-- Logs begin at Thu 2022-05-12 05:49:18 UTC, end at Thu 2022-05-12 07:37:41 UTC. -- May 12 06:30:02.760892 dv-cinder-766064-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 12 06:30:02.769675 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 12 06:30:02.771655 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 06:30:02 2022] *** May 12 06:30:02.771655 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 06:30:02.771655 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 06:30:02.771655 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: nodename: dv-cinder-766064-5-iscsi May 12 06:30:02.771655 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: machine: x86_64 May 12 06:30:02.771655 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: clock source: unix May 12 06:30:02.771655 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: pcre jit disabled May 12 06:30:02.771655 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: detected number of CPU cores: 4 May 12 06:30:02.771655 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: current working directory: / May 12 06:30:02.771655 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: detected binary path: /usr/bin/uwsgi-core May 12 06:30:02.772368 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: your processes number limit is 47680 May 12 06:30:02.772368 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: your memory page size is 4096 bytes May 12 06:30:02.772368 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: detected max file descriptor number: 2048 May 12 06:30:02.772368 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: lock engine: pthread robust mutexes May 12 06:30:02.772368 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: thunder lock: enabled May 12 06:30:02.772368 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 12 06:30:02.772368 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 06:30:02.819933 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: Python main interpreter initialized at 0x5638bb3009c0 May 12 06:30:02.819933 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: python threads support enabled May 12 06:30:02.819933 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: your server socket listen backlog is limited to 100 connections May 12 06:30:02.819933 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: your mercy for graceful operations on workers is 90 seconds May 12 06:30:02.820300 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: mapped 403077 bytes (393 KB) for 2 cores May 12 06:30:02.820378 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: *** Operational MODE: preforking *** May 12 06:30:02.820658 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: *** uWSGI is running in multiple interpreter mode *** May 12 06:30:02.820658 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: spawned uWSGI master process (pid: 80317) May 12 06:30:02.820844 dv-cinder-766064-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 12 06:30:02.823262 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: spawned uWSGI worker 1 (pid: 80358, cores: 1) May 12 06:30:02.823262 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: spawned uWSGI worker 2 (pid: 80359, cores: 1) May 12 06:30:02.823262 dv-cinder-766064-5-iscsi devstack@keystone.service[80317]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 06:30:08.572744 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 06:30:08.572744 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: from cryptography.utils import int_from_bytes May 12 06:30:08.573322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 06:30:08.573322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: from cryptography.utils import int_from_bytes May 12 06:30:08.574089 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 06:30:08.574089 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: from cryptography.utils import int_from_bytes May 12 06:30:08.574315 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 06:30:08.574315 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: from cryptography.utils import int_from_bytes May 12 06:30:08.624519 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 06:30:08.624695 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 06:30:08.624775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 06:30:08.624868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 06:30:08.624937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] command line args: [] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 06:30:08.625002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] command line args: [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 06:30:08.625234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 06:30:08.625327 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 06:30:08.625395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ================================================================================ {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 06:30:08.625466 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ================================================================================ {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 06:30:08.625532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] admin_token = **** {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.625598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] admin_token = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.625796 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] config_dir = [] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.625883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] config_dir = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.626028 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.626114 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.626183 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] config_source = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.626252 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] config_source = [] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.626318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] debug = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.626384 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] debug = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.626573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.626746 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.626846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.627904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.628022 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.628101 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.628177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.628245 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.628309 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.628382 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] list_limit = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.628454 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.628520 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] log_config_append = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.628520 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.628635 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] list_limit = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.628700 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] log_dir = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.628765 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] log_config_append = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.628835 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] log_file = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.628900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.628964 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.629029 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] log_dir = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.629093 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.629157 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] log_file = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.629227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.629292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.629356 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.629417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.629476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.629936 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.630166 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.630417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.630584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.630811 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.631014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.631323 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.631535 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.631814 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.632023 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.632224 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.632390 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.632619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.632786 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.632978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.633208 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.633374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.633571 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.633814 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.634011 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.634192 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.634192 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.634569 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.634802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.634974 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] publish_errors = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.634974 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.635265 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.635436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.635566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] publish_errors = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.635744 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.635880 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.636015 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.636106 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.636181 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.636343 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.636461 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] standard_threads = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.636548 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.636626 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.636703 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.636775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.636849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] standard_threads = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.636925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.637005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.637083 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] use_journal = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.637083 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] use_json = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.637239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.637353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] use_stderr = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.637930 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.638011 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] use_syslog = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.638093 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] use_journal = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.638093 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] use_json = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.638224 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.638302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] use_stderr = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.638375 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.638451 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] use_syslog = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.638519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.638584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 06:30:08.638683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.638752 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.638817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.638893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.638961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.638961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.639084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.639084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.639207 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.639207 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.639331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.639331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.639459 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.639526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.639596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.639673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.639769 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.639831 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.639902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.639968 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.640033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.640033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.640235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.640235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.640362 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.640441 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.640518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.640600 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.640680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.640757 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.640834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.640905 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.640975 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.641052 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.641129 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.641201 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.641277 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.641348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.641440 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.641520 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.641592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.641662 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.641737 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.641808 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.641877 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.641955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.642026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.642096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.642164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.642265 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.642387 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.642492 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.642614 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.642744 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.642972 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.643057 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.643214 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.643297 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.643538 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.643622 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.643715 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.643947 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.644194 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.645295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.645403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.645486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.645564 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.645634 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.645634 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.645818 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.645901 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.645982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.646056 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.646130 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.646206 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.646270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.646329 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.646388 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.646455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.646521 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.646593 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.646655 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.646714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.646890 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.646978 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.647092 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.647221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.647335 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.647452 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.647566 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.647666 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.647899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.648039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.648137 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.648281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.648361 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.648524 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.648617 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.648768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.648872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.649011 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.649122 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.649255 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.649350 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.649494 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.649593 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.649726 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.649826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.649976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.650065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.650213 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.650301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.650453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.650532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.650686 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.650764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.650926 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.651024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.651160 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.651246 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.651392 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.651470 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.651620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.651806 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.651886 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.652091 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.652181 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.652334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.652414 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.652576 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.652656 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.652810 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.652924 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.653093 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.653173 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.653332 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.653413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.653561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.653647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.653799 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.653934 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.654023 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.654181 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.654276 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.654425 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.654508 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.654674 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.654762 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.654920 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.655012 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.655155 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.655235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.655395 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.655475 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.655640 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.655951 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.656025 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.656158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.656245 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.656391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.656470 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.656627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.656707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.656867 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.656953 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.657109 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.657188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.657348 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.657426 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.657583 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.657661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.657819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.657899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.658054 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.658133 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.658292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.658377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.658528 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.658606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.658766 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.658846 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.659000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.659079 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.659241 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.659331 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.659477 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.659561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.659737 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.659928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.660052 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.660173 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.660293 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.660414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.660532 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.660645 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.660757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.660877 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.660997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.661110 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.661223 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] auth.external = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.661335 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.661453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.661574 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.661688 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.661809 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.661922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.662034 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.662153 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] auth.password = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.662267 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.662380 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] auth.token = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.662502 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.662645 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.662767 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.662882 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.662995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] auth.external = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.663115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.663240 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.663355 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.663481 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.663596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.663729 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.663846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.663971 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] auth.password = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.664087 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.664200 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] auth.token = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.664319 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] credential.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.664433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.664547 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.664671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.664791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.664905 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.665019 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.665124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.665236 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.665417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.665786 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.665904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.666017 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.666130 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.666243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.666366 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] credential.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.666481 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.666593 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.666714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.666839 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.666959 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.667046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.667121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.667193 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.667266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.667338 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.667485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.667573 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.667759 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.667883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.668021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.668139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.668253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.668377 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.668511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.668627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.668741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.668854 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.668967 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.669088 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.669211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.669325 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.669438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.669550 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.669663 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.669785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.669898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.670011 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] federation.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.670123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.670236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.670357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.670479 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.670594 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.670706 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.670820 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.670933 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.671046 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.671167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.671315 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.671431 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.671544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.671656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.671800 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.671917 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.672031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.672150 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.672264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.672383 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.672505 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.672619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.672731 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.672843 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.672958 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.673070 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.673191 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.673305 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.673418 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.673530 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.673650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.673764 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.673884 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.673999 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.674112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.674224 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.674336 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.674449 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.674570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.674684 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.674797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.674910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.675032 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.675150 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.675275 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.675388 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.675500 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.675612 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.675754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.675944 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.676084 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.676200 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.676313 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.676425 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.676536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.676649 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.676770 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.676885 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.676998 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.677112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.677225 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.677344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.677466 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.677581 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.677694 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.677806 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.677919 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.678038 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.678161 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.678275 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.678387 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.678499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.678612 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.678724 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.678845 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.678960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.679072 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.679184 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.679297 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.679411 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.679531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.679646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.679790 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.679904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.680016 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.680128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.680252 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.680368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.680481 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.680594 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.680705 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.680818 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.680940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.681054 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.681168 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.681284 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.681408 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.681530 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.681652 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.681772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.681887 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.682000 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.682112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.682224 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.682347 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.682461 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.682575 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.682688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.682808 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.682929 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.683044 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.683156 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.683269 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.683382 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.683501 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.683623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.683762 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.683878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.683992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.684613 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.684790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.684939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.685056 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.685176 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.685289 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.685402 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.685516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.685637 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.685752 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.685865 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.685982 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.686101 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.686221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.686342 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.686456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.686570 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.686683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.686802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.686920 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.687041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.687155 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.687268 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.687381 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.687493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.687607 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.687798 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.687916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.688030 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.688143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.688255 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.688368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.688556 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.688680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.688794 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.688907 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.689020 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.689133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.689255 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.689369 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.689481 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.689598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.689712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.689824 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.689945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.690060 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.690172 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.690285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.690397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.690510 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.690630 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.690745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.690857 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.690970 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.691082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.691187 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.691307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.691422 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.691534 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.691654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.691793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.691907 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.692031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.692147 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.692260 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.692372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.692484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.692600 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.692714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.692830 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.692945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.693058 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.693170 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.693283 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.693404 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.693518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.693631 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.693743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.693855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] resource.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.693972 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.694111 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.694226 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.694340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.694453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.694566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.694679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.694800 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.694915 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] role.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.695028 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.695141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] role.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.695255 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.695367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.695489 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.695603 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.695768 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.695885 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.696015 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.696015 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] role.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.696237 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.696351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] role.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.696464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.696576 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.696688 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.696688 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.696909 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.697023 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.697134 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.697248 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.697360 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.697484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.697597 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.697710 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.697822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.697935 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.698048 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.698170 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.698284 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.698397 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.698524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.698524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.698848 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.698974 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.699089 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.699202 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.699316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.699429 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.699542 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.699664 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.700395 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.700395 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.700621 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.700734 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.700847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.700972 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.701087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.701200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.701314 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.701426 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.701538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.701650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.701764 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.701877 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.701990 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.702068 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.702149 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.702223 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.702295 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.702368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.702440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.702511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.702595 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.702669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.702740 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.702812 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.702890 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.702990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.703079 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.703228 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] token.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.703308 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.703466 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.703546 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.703737 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.703927 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.704052 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.704165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.704278 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.704392 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.704504 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.704625 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] token.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.704740 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.704855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.704969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.705081 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.705193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.705318 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.705433 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.705548 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.705661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.705773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.705885 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.706005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.706119 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.706232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.706349 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.706462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.706575 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.706696 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.706810 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.706923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.707034 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.707146 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.707258 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.707378 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.707492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] database.connection = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.707640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.707798 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.707915 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.708028 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.708140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.708261 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.708375 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.708487 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.708640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.708758 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.708871 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.709057 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.connection = **** {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.709182 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.709309 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.709424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.709537 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.709652 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.709765 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.709879 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.709999 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.710113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.710227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.710340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.710452 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.710565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.710687 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.710802 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.710914 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.710914 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.711126 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.711239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.711359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.711473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.711586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.711751 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.711869 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.711869 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 06:30:08.712096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.712213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.712361 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.712593 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.712833 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.713067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 06:30:08.713237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 06:30:08.742871 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.743088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.743217 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.743303 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.743436 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.743664 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.752675 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.753000 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.781649 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.781880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.781972 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.782151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.835989 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.836207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.887079 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.887376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.887680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.887938 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.962864 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.963095 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.963299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.963391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.963523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.963605 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.963774 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.963917 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.964005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.964085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.964206 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.964426 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.991024 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.991680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.991793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.991859 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.991933 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.992027 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.992104 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.992177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.992251 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.992324 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.992406 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.992480 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.992553 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:08.992625 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:09.002740 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:09.003076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:09.017380 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:09.017616 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:09.017789 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:09.017874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:09.018028 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:09.018112 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:09.018237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:09.018317 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:09.018447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:09.018530 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:09.018658 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:09.018741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:09.018878 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:09.019093 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 06:30:09.035952 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.036166 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 06:30:09.036251 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.036379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 06:30:09.036503 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.036705 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 06:30:09.036784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.036902 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 06:30:09.036984 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.037168 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.037248 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.037424 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.037512 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.037679 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.037761 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.037933 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.049513 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.049760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.049858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.050037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.050120 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.050306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.050389 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.050586 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.058434 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.058657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.062402 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.062523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.062683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.062801 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.062966 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.063081 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.063360 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.063466 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.063645 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.063772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.063935 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.064037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.064207 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.064299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.064479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.064560 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.064747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.064827 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.065016 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.065099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.065285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.065364 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.091646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.091915 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.093542 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.093830 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.094711 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.094992 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.099192 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.099449 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.099745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.100305 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.100585 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.100860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.107669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.107968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.108774 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.109055 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.112620 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.112904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.113183 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.113461 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.113684 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.113766 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.113967 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.114058 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.114244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.114326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.114511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.114593 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.114782 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.115053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.115318 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.115582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.133101 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.133377 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.134148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.134422 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.138435 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.139437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.142067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.142358 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.143069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.143369 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.147310 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.148339 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.150895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.151922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.155248 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.155545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.155855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.156139 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.156276 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.156418 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.156557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.156694 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.156824 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.157050 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.157325 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.157599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.175889 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.176262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.176531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.176743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.176871 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.177115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.177384 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.177647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.184741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.185540 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.186461 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.186739 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.187248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.187521 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.189860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.190139 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.190428 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.190584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.190708 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.190860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.190983 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.191151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.191431 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.191726 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.204930 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.205209 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.205491 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.205691 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.205778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.205969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.206087 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.206249 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.206341 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.206535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.206667 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.206811 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.207103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.207377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.224670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.225460 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.227976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.228761 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.231849 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.232657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.233447 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.234285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.235097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.235374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.235676 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.235951 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.236229 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.236515 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.243138 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.243988 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.244796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.245587 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.248116 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.248405 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.248700 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.248868 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.248976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.249153 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.249432 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.249714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.258176 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.258471 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.258751 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.258933 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.259226 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.259501 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.267318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.267596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.267903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.268044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 06:30:09.268182 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.268321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.268455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.268599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.268741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.268872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.269030 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.269137 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.269304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.269412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.269573 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.269680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.269846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.269960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.270112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.270226 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.270385 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.270540 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.270663 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.270780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.270925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.271060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.271240 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.271503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 06:30:09.310434 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5638bb3009c0 pid: 80358 (default app) May 12 06:30:09.310807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5638bb3009c0 pid: 80359 (default app) May 12 06:30:09.313876 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f1d0d-e3b9-4b09-8f22-cc0f87ce00aa None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:09.314183 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f1d0d-e3b9-4b09-8f22-cc0f87ce00aa None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:09.314464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f1d0d-e3b9-4b09-8f22-cc0f87ce00aa None None] PATH_INFO: `/v3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:09.318674 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Thu May 12 06:30:09 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:18.467373 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc2c0f-649c-4836-a989-a130a30d7712 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:18.467966 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc2c0f-649c-4836-a989-a130a30d7712 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:18.467966 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc2c0f-649c-4836-a989-a130a30d7712 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:18.472254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:30:18.477273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce84e9-fc6c-4c39-89d5-6128676ee562 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:18.477655 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce84e9-fc6c-4c39-89d5-6128676ee562 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:18.477827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce84e9-fc6c-4c39-89d5-6128676ee562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:18.508416 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG oslo_db.sqlalchemy.engines [None req-f4ce84e9-fc6c-4c39-89d5-6128676ee562 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 06:30:18.691273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG passlib.handlers.bcrypt [None req-f4ce84e9-fc6c-4c39-89d5-6128676ee562 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80358) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 06:30:18.691720 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG passlib.handlers.bcrypt [None req-f4ce84e9-fc6c-4c39-89d5-6128676ee562 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80358) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 06:30:18.747447 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f4ce84e9-fc6c-4c39-89d5-6128676ee562 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:18.749089 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f4ce84e9-fc6c-4c39-89d5-6128676ee562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:18.871385 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 12 06:30:19.037384 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc2c0f-649c-4836-a989-a130a30d7712 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:19.070729 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG oslo_db.sqlalchemy.engines [None req-1adc2c0f-649c-4836-a989-a130a30d7712 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 06:30:19.197782 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc2c0f-649c-4836-a989-a130a30d7712 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:19.202619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabc0e9-a4c7-4e89-bba2-13993d6cebad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:19.203270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabc0e9-a4c7-4e89-bba2-13993d6cebad admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:19.203548 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabc0e9-a4c7-4e89-bba2-13993d6cebad admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:19.203872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabc0e9-a4c7-4e89-bba2-13993d6cebad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:19.211745 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabc0e9-a4c7-4e89-bba2-13993d6cebad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:19.264227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6eabc0e9-a4c7-4e89-bba2-13993d6cebad admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 06:30:19.264568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabc0e9-a4c7-4e89-bba2-13993d6cebad admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:19.274180 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Thu May 12 06:30:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 06:30:19.280611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce84e9-fc6c-4c39-89d5-6128676ee562 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:19.295457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce84e9-fc6c-4c39-89d5-6128676ee562 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:19.299848 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d179cfd-de8f-4b45-9bcd-22712dfcda85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:19.300967 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d179cfd-de8f-4b45-9bcd-22712dfcda85 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:19.301253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d179cfd-de8f-4b45-9bcd-22712dfcda85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:19.301529 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d179cfd-de8f-4b45-9bcd-22712dfcda85 admin admin] PATH_INFO: `/v3/projects/ce2018cacb6f4eb3a54694e57a783679` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:19.303028 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d179cfd-de8f-4b45-9bcd-22712dfcda85 admin admin] RBAC: Authorizing `identity:get_project(project_id=ce2018cacb6f4eb3a54694e57a783679)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:19.353319 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5d179cfd-de8f-4b45-9bcd-22712dfcda85 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 06:30:19.353665 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d179cfd-de8f-4b45-9bcd-22712dfcda85 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:19.358795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Thu May 12 06:30:19 2022] GET /identity/v3/projects/ce2018cacb6f4eb3a54694e57a783679 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:21.517104 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8162736-6439-4b2e-8a43-2a01b7c573fa None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:21.517653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8162736-6439-4b2e-8a43-2a01b7c573fa None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:21.517653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8162736-6439-4b2e-8a43-2a01b7c573fa None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:21.521811 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:21.527838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b87370-bf2c-450c-895f-e1b7ab093748 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:21.528258 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b87370-bf2c-450c-895f-e1b7ab093748 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:21.528406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b87370-bf2c-450c-895f-e1b7ab093748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:21.549044 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-08b87370-bf2c-450c-895f-e1b7ab093748 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:21.550580 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-08b87370-bf2c-450c-895f-e1b7ab093748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:21.558458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 12 06:30:21.580446 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8162736-6439-4b2e-8a43-2a01b7c573fa None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:21.592722 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8162736-6439-4b2e-8a43-2a01b7c573fa None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:21.596991 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bd5f5-c792-4919-8585-fd6bb26cf228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:21.597620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bd5f5-c792-4919-8585-fd6bb26cf228 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:21.597934 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bd5f5-c792-4919-8585-fd6bb26cf228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:21.598205 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bd5f5-c792-4919-8585-fd6bb26cf228 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:21.606441 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bd5f5-c792-4919-8585-fd6bb26cf228 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:21.608231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bd5f5-c792-4919-8585-fd6bb26cf228 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:21.616739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Thu May 12 06:30:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 06:30:21.622137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b87370-bf2c-450c-895f-e1b7ab093748 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:21.631040 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b87370-bf2c-450c-895f-e1b7ab093748 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:21.635421 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a1d42-1b89-4b84-be1a-4ffccb272947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:21.636305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a1d42-1b89-4b84-be1a-4ffccb272947 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:21.636592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a1d42-1b89-4b84-be1a-4ffccb272947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:21.636870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a1d42-1b89-4b84-be1a-4ffccb272947 admin admin] PATH_INFO: `/v3/users/79cb9f096a814d81a7a9552741bc1a1f` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:21.638275 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a1d42-1b89-4b84-be1a-4ffccb272947 admin admin] RBAC: Authorizing `identity:get_user(user_id=79cb9f096a814d81a7a9552741bc1a1f)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:21.640122 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a1d42-1b89-4b84-be1a-4ffccb272947 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:21.641689 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Thu May 12 06:30:21 2022] GET /identity/v3/users/79cb9f096a814d81a7a9552741bc1a1f => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:23.890001 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1994d66-510a-4fe7-a1eb-affb488526d8 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:23.890509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1994d66-510a-4fe7-a1eb-affb488526d8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:23.890612 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1994d66-510a-4fe7-a1eb-affb488526d8 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:23.891932 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:30:23.897018 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c685d3b-9bce-48f6-8551-d30bad9c89e7 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:23.897416 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c685d3b-9bce-48f6-8551-d30bad9c89e7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:23.897578 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c685d3b-9bce-48f6-8551-d30bad9c89e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:23.908182 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e0092-dbe3-4d21-914b-eebd65cc9f87 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:23.908471 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e0092-dbe3-4d21-914b-eebd65cc9f87 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:23.908751 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e0092-dbe3-4d21-914b-eebd65cc9f87 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:23.910102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:30:23.916218 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355861b5-6d8e-485e-8a18-25d126638f13 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:23.916505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355861b5-6d8e-485e-8a18-25d126638f13 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:23.916779 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355861b5-6d8e-485e-8a18-25d126638f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:23.958226 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG passlib.handlers.bcrypt [None req-355861b5-6d8e-485e-8a18-25d126638f13 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80359) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 06:30:23.958647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG passlib.handlers.bcrypt [None req-355861b5-6d8e-485e-8a18-25d126638f13 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80359) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 06:30:24.005935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-355861b5-6d8e-485e-8a18-25d126638f13 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:24.007575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-355861b5-6d8e-485e-8a18-25d126638f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:24.023104 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6c685d3b-9bce-48f6-8551-d30bad9c89e7 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:24.024298 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6c685d3b-9bce-48f6-8551-d30bad9c89e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:24.102178 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:24.104293 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:30:24.125092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c685d3b-9bce-48f6-8551-d30bad9c89e7 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:24.126033 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355861b5-6d8e-485e-8a18-25d126638f13 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:24.220994 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c685d3b-9bce-48f6-8551-d30bad9c89e7 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:24.221603 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355861b5-6d8e-485e-8a18-25d126638f13 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:24.252991 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca14ab-6c55-4564-8552-77c4897a924a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:24.253784 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca14ab-6c55-4564-8552-77c4897a924a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:24.254064 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca14ab-6c55-4564-8552-77c4897a924a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:24.254175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4c957-792e-47ac-bc62-46055126b13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:24.254335 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca14ab-6c55-4564-8552-77c4897a924a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:24.255040 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4c957-792e-47ac-bc62-46055126b13a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:24.255328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4c957-792e-47ac-bc62-46055126b13a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:24.255605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4c957-792e-47ac-bc62-46055126b13a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:24.265231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca14ab-6c55-4564-8552-77c4897a924a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:24.276264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-23ca14ab-6c55-4564-8552-77c4897a924a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:30:24.276264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:24.276264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:24.276264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:24.276264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:24.276264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:24.276264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:24.276264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:24.276264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:24.276264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:24.276264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:24.276264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:24.276264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:24.276264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:24.276264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:24.276264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:24.277838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:24.277838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:24.277838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:24.277838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:24.277838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:24.277838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:24.277838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:24.277838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:24.277838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:24.277838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:24.277838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:24.277838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:30:24.277838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:24.277838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:24.277838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:24.277838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:24.278958 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:24.278958 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:24.278958 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:24.278958 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:24.278958 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:24.278958 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:24.278958 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:24.278958 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:24.278958 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:24.278958 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:24.278958 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:30:24.278958 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:30:24.282716 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:30:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:30:24.283665 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca14ab-6c55-4564-8552-77c4897a924a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:24.322694 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4c957-792e-47ac-bc62-46055126b13a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:24.324270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4c957-792e-47ac-bc62-46055126b13a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:24.379232 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca14ab-6c55-4564-8552-77c4897a924a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:24.411334 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49347a1-b96e-4c8b-bf55-f931a7a83567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:24.412022 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49347a1-b96e-4c8b-bf55-f931a7a83567 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:24.412312 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49347a1-b96e-4c8b-bf55-f931a7a83567 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:24.412589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49347a1-b96e-4c8b-bf55-f931a7a83567 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:24.413341 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49347a1-b96e-4c8b-bf55-f931a7a83567 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:24.413647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49347a1-b96e-4c8b-bf55-f931a7a83567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:24.415038 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49347a1-b96e-4c8b-bf55-f931a7a83567 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:24.415275 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 8/15] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:30:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 06:30:24.421497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4c957-792e-47ac-bc62-46055126b13a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:24.427488 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 8/16] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:30:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:30:24.432737 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49347a1-b96e-4c8b-bf55-f931a7a83567 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:24.515140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4c957-792e-47ac-bc62-46055126b13a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:24.527443 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49347a1-b96e-4c8b-bf55-f931a7a83567 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:24.547309 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec89e94-656e-43c0-b650-7ba517457491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:24.548145 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec89e94-656e-43c0-b650-7ba517457491 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:24.548431 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec89e94-656e-43c0-b650-7ba517457491 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:24.548702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec89e94-656e-43c0-b650-7ba517457491 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:24.562961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafdee8-a047-4445-8b37-656f6ed6719c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:24.563905 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafdee8-a047-4445-8b37-656f6ed6719c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:24.564190 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafdee8-a047-4445-8b37-656f6ed6719c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:24.564460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafdee8-a047-4445-8b37-656f6ed6719c None admin] PATH_INFO: `/v3/users/79cb9f096a814d81a7a9552741bc1a1f` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:24.565765 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafdee8-a047-4445-8b37-656f6ed6719c None admin] RBAC: Authorizing `identity:get_user(user_id=79cb9f096a814d81a7a9552741bc1a1f)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:24.567255 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafdee8-a047-4445-8b37-656f6ed6719c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:24.569006 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:24 2022] GET /identity/v3/users/79cb9f096a814d81a7a9552741bc1a1f => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:30:24.574783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafdee8-a047-4445-8b37-656f6ed6719c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:24.674817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafdee8-a047-4445-8b37-656f6ed6719c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:24.675021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec89e94-656e-43c0-b650-7ba517457491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:24.676335 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec89e94-656e-43c0-b650-7ba517457491 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:24.697302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-0ec89e94-656e-43c0-b650-7ba517457491 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:30:24.697302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:24.697302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:24.697302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:24.697302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:24.697302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:24.697302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:24.697302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:24.697302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:24.697302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:24.697302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:24.697302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:24.697302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:30:24.697302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:30:24.697302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:30:24.698148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:30:24.698148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:24.698148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:24.698148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:24.698148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:24.698148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:24.698148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:24.698148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:24.698148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:30:24.698148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:24.698148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:24.698148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:24.698148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:24.698148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:24.698148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:24.698148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:24.698148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:24.698989 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:30:24.698989 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:30:24.698989 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:30:24.698989 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:30:24.698989 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 9/18] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:30:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:30:24.704381 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec89e94-656e-43c0-b650-7ba517457491 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:24.710680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828d092-c2d3-4bde-95a7-abe19c12013c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:24.711474 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828d092-c2d3-4bde-95a7-abe19c12013c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:24.711796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828d092-c2d3-4bde-95a7-abe19c12013c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:24.712076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828d092-c2d3-4bde-95a7-abe19c12013c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:24.713273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828d092-c2d3-4bde-95a7-abe19c12013c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:24.715196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828d092-c2d3-4bde-95a7-abe19c12013c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:24.716834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 10/19] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:30:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:30:24.722344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828d092-c2d3-4bde-95a7-abe19c12013c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:24.799733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec89e94-656e-43c0-b650-7ba517457491 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:24.816318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828d092-c2d3-4bde-95a7-abe19c12013c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:24.831636 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb19f6f-9c3d-40d2-b444-5b7c33bd2aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:24.832333 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb19f6f-9c3d-40d2-b444-5b7c33bd2aec None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:24.832612 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb19f6f-9c3d-40d2-b444-5b7c33bd2aec None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:24.832882 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb19f6f-9c3d-40d2-b444-5b7c33bd2aec None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:24.833604 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb19f6f-9c3d-40d2-b444-5b7c33bd2aec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:24.833907 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb19f6f-9c3d-40d2-b444-5b7c33bd2aec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:24.835276 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb19f6f-9c3d-40d2-b444-5b7c33bd2aec None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:24.848586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6922d-5906-4967-a7a4-7aa4aee86092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:24.849236 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6922d-5906-4967-a7a4-7aa4aee86092 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:24.849521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6922d-5906-4967-a7a4-7aa4aee86092 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:24.849797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6922d-5906-4967-a7a4-7aa4aee86092 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:24.850633 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6922d-5906-4967-a7a4-7aa4aee86092 None admin] RBAC: Adding query filter params (role.id=5e6a73052f3b4ee7829ecb858925e5ca, scope.domain.id=default, user.id=79cb9f096a814d81a7a9552741bc1a1f) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:24.850946 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6922d-5906-4967-a7a4-7aa4aee86092 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:24.852376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 10/20] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:30:24.852483 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6922d-5906-4967-a7a4-7aa4aee86092 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:24.859589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 11/21] 10.222.0.25 () {56 vars in 1322 bytes} [Thu May 12 06:30:24 2022] GET /identity/v3/role_assignments?user.id=79cb9f096a814d81a7a9552741bc1a1f&scope.domain.id=default&role.id=5e6a73052f3b4ee7829ecb858925e5ca => generated 233 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:30:27.536095 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460dd1c-d6e2-4e5b-ba1c-868882918aa3 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:27.536638 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460dd1c-d6e2-4e5b-ba1c-868882918aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:27.536638 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460dd1c-d6e2-4e5b-ba1c-868882918aa3 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:27.537991 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 11/22] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:27.548192 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59884c56-5144-4146-baf7-e1cd380a9e54 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:27.549143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59884c56-5144-4146-baf7-e1cd380a9e54 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:27.549613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59884c56-5144-4146-baf7-e1cd380a9e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:27.581241 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-59884c56-5144-4146-baf7-e1cd380a9e54 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:27.582755 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-59884c56-5144-4146-baf7-e1cd380a9e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:27.585044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646ce2d-ce4d-4d20-950d-46f0d2736e7c None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:27.585044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646ce2d-ce4d-4d20-950d-46f0d2736e7c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:27.585044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646ce2d-ce4d-4d20-950d-46f0d2736e7c None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:27.585686 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 12/23] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:27.590986 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a467-63dd-4b8c-9b20-d7246e4c435c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:27.591522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a467-63dd-4b8c-9b20-d7246e4c435c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:27.592031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a467-63dd-4b8c-9b20-d7246e4c435c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:27.624683 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-1c27a467-63dd-4b8c-9b20-d7246e4c435c None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:27.626292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1c27a467-63dd-4b8c-9b20-d7246e4c435c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:27.736490 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 12/24] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:27.737839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d987563-ad1c-4023-985c-613162dbbc2b None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:27.738282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d987563-ad1c-4023-985c-613162dbbc2b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:27.738402 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 13/25] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 12 06:30:27.743705 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d987563-ad1c-4023-985c-613162dbbc2b None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:27.745456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 13/26] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:27.761197 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cbeee-50c6-4b51-baf0-5c65f3b24a94 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:27.761495 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cbeee-50c6-4b51-baf0-5c65f3b24a94 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:27.761782 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cbeee-50c6-4b51-baf0-5c65f3b24a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:27.767473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d987563-ad1c-4023-985c-613162dbbc2b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:27.800839 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-775cbeee-50c6-4b51-baf0-5c65f3b24a94 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:27.802028 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-775cbeee-50c6-4b51-baf0-5c65f3b24a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:27.946448 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d987563-ad1c-4023-985c-613162dbbc2b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:27.953258 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 14/27] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:27.954232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cbeee-50c6-4b51-baf0-5c65f3b24a94 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:28.072314 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d836b-d253-4b06-9c7b-4a2b41433174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:28.073400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d836b-d253-4b06-9c7b-4a2b41433174 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:28.073863 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d836b-d253-4b06-9c7b-4a2b41433174 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:28.074304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d836b-d253-4b06-9c7b-4a2b41433174 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:28.083545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cbeee-50c6-4b51-baf0-5c65f3b24a94 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:28.118244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d836b-d253-4b06-9c7b-4a2b41433174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:28.126724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-3b8d836b-d253-4b06-9c7b-4a2b41433174 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:30:28.126724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:28.126724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:28.126724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:28.126724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:28.126724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:28.126724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:28.126724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:28.126724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:28.126724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:28.126724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:28.126724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:28.126724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:28.126724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:28.126724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:28.126724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:28.127764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:28.127764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:28.127764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:28.127764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:28.127764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:28.127764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:28.127764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:28.127764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:28.127764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:28.127764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:28.127764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:28.127764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:30:28.127764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:28.127764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:28.127764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:28.127764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:28.128592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:28.128592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:28.128592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:28.128592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:28.128592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:28.128592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:28.128592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:28.128592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:28.128592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:28.128592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:28.128592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:30:28.128592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:30:28.131257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f9002-2bdd-44d4-affa-a2186796c562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:28.132149 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f9002-2bdd-44d4-affa-a2186796c562 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:28.132398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f9002-2bdd-44d4-affa-a2186796c562 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:28.132798 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f9002-2bdd-44d4-affa-a2186796c562 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:28.133057 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 14/28] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:30:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:30:28.135178 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d836b-d253-4b06-9c7b-4a2b41433174 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:28.157621 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f9002-2bdd-44d4-affa-a2186796c562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:28.159434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f9002-2bdd-44d4-affa-a2186796c562 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:28.190285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-0d7f9002-2bdd-44d4-affa-a2186796c562 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:30:28.190285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:28.190285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:28.190285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:28.190285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:28.190285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:28.190285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:28.190285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:28.190285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:28.190285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:28.190285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:28.190285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:28.190285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:30:28.190285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:30:28.190285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:30:28.191151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:30:28.191151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:28.191151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:28.191151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:28.191151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:28.191151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:28.191151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:28.191151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:28.191151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:30:28.191151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:28.191151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:28.191151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:28.191151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:28.191151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:28.191151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:28.191151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:28.191151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:28.191978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:30:28.191978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:30:28.191978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:30:28.191978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:30:28.205826 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 15/29] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:30:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:30:28.208484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f9002-2bdd-44d4-affa-a2186796c562 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:28.288631 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d836b-d253-4b06-9c7b-4a2b41433174 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:28.333460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70819612-a79e-4eb0-929e-9c5b39562d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:28.334469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70819612-a79e-4eb0-929e-9c5b39562d4e None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:28.334945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70819612-a79e-4eb0-929e-9c5b39562d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:28.335408 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70819612-a79e-4eb0-929e-9c5b39562d4e None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:28.336375 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70819612-a79e-4eb0-929e-9c5b39562d4e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:28.337994 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70819612-a79e-4eb0-929e-9c5b39562d4e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:28.402769 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f9002-2bdd-44d4-affa-a2186796c562 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:28.443068 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65981a61-b358-44e9-b656-f93f890da5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:28.444132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65981a61-b358-44e9-b656-f93f890da5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:28.444700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65981a61-b358-44e9-b656-f93f890da5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:28.445464 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65981a61-b358-44e9-b656-f93f890da5d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:28.446247 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65981a61-b358-44e9-b656-f93f890da5d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:28.446617 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65981a61-b358-44e9-b656-f93f890da5d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:28.448031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65981a61-b358-44e9-b656-f93f890da5d7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:28.471752 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 16/30] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:30:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:28.473124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65981a61-b358-44e9-b656-f93f890da5d7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:28.570716 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 15/31] 10.222.0.25 () {60 vars in 1131 bytes} [Thu May 12 06:30:28 2022] POST /identity/v3/roles => generated 219 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:30:28.572742 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b8e73-f9d2-4d34-904d-607c1f5ff44b None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:28.572742 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b8e73-f9d2-4d34-904d-607c1f5ff44b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:28.573381 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b8e73-f9d2-4d34-904d-607c1f5ff44b None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:28.578862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 16/32] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:28.578862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b8e73-f9d2-4d34-904d-607c1f5ff44b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:28.596739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65981a61-b358-44e9-b656-f93f890da5d7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:28.640930 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cd1ce-1b0d-43f6-892d-a5f65152ad5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:28.641976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cd1ce-1b0d-43f6-892d-a5f65152ad5f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:28.642584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cd1ce-1b0d-43f6-892d-a5f65152ad5f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:28.643139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cd1ce-1b0d-43f6-892d-a5f65152ad5f None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:28.644489 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cd1ce-1b0d-43f6-892d-a5f65152ad5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:28.645049 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cd1ce-1b0d-43f6-892d-a5f65152ad5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:28.646949 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cd1ce-1b0d-43f6-892d-a5f65152ad5f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:28.663592 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 17/33] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:28.666207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9c0ff-ff14-44b9-b450-6442c277d3f3 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:28.666702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9c0ff-ff14-44b9-b450-6442c277d3f3 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:28.667361 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9c0ff-ff14-44b9-b450-6442c277d3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:28.691751 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-88c9c0ff-ff14-44b9-b450-6442c277d3f3 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:28.694552 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-88c9c0ff-ff14-44b9-b450-6442c277d3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:28.734217 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b8e73-f9d2-4d34-904d-607c1f5ff44b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:28.772468 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87bdeaf-cbd9-49d2-a442-46e6f665adb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:28.773358 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bdeaf-cbd9-49d2-a442-46e6f665adb9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:28.773641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bdeaf-cbd9-49d2-a442-46e6f665adb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:28.773914 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bdeaf-cbd9-49d2-a442-46e6f665adb9 None admin] PATH_INFO: `/v3/users/79cb9f096a814d81a7a9552741bc1a1f` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:28.775255 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87bdeaf-cbd9-49d2-a442-46e6f665adb9 None admin] RBAC: Authorizing `identity:get_user(user_id=79cb9f096a814d81a7a9552741bc1a1f)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:28.777378 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87bdeaf-cbd9-49d2-a442-46e6f665adb9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:28.779202 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 17/34] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:28 2022] GET /identity/v3/users/79cb9f096a814d81a7a9552741bc1a1f => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:28.780559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51404f1c-ce6e-40c5-8599-86a70f66cedb None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:28.780902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51404f1c-ce6e-40c5-8599-86a70f66cedb None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:28.781229 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51404f1c-ce6e-40c5-8599-86a70f66cedb None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:28.782548 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 18/35] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:28.783514 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51404f1c-ce6e-40c5-8599-86a70f66cedb None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:28.785998 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 18/36] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:28.787654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9c0ff-ff14-44b9-b450-6442c277d3f3 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:28.903536 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51404f1c-ce6e-40c5-8599-86a70f66cedb None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:28.907313 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9c0ff-ff14-44b9-b450-6442c277d3f3 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:28.942072 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544805f-d8ab-4a9c-80f0-7cadb387d5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:28.942072 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544805f-d8ab-4a9c-80f0-7cadb387d5a0 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:28.942072 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544805f-d8ab-4a9c-80f0-7cadb387d5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:28.942072 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544805f-d8ab-4a9c-80f0-7cadb387d5a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:28.943201 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544805f-d8ab-4a9c-80f0-7cadb387d5a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:28.944962 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544805f-d8ab-4a9c-80f0-7cadb387d5a0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:28.947354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9c659-c917-4180-8001-7b8fed54f4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:28.948324 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9c659-c917-4180-8001-7b8fed54f4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:28.949257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9c659-c917-4180-8001-7b8fed54f4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:28.955974 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9c659-c917-4180-8001-7b8fed54f4c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:28.955974 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9c659-c917-4180-8001-7b8fed54f4c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:28.955974 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9c659-c917-4180-8001-7b8fed54f4c1 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:28.955974 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 19/37] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:30:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:28.955974 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ef6d9-9f98-4e6d-8c51-2399d5758e45 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:28.956360 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ef6d9-9f98-4e6d-8c51-2399d5758e45 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:28.956427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ef6d9-9f98-4e6d-8c51-2399d5758e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:28.976407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-c46ef6d9-9f98-4e6d-8c51-2399d5758e45 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:28.980972 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c46ef6d9-9f98-4e6d-8c51-2399d5758e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:29.043314 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 20/38] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:29.044367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ef6d9-9f98-4e6d-8c51-2399d5758e45 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:29.062470 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 12 06:30:28 2022] POST /identity/v3/projects => generated 301 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:30:29.063360 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544805f-d8ab-4a9c-80f0-7cadb387d5a0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:29.154805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ef6d9-9f98-4e6d-8c51-2399d5758e45 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:29.188125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544805f-d8ab-4a9c-80f0-7cadb387d5a0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:29.200865 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c7320-22d1-45a8-8c68-cdc6ca5c0c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:29.202347 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c7320-22d1-45a8-8c68-cdc6ca5c0c5d None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:29.203186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c7320-22d1-45a8-8c68-cdc6ca5c0c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:29.203651 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c7320-22d1-45a8-8c68-cdc6ca5c0c5d None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:29.205017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c7320-22d1-45a8-8c68-cdc6ca5c0c5d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:29.207465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c7320-22d1-45a8-8c68-cdc6ca5c0c5d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:29.239188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f6c92-65e8-4d22-88b6-124eaa05a367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:29.240127 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f6c92-65e8-4d22-88b6-124eaa05a367 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:29.240416 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f6c92-65e8-4d22-88b6-124eaa05a367 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:29.240705 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f6c92-65e8-4d22-88b6-124eaa05a367 None admin] PATH_INFO: `/v3/domains/default/users/79cb9f096a814d81a7a9552741bc1a1f/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:29.242894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f6c92-65e8-4d22-88b6-124eaa05a367 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=79cb9f096a814d81a7a9552741bc1a1f, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:29.244419 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f6c92-65e8-4d22-88b6-124eaa05a367 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:29.315038 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 20/40] 10.222.0.25 () {58 vars in 1361 bytes} [Thu May 12 06:30:29 2022] PUT /identity/v3/domains/default/users/79cb9f096a814d81a7a9552741bc1a1f/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:30:29.316148 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f6c92-65e8-4d22-88b6-124eaa05a367 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:29.410946 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 21/41] 10.222.0.25 () {60 vars in 1131 bytes} [Thu May 12 06:30:29 2022] POST /identity/v3/roles => generated 225 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:30:29.413120 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39336d63-c783-4ea2-9ec4-2c54ba5690cb None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:29.413633 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39336d63-c783-4ea2-9ec4-2c54ba5690cb None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:29.414135 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39336d63-c783-4ea2-9ec4-2c54ba5690cb None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:29.416058 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 22/42] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:29.424226 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cec316-63d0-40de-bd5f-1b92fbf1a06f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:29.424838 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cec316-63d0-40de-bd5f-1b92fbf1a06f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:29.425334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cec316-63d0-40de-bd5f-1b92fbf1a06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:29.450458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-24cec316-63d0-40de-bd5f-1b92fbf1a06f None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:29.451175 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f6c92-65e8-4d22-88b6-124eaa05a367 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:29.453148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-24cec316-63d0-40de-bd5f-1b92fbf1a06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:29.496266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b0667-32a0-4c6d-a956-997f8a8d95fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:29.496740 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b0667-32a0-4c6d-a956-997f8a8d95fb None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:29.497025 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b0667-32a0-4c6d-a956-997f8a8d95fb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:29.497301 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b0667-32a0-4c6d-a956-997f8a8d95fb None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:29.498174 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b0667-32a0-4c6d-a956-997f8a8d95fb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:29.499788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b0667-32a0-4c6d-a956-997f8a8d95fb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:29.540829 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 23/43] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:29.571799 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cec316-63d0-40de-bd5f-1b92fbf1a06f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:29.587185 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 21/44] 10.222.0.25 () {60 vars in 1131 bytes} [Thu May 12 06:30:29 2022] POST /identity/v3/roles => generated 223 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:30:29.687426 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cec316-63d0-40de-bd5f-1b92fbf1a06f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:29.731112 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f30cc-1ce0-490a-a179-d4016f8d0852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:29.734668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f30cc-1ce0-490a-a179-d4016f8d0852 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:29.734668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f30cc-1ce0-490a-a179-d4016f8d0852 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:29.734668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f30cc-1ce0-490a-a179-d4016f8d0852 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:29.734668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f30cc-1ce0-490a-a179-d4016f8d0852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:29.735386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f30cc-1ce0-490a-a179-d4016f8d0852 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:29.737469 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 24/45] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:30:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:30:29.744468 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b0667-32a0-4c6d-a956-997f8a8d95fb None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:29.859372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b0667-32a0-4c6d-a956-997f8a8d95fb None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:29.901990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2f6c8-8d30-4dda-9437-64a6dedc54f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:29.902660 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2f6c8-8d30-4dda-9437-64a6dedc54f2 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:29.902939 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2f6c8-8d30-4dda-9437-64a6dedc54f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:29.903212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2f6c8-8d30-4dda-9437-64a6dedc54f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:29.904009 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2f6c8-8d30-4dda-9437-64a6dedc54f2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:29.905450 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2f6c8-8d30-4dda-9437-64a6dedc54f2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:30.013806 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 22/46] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 12 06:30:29 2022] POST /identity/v3/projects => generated 312 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:30:31.625455 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e1147-cb7d-4c7d-b5e0-f6b490123421 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:31.625986 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e1147-cb7d-4c7d-b5e0-f6b490123421 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:31.626073 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e1147-cb7d-4c7d-b5e0-f6b490123421 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:31.627388 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 25/47] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:31.633072 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdde99e-b3b3-4803-a501-7e353d28e12c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:31.633496 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdde99e-b3b3-4803-a501-7e353d28e12c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:31.633637 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdde99e-b3b3-4803-a501-7e353d28e12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:31.650992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9fdde99e-b3b3-4803-a501-7e353d28e12c None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:31.652588 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9fdde99e-b3b3-4803-a501-7e353d28e12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:31.720329 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 23/48] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:31.743211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e1147-cb7d-4c7d-b5e0-f6b490123421 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:31.848822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e1147-cb7d-4c7d-b5e0-f6b490123421 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:31.883262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d148682-2390-4765-91cd-49114281d890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:31.884143 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d148682-2390-4765-91cd-49114281d890 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:31.884429 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d148682-2390-4765-91cd-49114281d890 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:31.884703 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d148682-2390-4765-91cd-49114281d890 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:31.896563 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d148682-2390-4765-91cd-49114281d890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:31.906071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-3d148682-2390-4765-91cd-49114281d890 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:30:31.906071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:31.906071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:31.906071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:31.906071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:31.906071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:31.906071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:31.906071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:31.906071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:31.906071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:31.906071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:31.906071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:31.906071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:31.906071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:31.906071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:31.906071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:31.906945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:31.906945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:31.906945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:31.906945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:31.906945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:31.906945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:31.906945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:31.906945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:31.906945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:31.906945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:31.906945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:31.906945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:30:31.906945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:31.906945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:31.906945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:31.906945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:31.907760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:31.907760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:31.907760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:31.907760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:31.907760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:31.907760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:31.907760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:31.907760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:31.907760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:31.907760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:31.907760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:30:31.907760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:30:31.907760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 26/49] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:30:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:30:31.914267 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdde99e-b3b3-4803-a501-7e353d28e12c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:32.017028 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdde99e-b3b3-4803-a501-7e353d28e12c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:32.051860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2faf8-46f8-49b7-a33c-7c86f63c6e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:32.052643 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2faf8-46f8-49b7-a33c-7c86f63c6e08 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:32.052997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2faf8-46f8-49b7-a33c-7c86f63c6e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:32.053363 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2faf8-46f8-49b7-a33c-7c86f63c6e08 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:32.054207 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2faf8-46f8-49b7-a33c-7c86f63c6e08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:32.054526 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2faf8-46f8-49b7-a33c-7c86f63c6e08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:32.056018 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2faf8-46f8-49b7-a33c-7c86f63c6e08 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:32.065942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 24/50] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:30:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:32.071591 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d148682-2390-4765-91cd-49114281d890 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:32.174674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d148682-2390-4765-91cd-49114281d890 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:32.208027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029f955-3db6-4d17-9e0d-e81173988978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:32.208919 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029f955-3db6-4d17-9e0d-e81173988978 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:32.209211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029f955-3db6-4d17-9e0d-e81173988978 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:32.209487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029f955-3db6-4d17-9e0d-e81173988978 None admin] PATH_INFO: `/v3/users/79cb9f096a814d81a7a9552741bc1a1f` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:32.210951 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029f955-3db6-4d17-9e0d-e81173988978 None admin] RBAC: Authorizing `identity:get_user(user_id=79cb9f096a814d81a7a9552741bc1a1f)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:32.212453 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029f955-3db6-4d17-9e0d-e81173988978 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:32.214143 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 27/51] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:32 2022] GET /identity/v3/users/79cb9f096a814d81a7a9552741bc1a1f => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:32.219597 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2faf8-46f8-49b7-a33c-7c86f63c6e08 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:32.253241 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4898b-4da8-4f92-aa45-4d4774cbbca2 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:32.253541 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4898b-4da8-4f92-aa45-4d4774cbbca2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:32.253875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4898b-4da8-4f92-aa45-4d4774cbbca2 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:32.255181 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 28/52] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:30:32.260593 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1eb7f7-a35c-45c1-892a-111a6e92ee97 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:32.260886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1eb7f7-a35c-45c1-892a-111a6e92ee97 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:32.261732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1eb7f7-a35c-45c1-892a-111a6e92ee97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:32.278349 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4f1eb7f7-a35c-45c1-892a-111a6e92ee97 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:32.279557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4f1eb7f7-a35c-45c1-892a-111a6e92ee97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:32.332716 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2faf8-46f8-49b7-a33c-7c86f63c6e08 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:32.352369 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 29/53] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:30:32.369857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6b33d-6d58-4239-8461-e961823ef48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:32.371524 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6b33d-6d58-4239-8461-e961823ef48b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:32.372023 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6b33d-6d58-4239-8461-e961823ef48b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:32.372297 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6b33d-6d58-4239-8461-e961823ef48b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:32.373506 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6b33d-6d58-4239-8461-e961823ef48b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:32.374968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6b33d-6d58-4239-8461-e961823ef48b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:32.375642 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1eb7f7-a35c-45c1-892a-111a6e92ee97 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:32.376801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 25/54] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:30:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:32.383227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6b33d-6d58-4239-8461-e961823ef48b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:32.483767 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1eb7f7-a35c-45c1-892a-111a6e92ee97 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:32.485686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6b33d-6d58-4239-8461-e961823ef48b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:32.519620 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59e9d1-56b8-49dc-99e6-1d84b2af7cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:32.520316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59e9d1-56b8-49dc-99e6-1d84b2af7cfc None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:32.521511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59e9d1-56b8-49dc-99e6-1d84b2af7cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:32.521801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59e9d1-56b8-49dc-99e6-1d84b2af7cfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:32.522102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23479554-d8e9-47c9-99f4-f7c16692404e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:32.522662 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59e9d1-56b8-49dc-99e6-1d84b2af7cfc None admin] RBAC: Adding query filter params (role.id=5e6a73052f3b4ee7829ecb858925e5ca, scope.domain.id=default, user.id=79cb9f096a814d81a7a9552741bc1a1f) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:32.524200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59e9d1-56b8-49dc-99e6-1d84b2af7cfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:32.524870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59e9d1-56b8-49dc-99e6-1d84b2af7cfc None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:32.525067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23479554-d8e9-47c9-99f4-f7c16692404e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:32.525394 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23479554-d8e9-47c9-99f4-f7c16692404e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:32.525721 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23479554-d8e9-47c9-99f4-f7c16692404e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:32.527230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23479554-d8e9-47c9-99f4-f7c16692404e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:32.529043 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23479554-d8e9-47c9-99f4-f7c16692404e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:32.530896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 30/55] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:30:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:30:32.534437 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 26/56] 10.222.0.25 () {56 vars in 1322 bytes} [Thu May 12 06:30:32 2022] GET /identity/v3/role_assignments?user.id=79cb9f096a814d81a7a9552741bc1a1f&scope.domain.id=default&role.id=5e6a73052f3b4ee7829ecb858925e5ca => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:30:32.538466 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23479554-d8e9-47c9-99f4-f7c16692404e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:32.649483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23479554-d8e9-47c9-99f4-f7c16692404e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:32.687204 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c710a0-72b1-4806-a725-5de87c362eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:32.688210 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c710a0-72b1-4806-a725-5de87c362eb4 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:32.688640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c710a0-72b1-4806-a725-5de87c362eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:32.689059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c710a0-72b1-4806-a725-5de87c362eb4 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:32.689983 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c710a0-72b1-4806-a725-5de87c362eb4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:32.691635 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c710a0-72b1-4806-a725-5de87c362eb4 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:32.786573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 31/57] 10.222.0.25 () {60 vars in 1140 bytes} [Thu May 12 06:30:32 2022] POST /identity/v3/projects => generated 298 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:30:34.997506 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb3993-16b1-4911-ad96-3ef3904a2edd None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:34.997931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb3993-16b1-4911-ad96-3ef3904a2edd None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:34.998079 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb3993-16b1-4911-ad96-3ef3904a2edd None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:34.999530 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 27/58] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:35.005157 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f96de-4b72-4e75-955a-43de1dba741f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:35.005597 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f96de-4b72-4e75-955a-43de1dba741f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:35.005597 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f96de-4b72-4e75-955a-43de1dba741f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:35.022892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e33f96de-4b72-4e75-955a-43de1dba741f None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:35.024195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e33f96de-4b72-4e75-955a-43de1dba741f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:35.090791 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 32/59] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:35.114706 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb3993-16b1-4911-ad96-3ef3904a2edd None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:35.215987 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb3993-16b1-4911-ad96-3ef3904a2edd None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:35.248699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae75a84-cb9b-4a1e-bdb9-631ad0d3d6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:35.249489 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae75a84-cb9b-4a1e-bdb9-631ad0d3d6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:35.249768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae75a84-cb9b-4a1e-bdb9-631ad0d3d6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:35.250107 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae75a84-cb9b-4a1e-bdb9-631ad0d3d6b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:35.251314 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae75a84-cb9b-4a1e-bdb9-631ad0d3d6b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:35.252776 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae75a84-cb9b-4a1e-bdb9-631ad0d3d6b6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:35.254378 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 28/60] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:30:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:35.260033 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f96de-4b72-4e75-955a-43de1dba741f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:35.360318 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f96de-4b72-4e75-955a-43de1dba741f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:35.393580 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9e0ac-0263-449b-8684-67eead3a09d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:35.394254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9e0ac-0263-449b-8684-67eead3a09d3 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:35.394535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9e0ac-0263-449b-8684-67eead3a09d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:35.394808 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9e0ac-0263-449b-8684-67eead3a09d3 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:35.395539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9e0ac-0263-449b-8684-67eead3a09d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:35.397007 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9e0ac-0263-449b-8684-67eead3a09d3 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:35.520689 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 33/61] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 12 06:30:35 2022] POST /identity/v3/users => generated 275 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:30:38.809461 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42c3fd-6fe6-4859-9c36-354e8f3df707 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:38.810009 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42c3fd-6fe6-4859-9c36-354e8f3df707 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:38.810009 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42c3fd-6fe6-4859-9c36-354e8f3df707 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:38.811393 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 29/62] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:38.817686 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05851da-555f-4379-ade7-041545d75731 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:38.817686 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05851da-555f-4379-ade7-041545d75731 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:38.817686 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05851da-555f-4379-ade7-041545d75731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:38.836649 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-b05851da-555f-4379-ade7-041545d75731 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:38.837836 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b05851da-555f-4379-ade7-041545d75731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:38.879305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c584a6-002a-4291-b6da-89d5ad5f1568 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:38.879305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c584a6-002a-4291-b6da-89d5ad5f1568 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:38.879305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c584a6-002a-4291-b6da-89d5ad5f1568 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:38.880051 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 30/63] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:38.886508 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce84dd8-7db6-40f7-9e25-360b2c011bb4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:38.887138 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce84dd8-7db6-40f7-9e25-360b2c011bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:38.887740 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce84dd8-7db6-40f7-9e25-360b2c011bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:38.919225 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 34/64] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:30:38.936367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6ce84dd8-7db6-40f7-9e25-360b2c011bb4 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:38.937828 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6ce84dd8-7db6-40f7-9e25-360b2c011bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:38.944482 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05851da-555f-4379-ade7-041545d75731 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:39.077603 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 31/65] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:30:39.126543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce84dd8-7db6-40f7-9e25-360b2c011bb4 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:39.172843 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05851da-555f-4379-ade7-041545d75731 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:39.237221 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913140c-20f3-4047-a5f7-fc2c94c52dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:39.238293 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913140c-20f3-4047-a5f7-fc2c94c52dea None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:39.238729 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913140c-20f3-4047-a5f7-fc2c94c52dea None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:39.239152 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913140c-20f3-4047-a5f7-fc2c94c52dea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:39.257692 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913140c-20f3-4047-a5f7-fc2c94c52dea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:39.266820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-e913140c-20f3-4047-a5f7-fc2c94c52dea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 06:30:39.266820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:39.266820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:39.266820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:39.266820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:39.266820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:39.266820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:39.266820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:39.266820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:39.266820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:39.266820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:39.266820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:39.266820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:39.266820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:39.266820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:39.266820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:39.267925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:39.267925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:39.267925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:39.267925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:39.267925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:39.267925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:39.267925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:39.267925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:39.267925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:39.267925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:39.267925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:39.267925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:30:39.267925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:39.267925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:39.267925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:39.267925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:39.268731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:39.268731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:39.268731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:39.268731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:39.268731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:39.268731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:39.268731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:39.268731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:39.268731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:39.268731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:39.268731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 06:30:39.268731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:30:39.269361 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 35/66] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:30:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:30:39.276013 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913140c-20f3-4047-a5f7-fc2c94c52dea None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:39.329502 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce84dd8-7db6-40f7-9e25-360b2c011bb4 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:39.402497 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd4458-76da-4a1a-9da5-75e17d659550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:39.403653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd4458-76da-4a1a-9da5-75e17d659550 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:39.404168 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd4458-76da-4a1a-9da5-75e17d659550 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:39.404656 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd4458-76da-4a1a-9da5-75e17d659550 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:39.429068 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd4458-76da-4a1a-9da5-75e17d659550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:39.437262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-b3dd4458-76da-4a1a-9da5-75e17d659550 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:30:39.437262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:39.437262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:39.437262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:39.437262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:39.437262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:39.437262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:39.437262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:39.437262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:39.437262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:39.437262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:39.437262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:39.437262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:39.437262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:39.437262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:39.437262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:39.438133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:39.438133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:39.438133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:39.438133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:39.438133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:39.438133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:39.438133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:39.438133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:39.438133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:39.438133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:39.438133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:39.438133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:30:39.438133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:39.438133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:39.438133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:39.438133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:39.438899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:39.438899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:39.438899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:39.438899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:39.438899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:39.438899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:39.438899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:39.438899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:39.438899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:39.438899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:39.438899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:30:39.438899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:30:39.447218 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 32/67] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:30:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:30:39.463733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913140c-20f3-4047-a5f7-fc2c94c52dea None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:39.465549 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd4458-76da-4a1a-9da5-75e17d659550 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:39.514752 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216e436-4c6e-4fd3-94ae-b1e8b00829e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:39.516205 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216e436-4c6e-4fd3-94ae-b1e8b00829e6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:39.516940 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216e436-4c6e-4fd3-94ae-b1e8b00829e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:39.517414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216e436-4c6e-4fd3-94ae-b1e8b00829e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:39.518365 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216e436-4c6e-4fd3-94ae-b1e8b00829e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:39.518859 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216e436-4c6e-4fd3-94ae-b1e8b00829e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:39.521367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216e436-4c6e-4fd3-94ae-b1e8b00829e6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:39.532243 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 36/68] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:30:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:30:39.533814 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086de55c-b3c1-4e32-9a7f-62543280d542 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:39.534276 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086de55c-b3c1-4e32-9a7f-62543280d542 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:39.534721 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086de55c-b3c1-4e32-9a7f-62543280d542 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:39.536576 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 37/69] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:39.539956 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086de55c-b3c1-4e32-9a7f-62543280d542 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:39.592892 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd4458-76da-4a1a-9da5-75e17d659550 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:39.627480 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c3a40-e272-4461-abf6-64eac31c5b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:39.628553 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c3a40-e272-4461-abf6-64eac31c5b00 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:39.629047 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c3a40-e272-4461-abf6-64eac31c5b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:39.629507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c3a40-e272-4461-abf6-64eac31c5b00 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:39.630471 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c3a40-e272-4461-abf6-64eac31c5b00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:39.630977 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c3a40-e272-4461-abf6-64eac31c5b00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:39.632575 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c3a40-e272-4461-abf6-64eac31c5b00 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:39.642045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 33/70] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:30:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:30:39.643803 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb2042-209a-4f57-81b4-e47007e6dda3 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:39.644299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb2042-209a-4f57-81b4-e47007e6dda3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:39.644797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb2042-209a-4f57-81b4-e47007e6dda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:39.661705 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b3bb2042-209a-4f57-81b4-e47007e6dda3 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:39.663223 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b3bb2042-209a-4f57-81b4-e47007e6dda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:39.665564 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086de55c-b3c1-4e32-9a7f-62543280d542 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:39.710606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9dbd70-b047-40b6-a2c5-98b49d553531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:39.711497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9dbd70-b047-40b6-a2c5-98b49d553531 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:39.711809 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9dbd70-b047-40b6-a2c5-98b49d553531 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:39.712083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9dbd70-b047-40b6-a2c5-98b49d553531 None admin] PATH_INFO: `/v3/users/dffac131970f4d20b8b06d03ca4d1883` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:39.732479 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9dbd70-b047-40b6-a2c5-98b49d553531 None admin] RBAC: Authorizing `identity:get_user(user_id=dffac131970f4d20b8b06d03ca4d1883)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:39.733945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9dbd70-b047-40b6-a2c5-98b49d553531 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:39.734656 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 34/71] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:39.739886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 38/72] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:39 2022] GET /identity/v3/users/dffac131970f4d20b8b06d03ca4d1883 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:30:39.740042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb2042-209a-4f57-81b4-e47007e6dda3 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:39.742035 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9dbd70-b047-40b6-a2c5-98b49d553531 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:39.841054 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb2042-209a-4f57-81b4-e47007e6dda3 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:39.872148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9dbd70-b047-40b6-a2c5-98b49d553531 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:39.878505 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603d322-5f6a-4e8c-9f4b-a8d891a255aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:39.879642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603d322-5f6a-4e8c-9f4b-a8d891a255aa None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:39.880049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603d322-5f6a-4e8c-9f4b-a8d891a255aa None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:39.880624 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603d322-5f6a-4e8c-9f4b-a8d891a255aa None admin] PATH_INFO: `/v3/users/79cb9f096a814d81a7a9552741bc1a1f` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:39.882037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603d322-5f6a-4e8c-9f4b-a8d891a255aa None admin] RBAC: Authorizing `identity:get_user(user_id=79cb9f096a814d81a7a9552741bc1a1f)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:39.883609 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603d322-5f6a-4e8c-9f4b-a8d891a255aa None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:39.885970 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 35/73] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:39 2022] GET /identity/v3/users/79cb9f096a814d81a7a9552741bc1a1f => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:39.886980 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603d322-5f6a-4e8c-9f4b-a8d891a255aa None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:39.918189 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819e6e2-5087-43e0-b6bc-a1fefdb6133a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:39.919425 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819e6e2-5087-43e0-b6bc-a1fefdb6133a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:39.920159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819e6e2-5087-43e0-b6bc-a1fefdb6133a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:39.920631 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819e6e2-5087-43e0-b6bc-a1fefdb6133a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:40.005153 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819e6e2-5087-43e0-b6bc-a1fefdb6133a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:40.005452 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603d322-5f6a-4e8c-9f4b-a8d891a255aa None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:40.006849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819e6e2-5087-43e0-b6bc-a1fefdb6133a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:40.052151 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7945a62-513c-4e46-88e9-075320f1bc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:40.053239 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7945a62-513c-4e46-88e9-075320f1bc16 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:40.053525 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7945a62-513c-4e46-88e9-075320f1bc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:40.053966 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7945a62-513c-4e46-88e9-075320f1bc16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:40.065183 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7945a62-513c-4e46-88e9-075320f1bc16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:40.073852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-e7945a62-513c-4e46-88e9-075320f1bc16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:30:40.073852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:40.073852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:40.073852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:40.073852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:40.073852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:40.073852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:40.073852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:40.073852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:40.073852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:40.073852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:40.073852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:40.073852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:40.073852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:40.073852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:40.073852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:40.074707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:40.074707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:40.074707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:40.074707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:40.074707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:40.074707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:40.074707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:40.074707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:40.074707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:40.074707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:40.074707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:40.074707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:30:40.074707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:40.074707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:40.074707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:40.074707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:40.075473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:40.075473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:40.075473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:40.075473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:40.075473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:40.075473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:40.075473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:40.075473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:40.075473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:40.075473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:40.075473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:30:40.075473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:30:40.075473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 36/74] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:30:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:30:40.076655 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7945a62-513c-4e46-88e9-075320f1bc16 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:40.113680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 39/75] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:30:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:30:40.113680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38969b25-3ab2-44ff-a943-5b335076553a None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:40.113680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38969b25-3ab2-44ff-a943-5b335076553a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:40.113680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38969b25-3ab2-44ff-a943-5b335076553a None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:40.113680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 40/76] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:40.113680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38969b25-3ab2-44ff-a943-5b335076553a None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:40.183236 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7945a62-513c-4e46-88e9-075320f1bc16 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:40.213636 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38969b25-3ab2-44ff-a943-5b335076553a None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:40.215213 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbd645-0412-49f5-bfd0-8c6e3351f78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:40.215891 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbd645-0412-49f5-bfd0-8c6e3351f78a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:40.216179 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbd645-0412-49f5-bfd0-8c6e3351f78a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:40.216456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbd645-0412-49f5-bfd0-8c6e3351f78a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:40.246877 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d929f2e-6605-4f70-ab80-c7e66ddcf399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:40.247545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d929f2e-6605-4f70-ab80-c7e66ddcf399 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:40.247868 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d929f2e-6605-4f70-ab80-c7e66ddcf399 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:40.248144 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d929f2e-6605-4f70-ab80-c7e66ddcf399 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:40.248892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d929f2e-6605-4f70-ab80-c7e66ddcf399 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:40.249200 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d929f2e-6605-4f70-ab80-c7e66ddcf399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:40.250566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d929f2e-6605-4f70-ab80-c7e66ddcf399 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:40.258191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 41/77] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:30:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:40.258972 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d929f2e-6605-4f70-ab80-c7e66ddcf399 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:40.281423 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbd645-0412-49f5-bfd0-8c6e3351f78a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:40.282934 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbd645-0412-49f5-bfd0-8c6e3351f78a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:40.351226 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d929f2e-6605-4f70-ab80-c7e66ddcf399 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:40.374803 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 37/78] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:30:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:30:40.376098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e48ac8-1d43-4202-98aa-b18f6d96baaa None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:40.376388 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e48ac8-1d43-4202-98aa-b18f6d96baaa None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:40.376670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e48ac8-1d43-4202-98aa-b18f6d96baaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:40.383623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabc8ab-d3c5-4123-8c70-7a7b6f45a093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:40.384518 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabc8ab-d3c5-4123-8c70-7a7b6f45a093 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:40.384802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabc8ab-d3c5-4123-8c70-7a7b6f45a093 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:40.385081 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabc8ab-d3c5-4123-8c70-7a7b6f45a093 None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:40.386312 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabc8ab-d3c5-4123-8c70-7a7b6f45a093 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3884c9c1c84b738e43a478898c36f8)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:40.387859 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabc8ab-d3c5-4123-8c70-7a7b6f45a093 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:40.389560 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 42/79] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:30:40 2022] GET /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8 => generated 298 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:40.390724 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c65f5-260a-419c-bd7d-31db43b3b634 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:40.391071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c65f5-260a-419c-bd7d-31db43b3b634 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:40.391290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c65f5-260a-419c-bd7d-31db43b3b634 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:40.391959 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-75e48ac8-1d43-4202-98aa-b18f6d96baaa None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:40.394529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 43/80] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:40.394642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-75e48ac8-1d43-4202-98aa-b18f6d96baaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:40.394731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c65f5-260a-419c-bd7d-31db43b3b634 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:40.456619 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 38/81] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:40.457383 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e48ac8-1d43-4202-98aa-b18f6d96baaa None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:40.492605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c65f5-260a-419c-bd7d-31db43b3b634 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:40.523999 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e27e56-0de6-43c7-b2f2-ffda982193c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:40.524860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e27e56-0de6-43c7-b2f2-ffda982193c0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:40.525141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e27e56-0de6-43c7-b2f2-ffda982193c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:40.525412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e27e56-0de6-43c7-b2f2-ffda982193c0 None admin] PATH_INFO: `/v3/users/dffac131970f4d20b8b06d03ca4d1883` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:40.527117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e27e56-0de6-43c7-b2f2-ffda982193c0 None admin] RBAC: Authorizing `identity:get_user(user_id=dffac131970f4d20b8b06d03ca4d1883)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:40.528594 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e27e56-0de6-43c7-b2f2-ffda982193c0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:40.530353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 44/82] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:40 2022] GET /identity/v3/users/dffac131970f4d20b8b06d03ca4d1883 => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:40.531032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e27e56-0de6-43c7-b2f2-ffda982193c0 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:40.549637 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e48ac8-1d43-4202-98aa-b18f6d96baaa None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:40.582002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88106e-82fd-42e8-87b5-1b99cd698237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:40.582852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88106e-82fd-42e8-87b5-1b99cd698237 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:40.583136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88106e-82fd-42e8-87b5-1b99cd698237 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:40.583414 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88106e-82fd-42e8-87b5-1b99cd698237 None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:40.584645 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88106e-82fd-42e8-87b5-1b99cd698237 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3884c9c1c84b738e43a478898c36f8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:40.586089 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88106e-82fd-42e8-87b5-1b99cd698237 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:40.587804 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 39/83] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:30:40 2022] GET /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8 => generated 298 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:40.589438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b977db-f0c1-4dbd-8479-8656ba2d084a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:40.589722 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b977db-f0c1-4dbd-8479-8656ba2d084a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:40.589998 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b977db-f0c1-4dbd-8479-8656ba2d084a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:40.605340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-88b977db-f0c1-4dbd-8479-8656ba2d084a None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:40.606523 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-88b977db-f0c1-4dbd-8479-8656ba2d084a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:40.626055 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e27e56-0de6-43c7-b2f2-ffda982193c0 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:40.658002 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f33924-2fae-4158-a99a-4a11921c4d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:40.658653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f33924-2fae-4158-a99a-4a11921c4d77 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:40.658937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f33924-2fae-4158-a99a-4a11921c4d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:40.659212 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f33924-2fae-4158-a99a-4a11921c4d77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:40.660082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f33924-2fae-4158-a99a-4a11921c4d77 None admin] RBAC: Adding query filter params (role.id=2162d563a5344c26821a7961cb75468b, scope.project.id=0c3884c9c1c84b738e43a478898c36f8, user.id=dffac131970f4d20b8b06d03ca4d1883) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:40.660394 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f33924-2fae-4158-a99a-4a11921c4d77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:40.661849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f33924-2fae-4158-a99a-4a11921c4d77 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:40.670124 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 40/84] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:40.670249 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 45/85] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:30:40 2022] GET /identity/v3/role_assignments?user.id=dffac131970f4d20b8b06d03ca4d1883&scope.project.id=0c3884c9c1c84b738e43a478898c36f8&role.id=2162d563a5344c26821a7961cb75468b => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:40.670778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b977db-f0c1-4dbd-8479-8656ba2d084a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:40.670877 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f33924-2fae-4158-a99a-4a11921c4d77 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:40.779349 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f33924-2fae-4158-a99a-4a11921c4d77 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:40.781976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b977db-f0c1-4dbd-8479-8656ba2d084a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:40.814532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeb32c-9f0b-4541-aa53-dcc8f73f62c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:40.815297 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeb32c-9f0b-4541-aa53-dcc8f73f62c2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:40.815650 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeb32c-9f0b-4541-aa53-dcc8f73f62c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:40.815961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeb32c-9f0b-4541-aa53-dcc8f73f62c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:40.818096 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee77a3b-1dc4-4aa4-bcaa-d26bde82f8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:40.818899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee77a3b-1dc4-4aa4-bcaa-d26bde82f8fb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:40.819183 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee77a3b-1dc4-4aa4-bcaa-d26bde82f8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:40.819456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee77a3b-1dc4-4aa4-bcaa-d26bde82f8fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:40.821172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee77a3b-1dc4-4aa4-bcaa-d26bde82f8fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:40.822641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee77a3b-1dc4-4aa4-bcaa-d26bde82f8fb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:40.829216 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 41/86] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:30:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:40.829216 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee77a3b-1dc4-4aa4-bcaa-d26bde82f8fb None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:40.889239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aeb32c-9f0b-4541-aa53-dcc8f73f62c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:40.890700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aeb32c-9f0b-4541-aa53-dcc8f73f62c2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:40.924436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee77a3b-1dc4-4aa4-bcaa-d26bde82f8fb None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:40.957293 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa2ef3-4a6a-413f-8e2e-9c436fdd47b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:40.960099 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa2ef3-4a6a-413f-8e2e-9c436fdd47b5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:40.960491 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa2ef3-4a6a-413f-8e2e-9c436fdd47b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:40.960771 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa2ef3-4a6a-413f-8e2e-9c436fdd47b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:40.961637 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa2ef3-4a6a-413f-8e2e-9c436fdd47b5 None admin] RBAC: Adding query filter params (role.id=5e6a73052f3b4ee7829ecb858925e5ca, scope.project.id=0c3884c9c1c84b738e43a478898c36f8, user.id=79cb9f096a814d81a7a9552741bc1a1f) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:40.961954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa2ef3-4a6a-413f-8e2e-9c436fdd47b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:40.964489 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa2ef3-4a6a-413f-8e2e-9c436fdd47b5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:40.979954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 42/87] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:30:40 2022] GET /identity/v3/role_assignments?user.id=79cb9f096a814d81a7a9552741bc1a1f&scope.project.id=0c3884c9c1c84b738e43a478898c36f8&role.id=5e6a73052f3b4ee7829ecb858925e5ca => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:40.979954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa2ef3-4a6a-413f-8e2e-9c436fdd47b5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:40.989624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 46/88] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:30:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:30:40.990088 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeb32c-9f0b-4541-aa53-dcc8f73f62c2 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:41.090342 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa2ef3-4a6a-413f-8e2e-9c436fdd47b5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:41.095764 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeb32c-9f0b-4541-aa53-dcc8f73f62c2 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:41.126305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0572e82-a900-41cb-b885-a1f636c91221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:41.127122 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0572e82-a900-41cb-b885-a1f636c91221 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:41.127409 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0572e82-a900-41cb-b885-a1f636c91221 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:41.127713 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0572e82-a900-41cb-b885-a1f636c91221 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:41.132875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59afad3-9392-461a-8766-6afc88af74e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:41.133562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59afad3-9392-461a-8766-6afc88af74e1 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:41.133848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59afad3-9392-461a-8766-6afc88af74e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:41.134127 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59afad3-9392-461a-8766-6afc88af74e1 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:41.135047 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59afad3-9392-461a-8766-6afc88af74e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:41.137175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59afad3-9392-461a-8766-6afc88af74e1 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:41.140525 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0572e82-a900-41cb-b885-a1f636c91221 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:41.150125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-a0572e82-a900-41cb-b885-a1f636c91221 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 06:30:41.150125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:41.150125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:41.150125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:41.150125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:41.150125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:41.150125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:41.150125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:41.150125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:41.150125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:41.150125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:41.150125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:41.150125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:41.150125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:41.150125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:41.150125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:41.151117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:41.151117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:41.151117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:41.151117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:41.151117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:41.151117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:41.151117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:41.151117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:41.151117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:41.151117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:41.151117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:41.151117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:30:41.151117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:41.151117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:41.151117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:41.151117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:41.152499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:41.152499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:41.152499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:41.152499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:41.152499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:41.152499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:41.152499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:41.152499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:41.152499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:41.152499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:41.152499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 06:30:41.152499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:30:41.152499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 43/89] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:30:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:30:41.153249 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0572e82-a900-41cb-b885-a1f636c91221 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:41.220199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 47/90] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 12 06:30:40 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:30:41.221401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59afad3-9392-461a-8766-6afc88af74e1 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:41.299969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0572e82-a900-41cb-b885-a1f636c91221 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:41.346354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59afad3-9392-461a-8766-6afc88af74e1 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:41.387288 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fd1ab-82c7-4bf3-881e-c7f65c7d2008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:41.388422 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fd1ab-82c7-4bf3-881e-c7f65c7d2008 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:41.388907 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fd1ab-82c7-4bf3-881e-c7f65c7d2008 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:41.389381 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fd1ab-82c7-4bf3-881e-c7f65c7d2008 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:41.390569 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fd1ab-82c7-4bf3-881e-c7f65c7d2008 None admin] RBAC: Adding query filter params (name=member) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:41.391178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fd1ab-82c7-4bf3-881e-c7f65c7d2008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:41.392984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fd1ab-82c7-4bf3-881e-c7f65c7d2008 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:41.400447 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922ddd1-a6f6-4aa5-95c8-ff4b87ce23ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:41.401814 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922ddd1-a6f6-4aa5-95c8-ff4b87ce23ee None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:41.402102 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922ddd1-a6f6-4aa5-95c8-ff4b87ce23ee None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:41.402381 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922ddd1-a6f6-4aa5-95c8-ff4b87ce23ee None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:41.404130 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 48/91] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:30:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:41.404942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922ddd1-a6f6-4aa5-95c8-ff4b87ce23ee None admin] RBAC: Authorizing `identity:get_project(project_id=0c3884c9c1c84b738e43a478898c36f8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:41.406409 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922ddd1-a6f6-4aa5-95c8-ff4b87ce23ee None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:41.408412 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 44/92] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:30:41 2022] GET /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:41.418332 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922ddd1-a6f6-4aa5-95c8-ff4b87ce23ee None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:41.418521 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fd1ab-82c7-4bf3-881e-c7f65c7d2008 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:41.524661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fd1ab-82c7-4bf3-881e-c7f65c7d2008 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:41.546984 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922ddd1-a6f6-4aa5-95c8-ff4b87ce23ee None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:41.559558 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c136a-53be-4902-9206-138c6a5f4c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:41.560500 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c136a-53be-4902-9206-138c6a5f4c18 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:41.560787 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c136a-53be-4902-9206-138c6a5f4c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:41.561062 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c136a-53be-4902-9206-138c6a5f4c18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:41.561910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c136a-53be-4902-9206-138c6a5f4c18 None admin] RBAC: Adding query filter params (role.id=cba01848eb624bfaaeeb1244e02e5bd7, scope.project.id=0c3884c9c1c84b738e43a478898c36f8, user.id=dffac131970f4d20b8b06d03ca4d1883) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:41.562229 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c136a-53be-4902-9206-138c6a5f4c18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:41.564319 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c136a-53be-4902-9206-138c6a5f4c18 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:41.571201 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 49/93] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:30:41 2022] GET /identity/v3/role_assignments?user.id=dffac131970f4d20b8b06d03ca4d1883&scope.project.id=0c3884c9c1c84b738e43a478898c36f8&role.id=cba01848eb624bfaaeeb1244e02e5bd7 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:41.591193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6662cb-a71d-434d-814f-9217d6261212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:41.592670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6662cb-a71d-434d-814f-9217d6261212 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:41.593177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6662cb-a71d-434d-814f-9217d6261212 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:41.593681 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6662cb-a71d-434d-814f-9217d6261212 None admin] PATH_INFO: `/v3/users/dffac131970f4d20b8b06d03ca4d1883` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:41.595408 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6662cb-a71d-434d-814f-9217d6261212 None admin] RBAC: Authorizing `identity:get_user(user_id=dffac131970f4d20b8b06d03ca4d1883)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:41.597243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6662cb-a71d-434d-814f-9217d6261212 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:41.599951 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 45/94] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:41 2022] GET /identity/v3/users/dffac131970f4d20b8b06d03ca4d1883 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:30:41.609612 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c136a-53be-4902-9206-138c6a5f4c18 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:41.720535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c136a-53be-4902-9206-138c6a5f4c18 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:41.755886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b58fa7-483d-47c8-8c9b-84c40b7d0d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:41.756555 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b58fa7-483d-47c8-8c9b-84c40b7d0d1a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:41.756839 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b58fa7-483d-47c8-8c9b-84c40b7d0d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:41.757112 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b58fa7-483d-47c8-8c9b-84c40b7d0d1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:41.827423 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b58fa7-483d-47c8-8c9b-84c40b7d0d1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:41.828933 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b58fa7-483d-47c8-8c9b-84c40b7d0d1a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:41.929298 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 50/95] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:30:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:30:41.936883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6662cb-a71d-434d-814f-9217d6261212 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:42.093720 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6662cb-a71d-434d-814f-9217d6261212 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:42.134829 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3d75e-ae5d-40bd-b7bc-b495ae8aaad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:42.136037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3d75e-ae5d-40bd-b7bc-b495ae8aaad5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:42.136515 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3d75e-ae5d-40bd-b7bc-b495ae8aaad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:42.136968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3d75e-ae5d-40bd-b7bc-b495ae8aaad5 None admin] PATH_INFO: `/v3/projects/cfb01cb3dcdd456f8fa0525c42c829bb` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:42.138382 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3d75e-ae5d-40bd-b7bc-b495ae8aaad5 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb01cb3dcdd456f8fa0525c42c829bb)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:42.140031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3d75e-ae5d-40bd-b7bc-b495ae8aaad5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:42.143162 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 46/96] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:30:41 2022] GET /identity/v3/projects/cfb01cb3dcdd456f8fa0525c42c829bb => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:42.148135 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b58fa7-483d-47c8-8c9b-84c40b7d0d1a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:42.253337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b58fa7-483d-47c8-8c9b-84c40b7d0d1a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:42.292979 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38faaeaf-122e-4ac8-997f-ee9dea7e2305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:42.293938 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faaeaf-122e-4ac8-997f-ee9dea7e2305 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:42.294410 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faaeaf-122e-4ac8-997f-ee9dea7e2305 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:42.294852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faaeaf-122e-4ac8-997f-ee9dea7e2305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:42.295892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38faaeaf-122e-4ac8-997f-ee9dea7e2305 None admin] RBAC: Adding query filter params (role.id=2162d563a5344c26821a7961cb75468b, scope.project.id=cfb01cb3dcdd456f8fa0525c42c829bb, user.id=dffac131970f4d20b8b06d03ca4d1883) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:42.296397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38faaeaf-122e-4ac8-997f-ee9dea7e2305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:42.298017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38faaeaf-122e-4ac8-997f-ee9dea7e2305 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:42.304195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 51/97] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:30:42 2022] GET /identity/v3/role_assignments?user.id=dffac131970f4d20b8b06d03ca4d1883&scope.project.id=cfb01cb3dcdd456f8fa0525c42c829bb&role.id=2162d563a5344c26821a7961cb75468b => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:43.310268 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5cbe5-ed91-409b-bd9a-4cf0efdecbc9 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:43.310800 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5cbe5-ed91-409b-bd9a-4cf0efdecbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:43.310800 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5cbe5-ed91-409b-bd9a-4cf0efdecbc9 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:43.312488 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 47/98] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:43.325861 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c3b50-4db6-4f68-90dc-a9f3255461dd None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:43.326340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c3b50-4db6-4f68-90dc-a9f3255461dd None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:43.326415 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c3b50-4db6-4f68-90dc-a9f3255461dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:43.348815 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-576c3b50-4db6-4f68-90dc-a9f3255461dd None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:43.350041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-576c3b50-4db6-4f68-90dc-a9f3255461dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:43.434382 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 52/99] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:43.478355 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5cbe5-ed91-409b-bd9a-4cf0efdecbc9 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:43.593409 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5cbe5-ed91-409b-bd9a-4cf0efdecbc9 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:43.635086 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471b85e-096c-4b6e-aba9-3ca7fc99d178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:43.635967 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471b85e-096c-4b6e-aba9-3ca7fc99d178 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:43.636249 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471b85e-096c-4b6e-aba9-3ca7fc99d178 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:43.636520 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471b85e-096c-4b6e-aba9-3ca7fc99d178 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:43.653357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471b85e-096c-4b6e-aba9-3ca7fc99d178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:43.661014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-2471b85e-096c-4b6e-aba9-3ca7fc99d178 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 06:30:43.661014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:43.661014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:43.661014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:43.661014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:43.661014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:43.661014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:43.661014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:43.661014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:43.661014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:43.661014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:43.661014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:43.661014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:43.661014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:43.661014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:43.661014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:43.661860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:43.661860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:43.661860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:43.661860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:43.661860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:43.661860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:43.661860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:43.661860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:43.661860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:43.661860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:43.661860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:43.661860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:30:43.661860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:43.661860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:43.661860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:43.661860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:43.662648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:43.662648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:43.662648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:43.662648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:43.662648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:43.662648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:43.662648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:43.662648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:43.662648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:43.662648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:43.662648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 06:30:43.662648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:30:43.662648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 48/100] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:30:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:30:43.668775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c3b50-4db6-4f68-90dc-a9f3255461dd None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:43.785713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c3b50-4db6-4f68-90dc-a9f3255461dd None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:43.823209 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fb5a6-ac1e-4f74-9d28-4147a4da8c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:43.823910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fb5a6-ac1e-4f74-9d28-4147a4da8c88 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:43.824197 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fb5a6-ac1e-4f74-9d28-4147a4da8c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:43.824471 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fb5a6-ac1e-4f74-9d28-4147a4da8c88 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:43.825230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fb5a6-ac1e-4f74-9d28-4147a4da8c88 None admin] RBAC: Adding query filter params (name=member) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:43.825535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fb5a6-ac1e-4f74-9d28-4147a4da8c88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:43.826905 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fb5a6-ac1e-4f74-9d28-4147a4da8c88 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:43.839795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 53/101] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:30:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:43.841381 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471b85e-096c-4b6e-aba9-3ca7fc99d178 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:43.971024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471b85e-096c-4b6e-aba9-3ca7fc99d178 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:44.018358 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbdc1e-fed1-4760-9170-c2cf220d4a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:44.019235 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbdc1e-fed1-4760-9170-c2cf220d4a75 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:44.019523 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbdc1e-fed1-4760-9170-c2cf220d4a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:44.019825 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbdc1e-fed1-4760-9170-c2cf220d4a75 None admin] PATH_INFO: `/v3/users/dffac131970f4d20b8b06d03ca4d1883` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:44.021065 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbdc1e-fed1-4760-9170-c2cf220d4a75 None admin] RBAC: Authorizing `identity:get_user(user_id=dffac131970f4d20b8b06d03ca4d1883)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:44.022514 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbdc1e-fed1-4760-9170-c2cf220d4a75 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:44.024497 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 49/102] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:43 2022] GET /identity/v3/users/dffac131970f4d20b8b06d03ca4d1883 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:44.029630 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fb5a6-ac1e-4f74-9d28-4147a4da8c88 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:44.174890 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fb5a6-ac1e-4f74-9d28-4147a4da8c88 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:44.215664 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faad536-5111-420b-9308-20f7761c4d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:44.216596 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faad536-5111-420b-9308-20f7761c4d31 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:44.216877 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faad536-5111-420b-9308-20f7761c4d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:44.217153 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faad536-5111-420b-9308-20f7761c4d31 None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:44.218505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faad536-5111-420b-9308-20f7761c4d31 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3884c9c1c84b738e43a478898c36f8)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:44.220023 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faad536-5111-420b-9308-20f7761c4d31 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:44.221905 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 54/103] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:30:44 2022] GET /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:44.227744 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbdc1e-fed1-4760-9170-c2cf220d4a75 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:44.376653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954467f-7e7b-4b4b-973a-30a282bb2a9c None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:44.377176 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954467f-7e7b-4b4b-973a-30a282bb2a9c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:44.377176 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954467f-7e7b-4b4b-973a-30a282bb2a9c None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:44.378567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 55/104] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:30:44.382222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbdc1e-fed1-4760-9170-c2cf220d4a75 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:44.389873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade9106-1b1c-4192-b1b0-e449b5fb41eb None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:44.390162 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade9106-1b1c-4192-b1b0-e449b5fb41eb None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:44.390441 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade9106-1b1c-4192-b1b0-e449b5fb41eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:44.417786 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ece43-40dd-4055-9803-0cb08a389f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:44.419021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ece43-40dd-4055-9803-0cb08a389f9d None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:44.419524 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ece43-40dd-4055-9803-0cb08a389f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:44.420034 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ece43-40dd-4055-9803-0cb08a389f9d None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8/users/dffac131970f4d20b8b06d03ca4d1883/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:44.420727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-0ade9106-1b1c-4192-b1b0-e449b5fb41eb None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:44.422150 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0ade9106-1b1c-4192-b1b0-e449b5fb41eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:44.422719 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ece43-40dd-4055-9803-0cb08a389f9d None admin] RBAC: Authorizing `identity:create_grant(project_id=0c3884c9c1c84b738e43a478898c36f8, user_id=dffac131970f4d20b8b06d03ca4d1883, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:44.424437 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ece43-40dd-4055-9803-0cb08a389f9d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:44.509772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 56/105] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:30:44.511841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 50/106] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:30:44 2022] PUT /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8/users/dffac131970f4d20b8b06d03ca4d1883/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:30:44.513947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72407e41-73c6-4bd1-9a75-48f90049a808 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:44.514246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72407e41-73c6-4bd1-9a75-48f90049a808 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:44.515706 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72407e41-73c6-4bd1-9a75-48f90049a808 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:44.520584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 57/107] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:44 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:44.534042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feefc8-869c-4eeb-abea-80283625a886 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:44.534688 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feefc8-869c-4eeb-abea-80283625a886 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:44.535164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feefc8-869c-4eeb-abea-80283625a886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:44.543730 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72407e41-73c6-4bd1-9a75-48f90049a808 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:44.565221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a7feefc8-869c-4eeb-abea-80283625a886 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:44.566469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a7feefc8-869c-4eeb-abea-80283625a886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:44.652214 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72407e41-73c6-4bd1-9a75-48f90049a808 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:44.678304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 51/108] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:44.695141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a2e97-8713-4d35-85c0-c2bc2aeb54b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:44.696048 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a2e97-8713-4d35-85c0-c2bc2aeb54b5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:44.696333 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a2e97-8713-4d35-85c0-c2bc2aeb54b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:44.696658 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a2e97-8713-4d35-85c0-c2bc2aeb54b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:44.709244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a2e97-8713-4d35-85c0-c2bc2aeb54b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:44.718371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-bf8a2e97-8713-4d35-85c0-c2bc2aeb54b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:30:44.718371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:44.718371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:44.718371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:44.718371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:44.718371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:44.718371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:44.718371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:44.718371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:44.718371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:44.718371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:44.718371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:44.718371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:44.718371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:44.718371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:44.718371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:44.719239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:44.719239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:44.719239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:44.719239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:44.719239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:44.719239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:44.719239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:44.719239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:44.719239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:44.719239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:44.719239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:44.719239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:30:44.719239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:44.719239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:44.719239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:44.719239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:44.720053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:44.720053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:44.720053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:44.720053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:44.720053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:44.720053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:44.720053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:44.720053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:44.720053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:44.720053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:44.720053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:30:44.720053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:30:44.720644 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feefc8-869c-4eeb-abea-80283625a886 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:44.720715 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 58/109] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:30:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:30:44.726108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a2e97-8713-4d35-85c0-c2bc2aeb54b5 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:44.833147 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a2e97-8713-4d35-85c0-c2bc2aeb54b5 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:44.867004 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581f41d-a810-4532-ada5-a6ec56ebaac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:44.867677 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581f41d-a810-4532-ada5-a6ec56ebaac9 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:44.868050 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581f41d-a810-4532-ada5-a6ec56ebaac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:44.868611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581f41d-a810-4532-ada5-a6ec56ebaac9 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:44.869130 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581f41d-a810-4532-ada5-a6ec56ebaac9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:44.869442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581f41d-a810-4532-ada5-a6ec56ebaac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:44.870884 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581f41d-a810-4532-ada5-a6ec56ebaac9 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:44.879750 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 59/110] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:30:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:44.884460 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581f41d-a810-4532-ada5-a6ec56ebaac9 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:44.905045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feefc8-869c-4eeb-abea-80283625a886 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:44.969854 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b36052-c359-4425-b32b-34e958a63d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:44.970716 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b36052-c359-4425-b32b-34e958a63d1a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:44.971003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b36052-c359-4425-b32b-34e958a63d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:44.971327 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b36052-c359-4425-b32b-34e958a63d1a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:44.981623 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b36052-c359-4425-b32b-34e958a63d1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:45.006531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-36b36052-c359-4425-b32b-34e958a63d1a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:30:45.006531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:45.006531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:45.006531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:45.006531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:45.006531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:45.006531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:45.006531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:45.006531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:45.006531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:45.006531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:45.006531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:45.006531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:45.006531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:45.006531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:45.006531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:45.007420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:45.007420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:45.007420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:45.007420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:45.007420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:45.007420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:45.007420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:45.007420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:45.007420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:45.007420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:45.007420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:45.007420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:30:45.007420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:45.007420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:45.007420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:45.007420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:45.008270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:45.008270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:45.008270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:45.008270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:45.008270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:45.008270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:45.008270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:45.008270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:45.008270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:45.008270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:45.008270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:30:45.008270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:30:45.009381 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 52/111] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:30:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:30:45.013866 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b36052-c359-4425-b32b-34e958a63d1a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:45.092828 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581f41d-a810-4532-ada5-a6ec56ebaac9 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:45.162174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54437def-e021-4ba1-b027-f9a1b7b47c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:45.163111 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54437def-e021-4ba1-b027-f9a1b7b47c0a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:45.163443 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54437def-e021-4ba1-b027-f9a1b7b47c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:45.163739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54437def-e021-4ba1-b027-f9a1b7b47c0a None admin] PATH_INFO: `/v3/users/79cb9f096a814d81a7a9552741bc1a1f` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:45.165072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54437def-e021-4ba1-b027-f9a1b7b47c0a None admin] RBAC: Authorizing `identity:get_user(user_id=79cb9f096a814d81a7a9552741bc1a1f)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:45.167350 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54437def-e021-4ba1-b027-f9a1b7b47c0a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:45.171304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 60/112] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:44 2022] GET /identity/v3/users/79cb9f096a814d81a7a9552741bc1a1f => generated 247 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:45.173476 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95be1c3-725f-44b7-b1d1-0ce1873c78b7 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:45.173762 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95be1c3-725f-44b7-b1d1-0ce1873c78b7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:45.174037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95be1c3-725f-44b7-b1d1-0ce1873c78b7 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:45.175313 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 61/113] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:45.180091 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95be1c3-725f-44b7-b1d1-0ce1873c78b7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:45.185960 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b36052-c359-4425-b32b-34e958a63d1a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:45.238393 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f0278-b764-4269-bdda-b018e0e7e55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:45.239456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f0278-b764-4269-bdda-b018e0e7e55a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:45.239756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f0278-b764-4269-bdda-b018e0e7e55a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:45.240036 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f0278-b764-4269-bdda-b018e0e7e55a None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:45.241315 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f0278-b764-4269-bdda-b018e0e7e55a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:45.241629 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f0278-b764-4269-bdda-b018e0e7e55a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:45.243566 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f0278-b764-4269-bdda-b018e0e7e55a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:45.261581 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 53/114] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:30:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:45.262991 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26672acf-9840-458a-9d6a-629a885261ac None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:45.263280 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26672acf-9840-458a-9d6a-629a885261ac None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:45.263555 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26672acf-9840-458a-9d6a-629a885261ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:45.280550 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-26672acf-9840-458a-9d6a-629a885261ac None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:45.281724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-26672acf-9840-458a-9d6a-629a885261ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:45.318608 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95be1c3-725f-44b7-b1d1-0ce1873c78b7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:45.361500 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b718d5c-0f3f-458a-9a17-bcf43aac8f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:45.362799 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b718d5c-0f3f-458a-9a17-bcf43aac8f62 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:45.363290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b718d5c-0f3f-458a-9a17-bcf43aac8f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:45.363576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 54/115] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:45.363994 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b718d5c-0f3f-458a-9a17-bcf43aac8f62 None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:45.365055 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59114c14-4716-4836-bcc5-4adbdc2a1af0 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:45.365346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59114c14-4716-4836-bcc5-4adbdc2a1af0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:45.365622 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59114c14-4716-4836-bcc5-4adbdc2a1af0 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:45.366052 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b718d5c-0f3f-458a-9a17-bcf43aac8f62 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3884c9c1c84b738e43a478898c36f8)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:45.367262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 55/116] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:45.367984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b718d5c-0f3f-458a-9a17-bcf43aac8f62 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:45.368089 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59114c14-4716-4836-bcc5-4adbdc2a1af0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:45.370188 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 62/117] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:30:45 2022] GET /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:45.373292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8f3f6-b45a-42d1-96b6-573aa2e3e904 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:45.373827 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8f3f6-b45a-42d1-96b6-573aa2e3e904 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:45.374306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8f3f6-b45a-42d1-96b6-573aa2e3e904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:45.397109 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-deb8f3f6-b45a-42d1-96b6-573aa2e3e904 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:45.399852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-deb8f3f6-b45a-42d1-96b6-573aa2e3e904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:45.476827 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 63/118] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:45.477552 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8f3f6-b45a-42d1-96b6-573aa2e3e904 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:45.490525 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59114c14-4716-4836-bcc5-4adbdc2a1af0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:45.534611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765606f-4967-41df-a737-e9429a3433fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:45.536315 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765606f-4967-41df-a737-e9429a3433fa None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:45.536879 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765606f-4967-41df-a737-e9429a3433fa None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:45.537303 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765606f-4967-41df-a737-e9429a3433fa None admin] PATH_INFO: `/v3/users/dffac131970f4d20b8b06d03ca4d1883` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:45.539164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765606f-4967-41df-a737-e9429a3433fa None admin] RBAC: Authorizing `identity:get_user(user_id=dffac131970f4d20b8b06d03ca4d1883)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:45.541645 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765606f-4967-41df-a737-e9429a3433fa None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:45.544133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 56/119] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:45 2022] GET /identity/v3/users/dffac131970f4d20b8b06d03ca4d1883 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:45.545059 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765606f-4967-41df-a737-e9429a3433fa None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:45.590183 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8f3f6-b45a-42d1-96b6-573aa2e3e904 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:45.626674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e806e90-e0fb-4b94-9d1a-2594f4424478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:45.627775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e806e90-e0fb-4b94-9d1a-2594f4424478 None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:45.628186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e806e90-e0fb-4b94-9d1a-2594f4424478 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:45.628659 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e806e90-e0fb-4b94-9d1a-2594f4424478 None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8/users/79cb9f096a814d81a7a9552741bc1a1f/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:45.630972 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e806e90-e0fb-4b94-9d1a-2594f4424478 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c3884c9c1c84b738e43a478898c36f8, user_id=79cb9f096a814d81a7a9552741bc1a1f, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:45.632657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e806e90-e0fb-4b94-9d1a-2594f4424478 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:45.655151 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765606f-4967-41df-a737-e9429a3433fa None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:45.690657 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02ce1a-d67f-4695-95bc-a22addf0b6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:45.691461 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02ce1a-d67f-4695-95bc-a22addf0b6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:45.691772 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02ce1a-d67f-4695-95bc-a22addf0b6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:45.692048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02ce1a-d67f-4695-95bc-a22addf0b6e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:45.693279 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02ce1a-d67f-4695-95bc-a22addf0b6e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:45.694763 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02ce1a-d67f-4695-95bc-a22addf0b6e3 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:45.701421 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 57/120] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:30:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:45.701421 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02ce1a-d67f-4695-95bc-a22addf0b6e3 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:45.709620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 64/121] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:30:45 2022] PUT /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8/users/79cb9f096a814d81a7a9552741bc1a1f/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:30:45.714227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e806e90-e0fb-4b94-9d1a-2594f4424478 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:45.908652 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02ce1a-d67f-4695-95bc-a22addf0b6e3 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:45.921790 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e806e90-e0fb-4b94-9d1a-2594f4424478 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:45.945917 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a80ec2-7aeb-47f7-b7df-5e8bc584017e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:45.946724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a80ec2-7aeb-47f7-b7df-5e8bc584017e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:45.947012 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a80ec2-7aeb-47f7-b7df-5e8bc584017e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:45.947311 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a80ec2-7aeb-47f7-b7df-5e8bc584017e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:45.956035 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2316c23-4cc8-4e49-bbfb-0de724ef22e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:45.956909 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2316c23-4cc8-4e49-bbfb-0de724ef22e8 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:45.957196 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2316c23-4cc8-4e49-bbfb-0de724ef22e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:45.957477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2316c23-4cc8-4e49-bbfb-0de724ef22e8 None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:45.957940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a80ec2-7aeb-47f7-b7df-5e8bc584017e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:45.958833 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2316c23-4cc8-4e49-bbfb-0de724ef22e8 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3884c9c1c84b738e43a478898c36f8)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:45.960346 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2316c23-4cc8-4e49-bbfb-0de724ef22e8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:45.962083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 65/122] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:30:45 2022] GET /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:45.962832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2316c23-4cc8-4e49-bbfb-0de724ef22e8 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:45.969050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-a9a80ec2-7aeb-47f7-b7df-5e8bc584017e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 06:30:45.969050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:45.969050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:45.969050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:45.969050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:45.969050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:45.969050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:45.969050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:45.969050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:45.969050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:45.969050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:45.969050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:45.969050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:45.969050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:45.969050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:45.969050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:45.969954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:45.969954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:45.969954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:45.969954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:45.969954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:45.969954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:45.969954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:45.969954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:45.969954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:45.969954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:45.969954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:45.969954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:30:45.969954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:45.969954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:45.969954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:45.969954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:45.970724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:45.970724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:45.970724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:45.970724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:45.970724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:45.970724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:45.970724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:45.970724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:45.970724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:45.970724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:45.970724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 06:30:45.970724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:30:45.970724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 58/123] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:30:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:30:45.972091 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882db818-30f2-4236-9500-70c61e0d60b7 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:45.972091 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882db818-30f2-4236-9500-70c61e0d60b7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:45.972264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882db818-30f2-4236-9500-70c61e0d60b7 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:45.973638 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 59/124] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:45.974188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882db818-30f2-4236-9500-70c61e0d60b7 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:46.099098 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2316c23-4cc8-4e49-bbfb-0de724ef22e8 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:46.117021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882db818-30f2-4236-9500-70c61e0d60b7 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:46.133451 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9398ff-5413-474d-a214-4917cf4fcfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:46.134129 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9398ff-5413-474d-a214-4917cf4fcfb0 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:46.134421 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9398ff-5413-474d-a214-4917cf4fcfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:46.134703 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9398ff-5413-474d-a214-4917cf4fcfb0 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:46.135999 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9398ff-5413-474d-a214-4917cf4fcfb0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:46.138051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9398ff-5413-474d-a214-4917cf4fcfb0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:46.154870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae088fe-7fcc-4960-8552-9cd10a8b47ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:46.155985 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae088fe-7fcc-4960-8552-9cd10a8b47ef None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:46.156356 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae088fe-7fcc-4960-8552-9cd10a8b47ef None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:46.156701 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae088fe-7fcc-4960-8552-9cd10a8b47ef None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8/users/dffac131970f4d20b8b06d03ca4d1883/roles/cba01848eb624bfaaeeb1244e02e5bd7` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:46.159049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae088fe-7fcc-4960-8552-9cd10a8b47ef None admin] RBAC: Authorizing `identity:create_grant(project_id=0c3884c9c1c84b738e43a478898c36f8, user_id=dffac131970f4d20b8b06d03ca4d1883, role_id=cba01848eb624bfaaeeb1244e02e5bd7)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:46.160594 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae088fe-7fcc-4960-8552-9cd10a8b47ef None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:46.230056 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 66/125] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 12 06:30:45 2022] POST /identity/v3/projects => generated 302 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:30:46.231248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9398ff-5413-474d-a214-4917cf4fcfb0 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:46.261452 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 60/126] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:30:45 2022] PUT /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8/users/dffac131970f4d20b8b06d03ca4d1883/roles/cba01848eb624bfaaeeb1244e02e5bd7 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:30:46.263358 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107027a-4dda-45fd-bacd-9d45a92be567 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:46.263722 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107027a-4dda-45fd-bacd-9d45a92be567 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:46.263999 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107027a-4dda-45fd-bacd-9d45a92be567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:46.298400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e107027a-4dda-45fd-bacd-9d45a92be567 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:46.304531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e107027a-4dda-45fd-bacd-9d45a92be567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:46.440133 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9398ff-5413-474d-a214-4917cf4fcfb0 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:46.446345 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 61/127] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:46.485522 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107027a-4dda-45fd-bacd-9d45a92be567 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:46.508418 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafafe1-273b-4b99-b61c-ad71341699a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:46.509114 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafafe1-273b-4b99-b61c-ad71341699a9 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:46.509397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafafe1-273b-4b99-b61c-ad71341699a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:46.509673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafafe1-273b-4b99-b61c-ad71341699a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:46.510496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafafe1-273b-4b99-b61c-ad71341699a9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:46.510806 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafafe1-273b-4b99-b61c-ad71341699a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:46.512247 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafafe1-273b-4b99-b61c-ad71341699a9 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:46.533437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 67/128] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:30:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:46.539072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafafe1-273b-4b99-b61c-ad71341699a9 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:46.608862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107027a-4dda-45fd-bacd-9d45a92be567 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:46.653081 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58f8d3-9ba5-4607-a12a-1137dc6521f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:46.654128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58f8d3-9ba5-4607-a12a-1137dc6521f5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:46.654551 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58f8d3-9ba5-4607-a12a-1137dc6521f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:46.654964 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58f8d3-9ba5-4607-a12a-1137dc6521f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:46.674722 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58f8d3-9ba5-4607-a12a-1137dc6521f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:46.685251 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafafe1-273b-4b99-b61c-ad71341699a9 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:46.692992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-ae58f8d3-9ba5-4607-a12a-1137dc6521f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 06:30:46.692992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:46.692992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:46.692992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:46.692992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:46.692992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:46.692992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:46.692992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:46.692992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:46.692992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:46.692992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:46.692992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:46.692992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:46.692992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:46.692992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:46.692992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:46.694063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:46.694063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:46.694063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:46.694063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:46.694063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:46.694063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:46.694063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:46.694063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:46.694063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:46.694063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:46.694063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:46.694063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:30:46.694063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:46.694063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:46.694063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:46.694063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:46.695048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:46.695048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:46.695048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:46.695048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:46.695048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:46.695048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:46.695048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:46.695048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:46.695048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:46.695048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:46.695048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 06:30:46.695048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:30:46.697114 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 62/129] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:30:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:30:46.703991 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58f8d3-9ba5-4607-a12a-1137dc6521f5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:46.765030 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5adaa-a5f6-4f3c-89cf-9a44d52ec8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:46.766083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5adaa-a5f6-4f3c-89cf-9a44d52ec8fa None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:46.766460 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5adaa-a5f6-4f3c-89cf-9a44d52ec8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:46.766821 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5adaa-a5f6-4f3c-89cf-9a44d52ec8fa None admin] PATH_INFO: `/v3/users/cc08f20dbde145f9baaac7ac87ebdce4` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:46.796432 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5adaa-a5f6-4f3c-89cf-9a44d52ec8fa None admin] RBAC: Authorizing `identity:get_user(user_id=cc08f20dbde145f9baaac7ac87ebdce4)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:46.798047 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5adaa-a5f6-4f3c-89cf-9a44d52ec8fa None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:46.799900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 68/130] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:46 2022] GET /identity/v3/users/cc08f20dbde145f9baaac7ac87ebdce4 => generated 289 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:46.805140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5adaa-a5f6-4f3c-89cf-9a44d52ec8fa None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:46.821034 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58f8d3-9ba5-4607-a12a-1137dc6521f5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:46.855362 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf74754-4039-43c9-9b53-940b3c649dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:46.856440 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf74754-4039-43c9-9b53-940b3c649dde None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:46.856971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf74754-4039-43c9-9b53-940b3c649dde None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:46.857440 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf74754-4039-43c9-9b53-940b3c649dde None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:46.858677 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf74754-4039-43c9-9b53-940b3c649dde None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:46.859178 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf74754-4039-43c9-9b53-940b3c649dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:46.861135 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf74754-4039-43c9-9b53-940b3c649dde None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:46.871076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 63/131] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:30:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:46.876679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf74754-4039-43c9-9b53-940b3c649dde None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:46.931071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5adaa-a5f6-4f3c-89cf-9a44d52ec8fa None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:46.973916 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51481428-a7cb-41b5-b499-5eeb0aa911e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:46.974628 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51481428-a7cb-41b5-b499-5eeb0aa911e1 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:46.974987 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51481428-a7cb-41b5-b499-5eeb0aa911e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:46.975358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51481428-a7cb-41b5-b499-5eeb0aa911e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:46.983967 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf74754-4039-43c9-9b53-940b3c649dde None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:47.018613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f72c51-2898-4655-8ba2-0a3a7cf05758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:47.019534 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f72c51-2898-4655-8ba2-0a3a7cf05758 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:47.019868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f72c51-2898-4655-8ba2-0a3a7cf05758 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:47.020147 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f72c51-2898-4655-8ba2-0a3a7cf05758 None admin] PATH_INFO: `/v3/users/dffac131970f4d20b8b06d03ca4d1883` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:47.021365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f72c51-2898-4655-8ba2-0a3a7cf05758 None admin] RBAC: Authorizing `identity:get_user(user_id=dffac131970f4d20b8b06d03ca4d1883)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:47.022876 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f72c51-2898-4655-8ba2-0a3a7cf05758 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:47.024650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 64/132] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:46 2022] GET /identity/v3/users/dffac131970f4d20b8b06d03ca4d1883 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:47.030235 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f72c51-2898-4655-8ba2-0a3a7cf05758 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:47.084510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51481428-a7cb-41b5-b499-5eeb0aa911e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:47.086006 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51481428-a7cb-41b5-b499-5eeb0aa911e1 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:47.134204 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f72c51-2898-4655-8ba2-0a3a7cf05758 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:47.169081 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d3e5d-59fa-4158-9ca5-25b1286f8784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:47.169977 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d3e5d-59fa-4158-9ca5-25b1286f8784 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:47.170261 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d3e5d-59fa-4158-9ca5-25b1286f8784 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:47.170537 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d3e5d-59fa-4158-9ca5-25b1286f8784 None admin] PATH_INFO: `/v3/projects/cfb01cb3dcdd456f8fa0525c42c829bb` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:47.171789 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d3e5d-59fa-4158-9ca5-25b1286f8784 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb01cb3dcdd456f8fa0525c42c829bb)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:47.173253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d3e5d-59fa-4158-9ca5-25b1286f8784 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:47.174973 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 65/133] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:30:47 2022] GET /identity/v3/projects/cfb01cb3dcdd456f8fa0525c42c829bb => generated 312 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:30:47.180563 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d3e5d-59fa-4158-9ca5-25b1286f8784 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:47.191376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 69/134] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:30:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 06:30:47.197086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51481428-a7cb-41b5-b499-5eeb0aa911e1 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:47.309782 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d3e5d-59fa-4158-9ca5-25b1286f8784 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:47.330659 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51481428-a7cb-41b5-b499-5eeb0aa911e1 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:47.374553 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e5e8a-0c40-4764-ad78-9570d805c0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:47.376152 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e5e8a-0c40-4764-ad78-9570d805c0d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:47.377153 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e5e8a-0c40-4764-ad78-9570d805c0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:47.377984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf8ebf-659a-4e13-afe9-636d43871eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:47.379061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf8ebf-659a-4e13-afe9-636d43871eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:47.379560 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf8ebf-659a-4e13-afe9-636d43871eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:47.380055 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e5e8a-0c40-4764-ad78-9570d805c0d4 None admin] PATH_INFO: `/v3/projects/cfb01cb3dcdd456f8fa0525c42c829bb/users/dffac131970f4d20b8b06d03ca4d1883/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:47.380618 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf8ebf-659a-4e13-afe9-636d43871eb7 None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:47.383272 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf8ebf-659a-4e13-afe9-636d43871eb7 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3884c9c1c84b738e43a478898c36f8)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:47.384958 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf8ebf-659a-4e13-afe9-636d43871eb7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:47.385937 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e5e8a-0c40-4764-ad78-9570d805c0d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfb01cb3dcdd456f8fa0525c42c829bb, user_id=dffac131970f4d20b8b06d03ca4d1883, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:47.387583 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e5e8a-0c40-4764-ad78-9570d805c0d4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:47.389562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 70/135] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:30:47 2022] GET /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:30:47.395489 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf8ebf-659a-4e13-afe9-636d43871eb7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:47.451565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 66/136] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:30:47 2022] PUT /identity/v3/projects/cfb01cb3dcdd456f8fa0525c42c829bb/users/dffac131970f4d20b8b06d03ca4d1883/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:30:47.453313 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673879b1-3830-4c33-9003-59009b613631 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:47.453812 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673879b1-3830-4c33-9003-59009b613631 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:47.454327 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673879b1-3830-4c33-9003-59009b613631 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:47.456009 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 67/137] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:47.462428 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fd0fa-13c6-4110-b1d3-7f26232b620b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:47.463033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fd0fa-13c6-4110-b1d3-7f26232b620b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:47.464062 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fd0fa-13c6-4110-b1d3-7f26232b620b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:47.495613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f55fd0fa-13c6-4110-b1d3-7f26232b620b None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:47.497917 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f55fd0fa-13c6-4110-b1d3-7f26232b620b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:47.592711 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf8ebf-659a-4e13-afe9-636d43871eb7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:47.630732 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 68/138] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:30:47.657125 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b435cea-f61a-484a-b59c-acf561aa3100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:47.657810 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b435cea-f61a-484a-b59c-acf561aa3100 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:47.658094 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b435cea-f61a-484a-b59c-acf561aa3100 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:47.658369 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b435cea-f61a-484a-b59c-acf561aa3100 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:47.659289 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b435cea-f61a-484a-b59c-acf561aa3100 None admin] RBAC: Adding query filter params (role.id=6499c37d9f3048e1b9966d520667bd09, scope.project.id=0c3884c9c1c84b738e43a478898c36f8, user.id=cc08f20dbde145f9baaac7ac87ebdce4) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:47.659602 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b435cea-f61a-484a-b59c-acf561aa3100 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:47.661065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b435cea-f61a-484a-b59c-acf561aa3100 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:47.670092 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 71/139] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:30:47 2022] GET /identity/v3/role_assignments?user.id=cc08f20dbde145f9baaac7ac87ebdce4&scope.project.id=0c3884c9c1c84b738e43a478898c36f8&role.id=6499c37d9f3048e1b9966d520667bd09 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:30:47.682168 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fd0fa-13c6-4110-b1d3-7f26232b620b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:47.805434 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fd0fa-13c6-4110-b1d3-7f26232b620b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:47.841597 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98826295-0ad9-4736-b605-29caf2d037e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:47.842397 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98826295-0ad9-4736-b605-29caf2d037e8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:47.842679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98826295-0ad9-4736-b605-29caf2d037e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:47.843005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98826295-0ad9-4736-b605-29caf2d037e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:47.854407 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98826295-0ad9-4736-b605-29caf2d037e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:47.862406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-98826295-0ad9-4736-b605-29caf2d037e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 06:30:47.862406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:47.862406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:47.862406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:47.862406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:47.862406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:47.862406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:47.862406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:47.862406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:47.862406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:47.862406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:47.862406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:47.862406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:47.862406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:47.862406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:47.862406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:47.863306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:47.863306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:47.863306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:47.863306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:47.863306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:47.863306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:47.863306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:47.863306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:47.863306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:47.863306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:47.863306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:47.863306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:30:47.863306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:47.863306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:47.863306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:47.863306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:47.864137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:47.864137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:47.864137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:47.864137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:47.864137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:47.864137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:47.864137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:47.864137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:47.864137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:47.864137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:47.864137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 06:30:47.864137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:30:47.864137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 69/140] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:30:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:30:47.869592 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b435cea-f61a-484a-b59c-acf561aa3100 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:47.979440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b435cea-f61a-484a-b59c-acf561aa3100 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:48.021847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71adfc5-a0da-41d7-aa2b-2c12f1b72831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:48.022528 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71adfc5-a0da-41d7-aa2b-2c12f1b72831 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:48.022810 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71adfc5-a0da-41d7-aa2b-2c12f1b72831 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:48.023084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71adfc5-a0da-41d7-aa2b-2c12f1b72831 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:48.023930 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71adfc5-a0da-41d7-aa2b-2c12f1b72831 None admin] RBAC: Adding query filter params (name=member) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:48.024244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71adfc5-a0da-41d7-aa2b-2c12f1b72831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:48.026188 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71adfc5-a0da-41d7-aa2b-2c12f1b72831 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:48.039407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 72/141] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:30:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:48.045299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98826295-0ad9-4736-b605-29caf2d037e8 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:48.158253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98826295-0ad9-4736-b605-29caf2d037e8 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:48.192213 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189810b-c379-486e-a641-9c62b815fda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:48.193088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189810b-c379-486e-a641-9c62b815fda9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:48.193369 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189810b-c379-486e-a641-9c62b815fda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:48.193639 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189810b-c379-486e-a641-9c62b815fda9 None admin] PATH_INFO: `/v3/users/dffac131970f4d20b8b06d03ca4d1883` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:48.194847 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189810b-c379-486e-a641-9c62b815fda9 None admin] RBAC: Authorizing `identity:get_user(user_id=dffac131970f4d20b8b06d03ca4d1883)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:48.196419 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189810b-c379-486e-a641-9c62b815fda9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:48.198268 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 70/142] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:48 2022] GET /identity/v3/users/dffac131970f4d20b8b06d03ca4d1883 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:48.203626 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71adfc5-a0da-41d7-aa2b-2c12f1b72831 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:48.337057 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71adfc5-a0da-41d7-aa2b-2c12f1b72831 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:48.377431 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dad81a-4bab-488c-81e6-08057fa092a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:48.378113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dad81a-4bab-488c-81e6-08057fa092a7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:48.378407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dad81a-4bab-488c-81e6-08057fa092a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:48.378691 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dad81a-4bab-488c-81e6-08057fa092a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:48.457202 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dad81a-4bab-488c-81e6-08057fa092a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:48.459078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dad81a-4bab-488c-81e6-08057fa092a7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:48.562295 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 73/143] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:30:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:30:48.567795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189810b-c379-486e-a641-9c62b815fda9 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:48.711348 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189810b-c379-486e-a641-9c62b815fda9 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:48.751574 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b00c1-b726-43fa-bc6b-17a561122c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:48.752472 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b00c1-b726-43fa-bc6b-17a561122c5f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:48.752759 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b00c1-b726-43fa-bc6b-17a561122c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:48.753040 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b00c1-b726-43fa-bc6b-17a561122c5f None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:48.760492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b00c1-b726-43fa-bc6b-17a561122c5f None admin] RBAC: Authorizing `identity:get_project(project_id=0c3884c9c1c84b738e43a478898c36f8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:48.761972 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b00c1-b726-43fa-bc6b-17a561122c5f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:48.763864 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 71/144] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:30:48 2022] GET /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:48.769870 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dad81a-4bab-488c-81e6-08057fa092a7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:48.841179 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87480afc-cb23-4b8f-b8a4-4ea72a1b1e62 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:48.841500 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87480afc-cb23-4b8f-b8a4-4ea72a1b1e62 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:48.841698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87480afc-cb23-4b8f-b8a4-4ea72a1b1e62 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:48.843114 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 72/145] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:48.857007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8febef-d00b-4a12-a253-cc5d764bc329 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:48.857303 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8febef-d00b-4a12-a253-cc5d764bc329 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:48.857584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8febef-d00b-4a12-a253-cc5d764bc329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:48.896664 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8b8febef-d00b-4a12-a253-cc5d764bc329 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:48.897875 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8b8febef-d00b-4a12-a253-cc5d764bc329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:48.942313 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dad81a-4bab-488c-81e6-08057fa092a7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:49.012809 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c006d-667b-4023-bdb1-5f994ebf6507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:49.013485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c006d-667b-4023-bdb1-5f994ebf6507 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:49.013768 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c006d-667b-4023-bdb1-5f994ebf6507 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:49.014041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c006d-667b-4023-bdb1-5f994ebf6507 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:49.014889 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c006d-667b-4023-bdb1-5f994ebf6507 None admin] RBAC: Adding query filter params (role.id=2162d563a5344c26821a7961cb75468b, scope.project.id=0c3884c9c1c84b738e43a478898c36f8, user.id=dffac131970f4d20b8b06d03ca4d1883) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:49.015198 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c006d-667b-4023-bdb1-5f994ebf6507 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:49.017050 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c006d-667b-4023-bdb1-5f994ebf6507 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:49.027511 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 74/146] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:30:48 2022] GET /identity/v3/role_assignments?user.id=dffac131970f4d20b8b06d03ca4d1883&scope.project.id=0c3884c9c1c84b738e43a478898c36f8&role.id=2162d563a5344c26821a7961cb75468b => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:49.054191 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 73/147] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:30:49.086924 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c006d-667b-4023-bdb1-5f994ebf6507 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:49.220307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c006d-667b-4023-bdb1-5f994ebf6507 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:49.267724 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f3d8e-b37c-4612-b5b4-cd80e74e84f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:49.268571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f3d8e-b37c-4612-b5b4-cd80e74e84f1 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:49.268865 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f3d8e-b37c-4612-b5b4-cd80e74e84f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:49.269144 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f3d8e-b37c-4612-b5b4-cd80e74e84f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:49.286193 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f3d8e-b37c-4612-b5b4-cd80e74e84f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:49.294961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-520f3d8e-b37c-4612-b5b4-cd80e74e84f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:30:49.294961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:49.294961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:49.294961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:49.294961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:49.294961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:49.294961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:49.294961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:49.294961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:49.294961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:49.294961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:49.294961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:49.294961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:49.294961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:49.294961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:49.294961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:49.295845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:49.295845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:49.295845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:49.295845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:49.295845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:49.295845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:49.295845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:49.295845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:49.295845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:49.295845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:49.295845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:49.295845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:30:49.295845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:49.295845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:49.295845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:49.295845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:49.296624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:49.296624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:49.296624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:49.296624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:49.296624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:49.296624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:49.296624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:49.296624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:49.296624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:49.296624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:49.296624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:30:49.296624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:30:49.296624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 75/148] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:30:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:30:49.302022 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8febef-d00b-4a12-a253-cc5d764bc329 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:49.421083 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8febef-d00b-4a12-a253-cc5d764bc329 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:49.464362 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657c399-768e-43f2-bff2-e1b39c37b1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:49.465039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657c399-768e-43f2-bff2-e1b39c37b1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:49.465328 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657c399-768e-43f2-bff2-e1b39c37b1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:49.465611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657c399-768e-43f2-bff2-e1b39c37b1f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:49.466379 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657c399-768e-43f2-bff2-e1b39c37b1f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:49.466694 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657c399-768e-43f2-bff2-e1b39c37b1f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:49.468106 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657c399-768e-43f2-bff2-e1b39c37b1f0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:49.477677 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 74/149] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:30:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:49.483021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f3d8e-b37c-4612-b5b4-cd80e74e84f1 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:49.597710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f3d8e-b37c-4612-b5b4-cd80e74e84f1 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:49.641477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3caca5-7d39-40f9-94ff-a64ce968567b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:49.642378 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3caca5-7d39-40f9-94ff-a64ce968567b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:49.642667 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3caca5-7d39-40f9-94ff-a64ce968567b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:49.642947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3caca5-7d39-40f9-94ff-a64ce968567b None admin] PATH_INFO: `/v3/users/79cb9f096a814d81a7a9552741bc1a1f` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:49.648498 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3caca5-7d39-40f9-94ff-a64ce968567b None admin] RBAC: Authorizing `identity:get_user(user_id=79cb9f096a814d81a7a9552741bc1a1f)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:49.650065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3caca5-7d39-40f9-94ff-a64ce968567b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:49.652421 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 76/150] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:49 2022] GET /identity/v3/users/79cb9f096a814d81a7a9552741bc1a1f => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:49.657894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657c399-768e-43f2-bff2-e1b39c37b1f0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:49.782244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657c399-768e-43f2-bff2-e1b39c37b1f0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:49.816610 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0febca-5230-49e3-a6a5-fe6ac9de36f4 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:49.817136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0febca-5230-49e3-a6a5-fe6ac9de36f4 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:49.817212 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0febca-5230-49e3-a6a5-fe6ac9de36f4 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:49.818606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 77/151] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:30:49.824776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6d488-422c-43d6-a4b9-2f743bcd8cdb None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:49.825066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6d488-422c-43d6-a4b9-2f743bcd8cdb None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:49.825349 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6d488-422c-43d6-a4b9-2f743bcd8cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:49.845282 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3bf6d488-422c-43d6-a4b9-2f743bcd8cdb None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:49.848614 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3bf6d488-422c-43d6-a4b9-2f743bcd8cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:49.848744 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcbf88-4192-445a-bee0-e20710d3db47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:49.848744 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcbf88-4192-445a-bee0-e20710d3db47 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:49.848744 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcbf88-4192-445a-bee0-e20710d3db47 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:49.848744 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcbf88-4192-445a-bee0-e20710d3db47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:49.963303 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcbf88-4192-445a-bee0-e20710d3db47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:49.965316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcbf88-4192-445a-bee0-e20710d3db47 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:49.978190 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 78/152] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:30:50.000117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6d488-422c-43d6-a4b9-2f743bcd8cdb None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:50.114837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 75/153] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:30:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:30:50.115630 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6d488-422c-43d6-a4b9-2f743bcd8cdb None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:50.116174 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9de1e-f078-4f10-84bc-f5a836c0a947 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:50.116464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9de1e-f078-4f10-84bc-f5a836c0a947 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:50.116740 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9de1e-f078-4f10-84bc-f5a836c0a947 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:50.118178 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 76/154] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:50.124427 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9de1e-f078-4f10-84bc-f5a836c0a947 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:50.161017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64efde4-5021-4ae5-a465-8ef6eb0a4718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:50.162300 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64efde4-5021-4ae5-a465-8ef6eb0a4718 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:50.162715 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64efde4-5021-4ae5-a465-8ef6eb0a4718 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:50.163124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64efde4-5021-4ae5-a465-8ef6eb0a4718 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:50.176153 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64efde4-5021-4ae5-a465-8ef6eb0a4718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:50.186939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-e64efde4-5021-4ae5-a465-8ef6eb0a4718 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:30:50.186939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:50.186939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:50.186939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:50.186939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:50.186939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:50.186939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:50.186939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:50.186939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:50.186939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:50.186939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:50.186939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:50.186939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:50.186939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:50.186939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:50.186939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:50.187941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:50.187941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:50.187941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:50.187941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:50.187941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:50.187941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:50.187941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:50.187941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:50.187941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:50.187941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:50.187941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:50.187941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:30:50.187941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:50.187941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:50.187941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:50.187941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:50.188732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:50.188732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:50.188732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:50.188732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:50.188732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:50.188732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:50.188732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:50.188732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:50.188732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:50.188732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:50.188732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:30:50.188732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:30:50.191770 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 79/155] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:30:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:30:50.193060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8ee27-674c-455b-8a3c-bbe0aa967be6 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:50.193507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8ee27-674c-455b-8a3c-bbe0aa967be6 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:50.193725 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8ee27-674c-455b-8a3c-bbe0aa967be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:50.216794 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-41b8ee27-674c-455b-8a3c-bbe0aa967be6 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:50.218702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-41b8ee27-674c-455b-8a3c-bbe0aa967be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:50.243917 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9de1e-f078-4f10-84bc-f5a836c0a947 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:50.279780 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710b2f8-9eac-4675-98f7-4c02fb747940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:50.280762 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710b2f8-9eac-4675-98f7-4c02fb747940 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:50.281114 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710b2f8-9eac-4675-98f7-4c02fb747940 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:50.281689 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710b2f8-9eac-4675-98f7-4c02fb747940 None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:50.282706 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710b2f8-9eac-4675-98f7-4c02fb747940 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3884c9c1c84b738e43a478898c36f8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:50.284402 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710b2f8-9eac-4675-98f7-4c02fb747940 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:50.286191 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 77/156] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:30:50 2022] GET /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:50.287122 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710b2f8-9eac-4675-98f7-4c02fb747940 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:50.311512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 80/157] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:50.313249 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8ee27-674c-455b-8a3c-bbe0aa967be6 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:50.388734 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710b2f8-9eac-4675-98f7-4c02fb747940 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:50.423773 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49bd1e-ac5f-4650-85fd-47083090cf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:50.424643 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49bd1e-ac5f-4650-85fd-47083090cf4d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:50.425070 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49bd1e-ac5f-4650-85fd-47083090cf4d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:50.425438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49bd1e-ac5f-4650-85fd-47083090cf4d None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:50.426300 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49bd1e-ac5f-4650-85fd-47083090cf4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:50.426826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49bd1e-ac5f-4650-85fd-47083090cf4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:50.428233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49bd1e-ac5f-4650-85fd-47083090cf4d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:50.437640 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 78/158] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:30:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:50.442085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49bd1e-ac5f-4650-85fd-47083090cf4d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:50.445823 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8ee27-674c-455b-8a3c-bbe0aa967be6 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:50.479575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be46ccc-2587-4169-bfc3-2af6449a1748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:50.480452 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be46ccc-2587-4169-bfc3-2af6449a1748 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:50.480828 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be46ccc-2587-4169-bfc3-2af6449a1748 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:50.481244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be46ccc-2587-4169-bfc3-2af6449a1748 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:50.482740 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be46ccc-2587-4169-bfc3-2af6449a1748 None admin] RBAC: Adding query filter params (role.id=5e6a73052f3b4ee7829ecb858925e5ca, scope.project.id=0c3884c9c1c84b738e43a478898c36f8, user.id=79cb9f096a814d81a7a9552741bc1a1f) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:50.482740 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be46ccc-2587-4169-bfc3-2af6449a1748 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:50.484143 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be46ccc-2587-4169-bfc3-2af6449a1748 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:50.490425 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 81/159] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:30:50 2022] GET /identity/v3/role_assignments?user.id=79cb9f096a814d81a7a9552741bc1a1f&scope.project.id=0c3884c9c1c84b738e43a478898c36f8&role.id=5e6a73052f3b4ee7829ecb858925e5ca => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:50.491296 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be46ccc-2587-4169-bfc3-2af6449a1748 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:50.597311 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49bd1e-ac5f-4650-85fd-47083090cf4d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:50.666690 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be46ccc-2587-4169-bfc3-2af6449a1748 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:50.682215 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e960656-4b9a-46b1-b894-02c48cc1f862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:50.683073 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e960656-4b9a-46b1-b894-02c48cc1f862 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:50.683449 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e960656-4b9a-46b1-b894-02c48cc1f862 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:50.683618 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e960656-4b9a-46b1-b894-02c48cc1f862 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:50.688694 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e960656-4b9a-46b1-b894-02c48cc1f862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:50.690232 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e960656-4b9a-46b1-b894-02c48cc1f862 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:50.692102 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 79/160] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:30:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:50.698567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e960656-4b9a-46b1-b894-02c48cc1f862 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:50.710110 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1254c-178c-4a46-85d9-81443f4b2612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:50.711281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1254c-178c-4a46-85d9-81443f4b2612 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:50.711769 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1254c-178c-4a46-85d9-81443f4b2612 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:50.712204 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1254c-178c-4a46-85d9-81443f4b2612 None admin] PATH_INFO: `/v3/users/dffac131970f4d20b8b06d03ca4d1883` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:50.713749 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1254c-178c-4a46-85d9-81443f4b2612 None admin] RBAC: Authorizing `identity:get_user(user_id=dffac131970f4d20b8b06d03ca4d1883)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:50.715360 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1254c-178c-4a46-85d9-81443f4b2612 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:50.717247 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 82/161] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:50 2022] GET /identity/v3/users/dffac131970f4d20b8b06d03ca4d1883 => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:50.723492 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1254c-178c-4a46-85d9-81443f4b2612 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:50.831506 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e960656-4b9a-46b1-b894-02c48cc1f862 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:50.834213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1254c-178c-4a46-85d9-81443f4b2612 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:50.864265 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b75111-b1b4-48dd-ae48-33be38b1a533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:50.864932 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b75111-b1b4-48dd-ae48-33be38b1a533 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:50.865212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b75111-b1b4-48dd-ae48-33be38b1a533 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:50.865480 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b75111-b1b4-48dd-ae48-33be38b1a533 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:50.866185 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b75111-b1b4-48dd-ae48-33be38b1a533 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:50.867091 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a4e6a-be64-4347-89f9-86c7500cd6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:50.867627 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b75111-b1b4-48dd-ae48-33be38b1a533 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:50.867828 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a4e6a-be64-4347-89f9-86c7500cd6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:50.868028 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a4e6a-be64-4347-89f9-86c7500cd6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:50.868295 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a4e6a-be64-4347-89f9-86c7500cd6e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:50.933650 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a4e6a-be64-4347-89f9-86c7500cd6e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:50.935032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a4e6a-be64-4347-89f9-86c7500cd6e2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:50.966237 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 80/162] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 12 06:30:50 2022] POST /identity/v3/users => generated 283 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:30:50.979728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07af84-713c-473a-a346-c0150f44570a None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:50.979728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07af84-713c-473a-a346-c0150f44570a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:50.979728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07af84-713c-473a-a346-c0150f44570a None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:50.979728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 81/163] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:50.979728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb8d55-6e3d-4fe5-b64f-c29e148d6866 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:50.979728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb8d55-6e3d-4fe5-b64f-c29e148d6866 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:50.980288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb8d55-6e3d-4fe5-b64f-c29e148d6866 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:50.980288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 82/164] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:50.980288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e0c0d-1fa7-4605-bbe7-f6e6475f78aa None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:50.980288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e0c0d-1fa7-4605-bbe7-f6e6475f78aa None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:50.980288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e0c0d-1fa7-4605-bbe7-f6e6475f78aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:50.996999 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ad8e0c0d-1fa7-4605-bbe7-f6e6475f78aa None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:50.998381 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ad8e0c0d-1fa7-4605-bbe7-f6e6475f78aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:51.048084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 83/165] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:30:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 06:30:51.048084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a2a29-2cc9-472f-b7a9-5009febeada7 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:51.048084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a2a29-2cc9-472f-b7a9-5009febeada7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:51.048084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a2a29-2cc9-472f-b7a9-5009febeada7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:51.068465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-102a2a29-2cc9-472f-b7a9-5009febeada7 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:51.069699 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-102a2a29-2cc9-472f-b7a9-5009febeada7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:51.072359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 83/166] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:51.073732 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e0c0d-1fa7-4605-bbe7-f6e6475f78aa None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:51.152082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 84/167] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:51.152830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a2a29-2cc9-472f-b7a9-5009febeada7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:51.186637 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e0c0d-1fa7-4605-bbe7-f6e6475f78aa None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:51.224361 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819a475-e783-45af-a1ff-ea08064b2020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:51.225217 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819a475-e783-45af-a1ff-ea08064b2020 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:51.225497 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819a475-e783-45af-a1ff-ea08064b2020 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:51.225763 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819a475-e783-45af-a1ff-ea08064b2020 None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:51.226942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819a475-e783-45af-a1ff-ea08064b2020 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3884c9c1c84b738e43a478898c36f8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:51.228473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819a475-e783-45af-a1ff-ea08064b2020 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:51.230337 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 84/168] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:30:51 2022] GET /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:51.231105 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819a475-e783-45af-a1ff-ea08064b2020 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:51.264986 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a2a29-2cc9-472f-b7a9-5009febeada7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:51.309305 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef780c6c-c016-4070-921f-ec5027cdbc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:51.310118 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef780c6c-c016-4070-921f-ec5027cdbc98 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:51.310398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef780c6c-c016-4070-921f-ec5027cdbc98 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:51.310670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef780c6c-c016-4070-921f-ec5027cdbc98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:51.323932 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef780c6c-c016-4070-921f-ec5027cdbc98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:51.333841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-ef780c6c-c016-4070-921f-ec5027cdbc98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 06:30:51.333841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:51.333841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:51.333841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:51.333841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:51.333841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:51.333841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:51.333841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:51.333841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:51.333841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:51.333841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:51.333841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:51.333841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:51.333841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:51.333841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:51.333841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:51.334727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:51.334727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:51.334727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:51.334727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:51.334727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:51.334727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:51.334727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:51.334727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:51.334727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:51.334727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:51.334727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:51.334727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:30:51.334727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:51.334727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:51.334727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:51.334727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:51.335496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:51.335496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:51.335496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:51.335496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:51.335496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:51.335496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:51.335496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:51.335496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:51.335496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:51.335496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:51.335496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 06:30:51.335496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:30:51.336174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 85/169] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:30:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:30:51.337773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef780c6c-c016-4070-921f-ec5027cdbc98 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:51.351841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819a475-e783-45af-a1ff-ea08064b2020 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:51.395126 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d893e77-1763-404f-abc0-d282d6cb2a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:51.396311 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d893e77-1763-404f-abc0-d282d6cb2a3c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:51.396822 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d893e77-1763-404f-abc0-d282d6cb2a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:51.397283 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d893e77-1763-404f-abc0-d282d6cb2a3c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:51.410716 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d893e77-1763-404f-abc0-d282d6cb2a3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:51.419254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-9d893e77-1763-404f-abc0-d282d6cb2a3c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 06:30:51.419254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:51.419254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:51.419254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:51.419254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:51.419254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:51.419254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:51.419254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:51.419254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:51.419254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:51.419254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:51.419254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:51.419254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:51.419254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:51.419254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:51.419254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:51.420214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:51.420214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:51.420214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:51.420214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:51.420214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:51.420214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:51.420214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:51.420214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:51.420214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:51.420214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:51.420214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:51.420214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:30:51.420214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:51.420214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:51.420214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:51.420214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:51.420986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:51.420986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:51.420986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:51.420986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:51.420986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:51.420986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:51.420986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:51.420986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:51.420986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:51.420986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:51.420986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 06:30:51.420986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:30:51.420986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 85/170] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:30:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:30:51.421822 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d893e77-1763-404f-abc0-d282d6cb2a3c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:51.474528 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef780c6c-c016-4070-921f-ec5027cdbc98 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:51.515258 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735e2df-a642-4dc6-a82a-2decb7fac66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:51.516084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735e2df-a642-4dc6-a82a-2decb7fac66f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:51.516590 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735e2df-a642-4dc6-a82a-2decb7fac66f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:51.516996 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735e2df-a642-4dc6-a82a-2decb7fac66f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:51.518223 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735e2df-a642-4dc6-a82a-2decb7fac66f None admin] RBAC: Adding query filter params (role.id=cba01848eb624bfaaeeb1244e02e5bd7, scope.project.id=0c3884c9c1c84b738e43a478898c36f8, user.id=dffac131970f4d20b8b06d03ca4d1883) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:51.518614 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735e2df-a642-4dc6-a82a-2decb7fac66f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:51.520185 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735e2df-a642-4dc6-a82a-2decb7fac66f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:51.529881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 86/171] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:30:51 2022] GET /identity/v3/role_assignments?user.id=dffac131970f4d20b8b06d03ca4d1883&scope.project.id=0c3884c9c1c84b738e43a478898c36f8&role.id=cba01848eb624bfaaeeb1244e02e5bd7 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:51.529881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735e2df-a642-4dc6-a82a-2decb7fac66f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:51.535129 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d893e77-1763-404f-abc0-d282d6cb2a3c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:51.585458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8619e4-06f2-4b75-a800-a135726e4ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:51.586156 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8619e4-06f2-4b75-a800-a135726e4ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:51.586438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8619e4-06f2-4b75-a800-a135726e4ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:51.586710 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8619e4-06f2-4b75-a800-a135726e4ea8 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:51.587499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8619e4-06f2-4b75-a800-a135726e4ea8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:51.587841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8619e4-06f2-4b75-a800-a135726e4ea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:51.589515 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8619e4-06f2-4b75-a800-a135726e4ea8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:51.599376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 86/172] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:30:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:51.608805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8619e4-06f2-4b75-a800-a135726e4ea8 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:51.653543 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735e2df-a642-4dc6-a82a-2decb7fac66f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:51.691067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3cf7c-dd0f-4767-9d2c-a92837ee7401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:51.692030 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3cf7c-dd0f-4767-9d2c-a92837ee7401 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:51.692451 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3cf7c-dd0f-4767-9d2c-a92837ee7401 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:51.692928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3cf7c-dd0f-4767-9d2c-a92837ee7401 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:51.693867 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3cf7c-dd0f-4767-9d2c-a92837ee7401 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:51.694324 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3cf7c-dd0f-4767-9d2c-a92837ee7401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:51.695943 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3cf7c-dd0f-4767-9d2c-a92837ee7401 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:51.706074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 87/173] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:30:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:51.716110 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3cf7c-dd0f-4767-9d2c-a92837ee7401 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:51.776871 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8619e4-06f2-4b75-a800-a135726e4ea8 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:51.812126 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e05b32-08de-436d-9718-00ddc7080bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:51.813111 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e05b32-08de-436d-9718-00ddc7080bcb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:51.813458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e05b32-08de-436d-9718-00ddc7080bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:51.813802 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e05b32-08de-436d-9718-00ddc7080bcb None admin] PATH_INFO: `/v3/users/dffac131970f4d20b8b06d03ca4d1883` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:51.815104 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e05b32-08de-436d-9718-00ddc7080bcb None admin] RBAC: Authorizing `identity:get_user(user_id=dffac131970f4d20b8b06d03ca4d1883)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:51.816739 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e05b32-08de-436d-9718-00ddc7080bcb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:51.819040 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 87/174] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:51 2022] GET /identity/v3/users/dffac131970f4d20b8b06d03ca4d1883 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:51.824579 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e05b32-08de-436d-9718-00ddc7080bcb None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:51.829083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3cf7c-dd0f-4767-9d2c-a92837ee7401 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:51.865040 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b7b6b-34f8-4af4-a281-11cade22cca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:51.866660 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b7b6b-34f8-4af4-a281-11cade22cca0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:51.867150 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b7b6b-34f8-4af4-a281-11cade22cca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:51.867619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b7b6b-34f8-4af4-a281-11cade22cca0 None admin] PATH_INFO: `/v3/users/cc08f20dbde145f9baaac7ac87ebdce4` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:51.869074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b7b6b-34f8-4af4-a281-11cade22cca0 None admin] RBAC: Authorizing `identity:get_user(user_id=cc08f20dbde145f9baaac7ac87ebdce4)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:51.871235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b7b6b-34f8-4af4-a281-11cade22cca0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:51.873142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 88/175] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:51 2022] GET /identity/v3/users/cc08f20dbde145f9baaac7ac87ebdce4 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:30:51.880493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b7b6b-34f8-4af4-a281-11cade22cca0 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:51.934907 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e05b32-08de-436d-9718-00ddc7080bcb None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:51.976252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef626845-d175-4e17-951e-8773ed5c8b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:51.976996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef626845-d175-4e17-951e-8773ed5c8b28 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:51.977346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef626845-d175-4e17-951e-8773ed5c8b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:51.977684 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef626845-d175-4e17-951e-8773ed5c8b28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:52.014706 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b7b6b-34f8-4af4-a281-11cade22cca0 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:52.055994 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e653b-9536-4457-90b4-16ddab7e4b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:52.057410 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e653b-9536-4457-90b4-16ddab7e4b5f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:52.057757 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e653b-9536-4457-90b4-16ddab7e4b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:52.058096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e653b-9536-4457-90b4-16ddab7e4b5f None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:52.059457 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e653b-9536-4457-90b4-16ddab7e4b5f None admin] RBAC: Authorizing `identity:get_project(project_id=0c3884c9c1c84b738e43a478898c36f8)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:52.060959 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e653b-9536-4457-90b4-16ddab7e4b5f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:52.062760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 89/176] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:30:51 2022] GET /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:52.063282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef626845-d175-4e17-951e-8773ed5c8b28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:52.064955 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef626845-d175-4e17-951e-8773ed5c8b28 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:52.068410 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e653b-9536-4457-90b4-16ddab7e4b5f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:52.184504 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e653b-9536-4457-90b4-16ddab7e4b5f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:52.187510 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 88/177] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:30:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 06:30:52.196535 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef626845-d175-4e17-951e-8773ed5c8b28 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:52.237277 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fbc16-396b-493e-af1a-85dbc8ca519f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:52.238170 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fbc16-396b-493e-af1a-85dbc8ca519f None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:52.238444 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fbc16-396b-493e-af1a-85dbc8ca519f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:52.238713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fbc16-396b-493e-af1a-85dbc8ca519f None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8/users/cc08f20dbde145f9baaac7ac87ebdce4/roles/6499c37d9f3048e1b9966d520667bd09` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:52.243402 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fbc16-396b-493e-af1a-85dbc8ca519f None admin] RBAC: Authorizing `identity:create_grant(project_id=0c3884c9c1c84b738e43a478898c36f8, user_id=cc08f20dbde145f9baaac7ac87ebdce4, role_id=6499c37d9f3048e1b9966d520667bd09)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:52.246515 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fbc16-396b-493e-af1a-85dbc8ca519f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:52.324460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef626845-d175-4e17-951e-8773ed5c8b28 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:52.332510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 90/178] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:30:52 2022] PUT /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8/users/cc08f20dbde145f9baaac7ac87ebdce4/roles/6499c37d9f3048e1b9966d520667bd09 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:30:52.378721 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa02fb-012b-4030-b6a7-1cee84237e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:52.379930 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa02fb-012b-4030-b6a7-1cee84237e57 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:52.380387 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa02fb-012b-4030-b6a7-1cee84237e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:52.380861 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa02fb-012b-4030-b6a7-1cee84237e57 None admin] PATH_INFO: `/v3/projects/cfb01cb3dcdd456f8fa0525c42c829bb` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:52.383413 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa02fb-012b-4030-b6a7-1cee84237e57 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb01cb3dcdd456f8fa0525c42c829bb)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:52.385670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa02fb-012b-4030-b6a7-1cee84237e57 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:52.387804 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 89/179] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:30:52 2022] GET /identity/v3/projects/cfb01cb3dcdd456f8fa0525c42c829bb => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:30:52.393919 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fbc16-396b-493e-af1a-85dbc8ca519f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:52.520245 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fbc16-396b-493e-af1a-85dbc8ca519f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:52.557659 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14bddf-4eec-4b93-afe4-bf4ec1bd7134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:52.558325 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14bddf-4eec-4b93-afe4-bf4ec1bd7134 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:52.558603 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14bddf-4eec-4b93-afe4-bf4ec1bd7134 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:52.558873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14bddf-4eec-4b93-afe4-bf4ec1bd7134 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:52.559750 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14bddf-4eec-4b93-afe4-bf4ec1bd7134 None admin] RBAC: Adding query filter params (role.id=2162d563a5344c26821a7961cb75468b, scope.project.id=cfb01cb3dcdd456f8fa0525c42c829bb, user.id=dffac131970f4d20b8b06d03ca4d1883) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:52.560111 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14bddf-4eec-4b93-afe4-bf4ec1bd7134 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:52.561663 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14bddf-4eec-4b93-afe4-bf4ec1bd7134 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:52.568638 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 91/180] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:30:52 2022] GET /identity/v3/role_assignments?user.id=dffac131970f4d20b8b06d03ca4d1883&scope.project.id=cfb01cb3dcdd456f8fa0525c42c829bb&role.id=2162d563a5344c26821a7961cb75468b => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:53.638639 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed05cb2-f6c3-4010-bb34-917eedb9e8f7 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:53.639151 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed05cb2-f6c3-4010-bb34-917eedb9e8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:53.639227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed05cb2-f6c3-4010-bb34-917eedb9e8f7 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:53.640586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 90/181] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:53.645872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ad762-9f03-42c9-bea4-20652668564b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:53.646284 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ad762-9f03-42c9-bea4-20652668564b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:53.646468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ad762-9f03-42c9-bea4-20652668564b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:53.663462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-0f8ad762-9f03-42c9-bea4-20652668564b None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:53.664703 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0f8ad762-9f03-42c9-bea4-20652668564b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:53.739306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 92/182] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:30:53.762916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed05cb2-f6c3-4010-bb34-917eedb9e8f7 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:53.866129 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed05cb2-f6c3-4010-bb34-917eedb9e8f7 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:53.878455 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1d049-15f7-429f-b972-c0d3a3a3cc9e None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:53.878768 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1d049-15f7-429f-b972-c0d3a3a3cc9e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:53.879049 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1d049-15f7-429f-b972-c0d3a3a3cc9e None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:53.880913 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 93/183] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:30:53.885785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5003e3-ac9d-4e40-ae9a-8877639cbd8e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:53.886123 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5003e3-ac9d-4e40-ae9a-8877639cbd8e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:53.886349 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5003e3-ac9d-4e40-ae9a-8877639cbd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:53.903106 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-7e5003e3-ac9d-4e40-ae9a-8877639cbd8e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:53.904251 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7e5003e3-ac9d-4e40-ae9a-8877639cbd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:53.905871 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca292c6-ff9d-4818-a939-08283bb31f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:53.906873 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca292c6-ff9d-4818-a939-08283bb31f44 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:53.907342 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca292c6-ff9d-4818-a939-08283bb31f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:53.907866 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca292c6-ff9d-4818-a939-08283bb31f44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:53.919379 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca292c6-ff9d-4818-a939-08283bb31f44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:53.927507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5ca292c6-ff9d-4818-a939-08283bb31f44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:30:53.927507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:53.927507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:53.927507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:53.927507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:53.927507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:53.927507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:53.927507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:53.927507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:53.927507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:53.927507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:53.927507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:53.927507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:53.927507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:53.927507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:53.927507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:53.931868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:53.931868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:53.931868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:53.931868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:53.931868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:53.931868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:53.931868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:53.931868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:53.931868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:53.931868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:53.931868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:53.931868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:30:53.931868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:53.931868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:53.931868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:53.931868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:53.932661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:53.932661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:53.932661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:53.932661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:53.932661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:53.932661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:53.932661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:53.932661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:53.932661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:53.932661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:53.932661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:30:53.932661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:30:53.932661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 91/184] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:30:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:30:53.935154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca292c6-ff9d-4818-a939-08283bb31f44 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:53.980908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 94/185] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:30:54.004500 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5003e3-ac9d-4e40-ae9a-8877639cbd8e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:54.089696 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca292c6-ff9d-4818-a939-08283bb31f44 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:54.108373 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5003e3-ac9d-4e40-ae9a-8877639cbd8e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:54.133885 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a9e34-8e14-4d4a-b58a-d118d254cddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:54.135056 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a9e34-8e14-4d4a-b58a-d118d254cddd None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:54.135588 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a9e34-8e14-4d4a-b58a-d118d254cddd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:54.136341 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a9e34-8e14-4d4a-b58a-d118d254cddd None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:54.137564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a9e34-8e14-4d4a-b58a-d118d254cddd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:54.138203 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a9e34-8e14-4d4a-b58a-d118d254cddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:54.140367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a9e34-8e14-4d4a-b58a-d118d254cddd None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:54.143793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e354e16-80f9-4039-af0f-06091aa62ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:54.144712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e354e16-80f9-4039-af0f-06091aa62ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:54.145063 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e354e16-80f9-4039-af0f-06091aa62ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:54.145415 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e354e16-80f9-4039-af0f-06091aa62ed6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:54.151304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 92/186] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:30:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:54.156436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a9e34-8e14-4d4a-b58a-d118d254cddd None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:54.161464 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e354e16-80f9-4039-af0f-06091aa62ed6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:54.169674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-0e354e16-80f9-4039-af0f-06091aa62ed6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:30:54.169674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:54.169674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:54.169674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:54.169674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:54.169674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:54.169674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:54.169674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:54.169674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:54.169674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:54.169674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:54.169674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:54.169674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:54.169674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:54.169674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:54.169674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:54.170607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:54.170607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:54.170607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:54.170607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:54.170607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:54.170607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:54.170607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:54.170607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:54.170607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:54.170607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:54.170607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:54.170607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:30:54.170607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:54.170607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:54.170607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:54.170607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:54.171386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:54.171386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:54.171386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:54.171386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:54.171386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:54.171386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:54.171386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:54.171386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:54.171386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:54.171386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:54.171386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:30:54.171386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:30:54.171386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 95/187] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:30:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:30:54.183427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e354e16-80f9-4039-af0f-06091aa62ed6 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:54.268155 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a9e34-8e14-4d4a-b58a-d118d254cddd None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:54.284229 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e354e16-80f9-4039-af0f-06091aa62ed6 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:54.301087 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b776c5-56e6-4528-b730-1ea8a2c33ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:54.301960 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b776c5-56e6-4528-b730-1ea8a2c33ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:54.302241 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b776c5-56e6-4528-b730-1ea8a2c33ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:54.302515 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b776c5-56e6-4528-b730-1ea8a2c33ad2 None admin] PATH_INFO: `/v3/users/fac9efcda68b47b9bce3f4a650586c64` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:54.317013 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b776c5-56e6-4528-b730-1ea8a2c33ad2 None admin] RBAC: Authorizing `identity:get_user(user_id=fac9efcda68b47b9bce3f4a650586c64)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:54.318006 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b953c-456e-413f-996d-27f25d0891a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:54.318496 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b776c5-56e6-4528-b730-1ea8a2c33ad2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:54.318675 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b953c-456e-413f-996d-27f25d0891a1 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:54.318957 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b953c-456e-413f-996d-27f25d0891a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:54.319234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b953c-456e-413f-996d-27f25d0891a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:54.320040 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b953c-456e-413f-996d-27f25d0891a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:54.320458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 93/188] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:54 2022] GET /identity/v3/users/fac9efcda68b47b9bce3f4a650586c64 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:54.321582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cb7bf-2749-473b-8501-23199b68ddb3 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:54.321869 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cb7bf-2749-473b-8501-23199b68ddb3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:54.322142 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cb7bf-2749-473b-8501-23199b68ddb3 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:54.323540 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 94/189] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:54.324742 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b953c-456e-413f-996d-27f25d0891a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:54.326149 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b953c-456e-413f-996d-27f25d0891a1 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:54.328393 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cb7bf-2749-473b-8501-23199b68ddb3 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:54.334961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 96/190] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:30:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:54.337238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7e3fb-8b97-40c8-b39b-b0984c772c88 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:54.337761 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7e3fb-8b97-40c8-b39b-b0984c772c88 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:54.338857 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7e3fb-8b97-40c8-b39b-b0984c772c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:54.356005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-0cb7e3fb-8b97-40c8-b39b-b0984c772c88 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:54.357288 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0cb7e3fb-8b97-40c8-b39b-b0984c772c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:54.425920 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 97/191] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:54.426692 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7e3fb-8b97-40c8-b39b-b0984c772c88 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:54.441305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cb7bf-2749-473b-8501-23199b68ddb3 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:54.474918 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e10172-06dd-42c2-adc5-1cbefd08fd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:54.475564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e10172-06dd-42c2-adc5-1cbefd08fd28 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:54.475888 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e10172-06dd-42c2-adc5-1cbefd08fd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:54.476161 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e10172-06dd-42c2-adc5-1cbefd08fd28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:54.528366 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7e3fb-8b97-40c8-b39b-b0984c772c88 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:54.543996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e10172-06dd-42c2-adc5-1cbefd08fd28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:54.545461 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e10172-06dd-42c2-adc5-1cbefd08fd28 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:54.561636 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a25fe-ac00-4482-bd5e-3fce2a11a4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:54.562512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a25fe-ac00-4482-bd5e-3fce2a11a4ff None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:54.562802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a25fe-ac00-4482-bd5e-3fce2a11a4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:54.563073 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a25fe-ac00-4482-bd5e-3fce2a11a4ff None admin] PATH_INFO: `/v3/users/fac9efcda68b47b9bce3f4a650586c64` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:54.564312 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a25fe-ac00-4482-bd5e-3fce2a11a4ff None admin] RBAC: Authorizing `identity:get_user(user_id=fac9efcda68b47b9bce3f4a650586c64)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:54.565749 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a25fe-ac00-4482-bd5e-3fce2a11a4ff None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:54.567380 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 98/192] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:54 2022] GET /identity/v3/users/fac9efcda68b47b9bce3f4a650586c64 => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:54.568164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a25fe-ac00-4482-bd5e-3fce2a11a4ff None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:54.649932 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 95/193] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:30:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:30:54.651477 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e10172-06dd-42c2-adc5-1cbefd08fd28 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:54.670712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a25fe-ac00-4482-bd5e-3fce2a11a4ff None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:54.704154 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284c7f2-e94e-48c0-828c-994f82ae5645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:54.704883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284c7f2-e94e-48c0-828c-994f82ae5645 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:54.705167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284c7f2-e94e-48c0-828c-994f82ae5645 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:54.705532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284c7f2-e94e-48c0-828c-994f82ae5645 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:54.706631 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284c7f2-e94e-48c0-828c-994f82ae5645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:54.708119 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284c7f2-e94e-48c0-828c-994f82ae5645 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:54.714421 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 99/194] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:30:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:54.714421 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284c7f2-e94e-48c0-828c-994f82ae5645 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:54.749495 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e10172-06dd-42c2-adc5-1cbefd08fd28 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:54.782292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85da10e-04f7-4027-9b05-8d45d30e0e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:54.782942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85da10e-04f7-4027-9b05-8d45d30e0e81 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:54.783223 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85da10e-04f7-4027-9b05-8d45d30e0e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:54.783494 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85da10e-04f7-4027-9b05-8d45d30e0e81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:54.808787 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284c7f2-e94e-48c0-828c-994f82ae5645 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:54.841514 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e99f9-65a9-4e4d-81d5-f132db25ba17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:54.842448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e99f9-65a9-4e4d-81d5-f132db25ba17 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:54.842670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e99f9-65a9-4e4d-81d5-f132db25ba17 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:54.842950 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e99f9-65a9-4e4d-81d5-f132db25ba17 None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:54.844166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e99f9-65a9-4e4d-81d5-f132db25ba17 None admin] RBAC: Authorizing `identity:get_project(project_id=997175288e39489ead5929a225ecbf2c)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:54.845602 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e99f9-65a9-4e4d-81d5-f132db25ba17 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:54.847309 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 100/195] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:30:54 2022] GET /identity/v3/projects/997175288e39489ead5929a225ecbf2c => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:54.848078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e99f9-65a9-4e4d-81d5-f132db25ba17 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:54.853354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85da10e-04f7-4027-9b05-8d45d30e0e81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:54.855400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85da10e-04f7-4027-9b05-8d45d30e0e81 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:54.939712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e99f9-65a9-4e4d-81d5-f132db25ba17 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:54.947710 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 96/196] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:30:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:30:54.949222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa3881-1b92-464d-9564-bae15b40416c None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:54.949511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa3881-1b92-464d-9564-bae15b40416c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:54.949787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa3881-1b92-464d-9564-bae15b40416c None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:54.951062 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 97/197] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:54.951827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa3881-1b92-464d-9564-bae15b40416c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:54.975637 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9313b0-b953-4887-ab78-cd1e3ae504a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:54.975637 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9313b0-b953-4887-ab78-cd1e3ae504a4 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:54.975637 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9313b0-b953-4887-ab78-cd1e3ae504a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:54.975637 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9313b0-b953-4887-ab78-cd1e3ae504a4 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:54.976112 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9313b0-b953-4887-ab78-cd1e3ae504a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:54.977471 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9313b0-b953-4887-ab78-cd1e3ae504a4 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:55.047066 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa3881-1b92-464d-9564-bae15b40416c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:55.080051 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b62ae-4d1c-4420-b4de-447d59aaeec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:55.080685 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b62ae-4d1c-4420-b4de-447d59aaeec7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:55.080961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b62ae-4d1c-4420-b4de-447d59aaeec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:55.081259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b62ae-4d1c-4420-b4de-447d59aaeec7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:55.082085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b62ae-4d1c-4420-b4de-447d59aaeec7 None admin] RBAC: Adding query filter params (role.id=5e6a73052f3b4ee7829ecb858925e5ca, scope.project.id=997175288e39489ead5929a225ecbf2c, user.id=fac9efcda68b47b9bce3f4a650586c64) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:55.084053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b62ae-4d1c-4420-b4de-447d59aaeec7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:55.084053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b62ae-4d1c-4420-b4de-447d59aaeec7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:55.089306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 98/198] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:30:54 2022] GET /identity/v3/role_assignments?user.id=fac9efcda68b47b9bce3f4a650586c64&scope.project.id=997175288e39489ead5929a225ecbf2c&role.id=5e6a73052f3b4ee7829ecb858925e5ca => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:55.089960 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b62ae-4d1c-4420-b4de-447d59aaeec7 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:55.110290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 101/199] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 12 06:30:54 2022] POST /identity/v3/users => generated 297 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:30:55.112133 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5ae70-a4ac-444c-8ff5-8709ffdf31ff None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:55.112678 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5ae70-a4ac-444c-8ff5-8709ffdf31ff None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:55.113161 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5ae70-a4ac-444c-8ff5-8709ffdf31ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:55.134174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3eb5ae70-a4ac-444c-8ff5-8709ffdf31ff None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:55.136174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3eb5ae70-a4ac-444c-8ff5-8709ffdf31ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:55.215998 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 102/200] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:55.233731 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b62ae-4d1c-4420-b4de-447d59aaeec7 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:55.243485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5ae70-a4ac-444c-8ff5-8709ffdf31ff None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:55.273987 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e7954-cd2f-4179-ae18-a36d0824cf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:55.275250 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e7954-cd2f-4179-ae18-a36d0824cf92 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:55.275933 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e7954-cd2f-4179-ae18-a36d0824cf92 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:55.276359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e7954-cd2f-4179-ae18-a36d0824cf92 None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:55.277994 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e7954-cd2f-4179-ae18-a36d0824cf92 None admin] RBAC: Authorizing `identity:get_project(project_id=997175288e39489ead5929a225ecbf2c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:55.279910 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e7954-cd2f-4179-ae18-a36d0824cf92 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:55.282851 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 99/201] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:30:55 2022] GET /identity/v3/projects/997175288e39489ead5929a225ecbf2c => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:55.289294 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e7954-cd2f-4179-ae18-a36d0824cf92 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:55.363306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5ae70-a4ac-444c-8ff5-8709ffdf31ff None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:55.414497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f58b4-4711-4765-8f3a-5b0914e8f43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:55.415567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f58b4-4711-4765-8f3a-5b0914e8f43b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:55.415886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f58b4-4711-4765-8f3a-5b0914e8f43b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:55.416723 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f58b4-4711-4765-8f3a-5b0914e8f43b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:55.424648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e7954-cd2f-4179-ae18-a36d0824cf92 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:55.432632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f58b4-4711-4765-8f3a-5b0914e8f43b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:55.440680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-0d3f58b4-4711-4765-8f3a-5b0914e8f43b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 06:30:55.440680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:55.440680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:55.440680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:55.440680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:55.440680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:55.440680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:55.440680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:55.440680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:55.440680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:55.440680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:55.440680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:55.440680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:55.440680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:55.440680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:55.440680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:55.441611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:55.441611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:55.441611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:55.441611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:55.441611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:55.441611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:55.441611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:55.441611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:55.441611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:55.441611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:55.441611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:55.441611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:30:55.441611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:55.441611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:55.441611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:55.441611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:55.442414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:55.442414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:55.442414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:55.442414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:55.442414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:55.442414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:55.442414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:55.442414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:55.442414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:55.442414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:55.442414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 06:30:55.442414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:30:55.442414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 103/202] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:30:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:30:55.450216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f58b4-4711-4765-8f3a-5b0914e8f43b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:55.470795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b0e76-bb73-467b-a314-6937cffa2e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:55.471454 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b0e76-bb73-467b-a314-6937cffa2e84 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:55.471760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b0e76-bb73-467b-a314-6937cffa2e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:55.472039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b0e76-bb73-467b-a314-6937cffa2e84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:55.472882 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b0e76-bb73-467b-a314-6937cffa2e84 None admin] RBAC: Adding query filter params (role.id=cba01848eb624bfaaeeb1244e02e5bd7, scope.project.id=997175288e39489ead5929a225ecbf2c, user.id=fac9efcda68b47b9bce3f4a650586c64) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:55.473487 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b0e76-bb73-467b-a314-6937cffa2e84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:55.474757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b0e76-bb73-467b-a314-6937cffa2e84 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:55.481757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 100/203] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:30:55 2022] GET /identity/v3/role_assignments?user.id=fac9efcda68b47b9bce3f4a650586c64&scope.project.id=997175288e39489ead5929a225ecbf2c&role.id=cba01848eb624bfaaeeb1244e02e5bd7 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:55.581669 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f58b4-4711-4765-8f3a-5b0914e8f43b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:55.631931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694748f4-af04-41d1-a6c0-71377a09847a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:55.632619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694748f4-af04-41d1-a6c0-71377a09847a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:55.632903 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694748f4-af04-41d1-a6c0-71377a09847a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:55.633181 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694748f4-af04-41d1-a6c0-71377a09847a None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:55.633958 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694748f4-af04-41d1-a6c0-71377a09847a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:55.634267 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694748f4-af04-41d1-a6c0-71377a09847a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:55.635809 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694748f4-af04-41d1-a6c0-71377a09847a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:55.645528 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 104/204] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:30:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:55.651289 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b0e76-bb73-467b-a314-6937cffa2e84 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:55.774798 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b0e76-bb73-467b-a314-6937cffa2e84 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:55.810009 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c596742-0308-4737-aa33-0db1e12b58d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:55.810894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c596742-0308-4737-aa33-0db1e12b58d4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:55.811176 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c596742-0308-4737-aa33-0db1e12b58d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:55.811449 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c596742-0308-4737-aa33-0db1e12b58d4 None admin] PATH_INFO: `/v3/users/cc08f20dbde145f9baaac7ac87ebdce4` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:55.812713 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c596742-0308-4737-aa33-0db1e12b58d4 None admin] RBAC: Authorizing `identity:get_user(user_id=cc08f20dbde145f9baaac7ac87ebdce4)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:55.814167 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c596742-0308-4737-aa33-0db1e12b58d4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:55.816130 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 101/205] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:55 2022] GET /identity/v3/users/cc08f20dbde145f9baaac7ac87ebdce4 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:55.821779 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694748f4-af04-41d1-a6c0-71377a09847a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:55.934281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694748f4-af04-41d1-a6c0-71377a09847a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:55.957664 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7735e9-7cc4-42ef-aa79-1fef9c524c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:55.958331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7735e9-7cc4-42ef-aa79-1fef9c524c0f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:55.958654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7735e9-7cc4-42ef-aa79-1fef9c524c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:55.959728 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7735e9-7cc4-42ef-aa79-1fef9c524c0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:56.028505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7735e9-7cc4-42ef-aa79-1fef9c524c0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:56.029970 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7735e9-7cc4-42ef-aa79-1fef9c524c0f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:56.130142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 105/206] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:30:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:30:56.135835 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c596742-0308-4737-aa33-0db1e12b58d4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:56.235386 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c596742-0308-4737-aa33-0db1e12b58d4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:56.269453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db7752-e4ab-4e0c-a543-a7d2afbd06f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:56.270310 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db7752-e4ab-4e0c-a543-a7d2afbd06f1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:56.270589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db7752-e4ab-4e0c-a543-a7d2afbd06f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:56.270859 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db7752-e4ab-4e0c-a543-a7d2afbd06f1 None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:56.272079 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db7752-e4ab-4e0c-a543-a7d2afbd06f1 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3884c9c1c84b738e43a478898c36f8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:56.273521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db7752-e4ab-4e0c-a543-a7d2afbd06f1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:56.275778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 102/207] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:30:56 2022] GET /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:56.291114 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7735e9-7cc4-42ef-aa79-1fef9c524c0f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:56.417832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7735e9-7cc4-42ef-aa79-1fef9c524c0f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:56.451908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694a266-f766-4ad2-88ef-29eca46808a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:56.452575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694a266-f766-4ad2-88ef-29eca46808a8 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:56.452854 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694a266-f766-4ad2-88ef-29eca46808a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:56.453124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694a266-f766-4ad2-88ef-29eca46808a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:56.453966 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694a266-f766-4ad2-88ef-29eca46808a8 None admin] RBAC: Adding query filter params (role.id=6499c37d9f3048e1b9966d520667bd09, scope.project.id=0c3884c9c1c84b738e43a478898c36f8, user.id=cc08f20dbde145f9baaac7ac87ebdce4) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:56.454273 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694a266-f766-4ad2-88ef-29eca46808a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:56.455719 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694a266-f766-4ad2-88ef-29eca46808a8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:56.461802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 106/208] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:30:56 2022] GET /identity/v3/role_assignments?user.id=cc08f20dbde145f9baaac7ac87ebdce4&scope.project.id=0c3884c9c1c84b738e43a478898c36f8&role.id=6499c37d9f3048e1b9966d520667bd09 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:57.525195 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdde80c-14f9-45c9-9543-6ff96d1bf30e None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:57.526755 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdde80c-14f9-45c9-9543-6ff96d1bf30e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:57.527246 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdde80c-14f9-45c9-9543-6ff96d1bf30e None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:57.529205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 103/209] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:57.534742 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011e4c2-043a-4e2d-a620-bb3f5e46fe16 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:57.535563 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011e4c2-043a-4e2d-a620-bb3f5e46fe16 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:57.536169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011e4c2-043a-4e2d-a620-bb3f5e46fe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:57.553372 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-5011e4c2-043a-4e2d-a620-bb3f5e46fe16 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:57.554980 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5011e4c2-043a-4e2d-a620-bb3f5e46fe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:57.623318 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 107/210] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:57.645987 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdde80c-14f9-45c9-9543-6ff96d1bf30e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:57.754543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdde80c-14f9-45c9-9543-6ff96d1bf30e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:57.792386 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9f298-4cdf-4b34-8546-b773cbc33aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:57.793104 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9f298-4cdf-4b34-8546-b773cbc33aac None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:57.793383 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9f298-4cdf-4b34-8546-b773cbc33aac None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:57.793653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9f298-4cdf-4b34-8546-b773cbc33aac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:57.804114 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9f298-4cdf-4b34-8546-b773cbc33aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:57.811880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-64e9f298-4cdf-4b34-8546-b773cbc33aac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:30:57.811880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:57.811880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:57.811880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:57.811880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:57.811880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:57.811880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:57.811880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:57.811880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:57.811880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:57.811880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:57.811880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:57.811880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:57.811880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:57.811880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:57.811880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:57.812760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:57.812760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:57.812760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:57.812760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:57.812760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:57.812760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:57.812760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:57.812760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:57.812760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:57.812760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:57.812760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:57.812760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:30:57.812760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:57.812760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:57.812760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:57.812760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:57.813559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:57.813559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:57.813559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:57.813559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:57.813559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:57.813559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:57.813559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:57.813559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:57.813559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:57.813559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:57.813559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:30:57.813559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:30:57.813559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 104/211] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:30:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:30:57.818829 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011e4c2-043a-4e2d-a620-bb3f5e46fe16 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:57.914858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887330e5-e9b0-4732-9e00-8babc377bb2e None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:57.915458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887330e5-e9b0-4732-9e00-8babc377bb2e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:57.915656 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887330e5-e9b0-4732-9e00-8babc377bb2e None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:57.917233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 105/212] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:57.920718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011e4c2-043a-4e2d-a620-bb3f5e46fe16 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:57.923368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d14390-2621-4508-8256-b686f73dcf12 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:57.923889 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d14390-2621-4508-8256-b686f73dcf12 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:57.924304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d14390-2621-4508-8256-b686f73dcf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:57.943141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-01d14390-2621-4508-8256-b686f73dcf12 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:57.944388 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-01d14390-2621-4508-8256-b686f73dcf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:57.960573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358161d1-fa46-4764-a7b1-928c3a36fa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:57.961242 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358161d1-fa46-4764-a7b1-928c3a36fa2f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:57.961516 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358161d1-fa46-4764-a7b1-928c3a36fa2f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:57.961782 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358161d1-fa46-4764-a7b1-928c3a36fa2f None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:57.962534 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358161d1-fa46-4764-a7b1-928c3a36fa2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:57.963352 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358161d1-fa46-4764-a7b1-928c3a36fa2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:57.964739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358161d1-fa46-4764-a7b1-928c3a36fa2f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:57.973028 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 108/213] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:30:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:57.974446 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ba6ba-d025-465c-9000-b6e74b55a172 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:57.974736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ba6ba-d025-465c-9000-b6e74b55a172 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:57.975009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ba6ba-d025-465c-9000-b6e74b55a172 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:57.976433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 109/214] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:57.979213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ba6ba-d025-465c-9000-b6e74b55a172 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:58.051155 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 106/215] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:58.052480 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053dc6d-e2fd-4a5f-b6c7-1a09d1604c29 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:58.052764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053dc6d-e2fd-4a5f-b6c7-1a09d1604c29 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:58.053034 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053dc6d-e2fd-4a5f-b6c7-1a09d1604c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:58.068953 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0053dc6d-e2fd-4a5f-b6c7-1a09d1604c29 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:58.070334 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0053dc6d-e2fd-4a5f-b6c7-1a09d1604c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:58.090989 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ba6ba-d025-465c-9000-b6e74b55a172 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:58.122449 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194cf4f-4df6-4d83-91fd-04c99092cca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:58.123315 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194cf4f-4df6-4d83-91fd-04c99092cca7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:58.123602 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194cf4f-4df6-4d83-91fd-04c99092cca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:58.123901 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194cf4f-4df6-4d83-91fd-04c99092cca7 None admin] PATH_INFO: `/v3/users/fac9efcda68b47b9bce3f4a650586c64` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:58.125113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194cf4f-4df6-4d83-91fd-04c99092cca7 None admin] RBAC: Authorizing `identity:get_user(user_id=fac9efcda68b47b9bce3f4a650586c64)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:58.126530 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194cf4f-4df6-4d83-91fd-04c99092cca7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:58.128339 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 110/216] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:57 2022] GET /identity/v3/users/fac9efcda68b47b9bce3f4a650586c64 => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:30:58.128964 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194cf4f-4df6-4d83-91fd-04c99092cca7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:58.139533 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 107/217] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:58.140957 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0baee-0a2d-4688-8a25-9d621afc9223 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:58.141248 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0baee-0a2d-4688-8a25-9d621afc9223 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:58.141520 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0baee-0a2d-4688-8a25-9d621afc9223 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:58.142785 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 108/218] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:30:58.146894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0baee-0a2d-4688-8a25-9d621afc9223 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:58.224208 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194cf4f-4df6-4d83-91fd-04c99092cca7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:58.240726 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0baee-0a2d-4688-8a25-9d621afc9223 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:58.254814 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153bbbd-fae3-440c-9d17-66f0b87eb1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:58.255609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153bbbd-fae3-440c-9d17-66f0b87eb1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:58.255924 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153bbbd-fae3-440c-9d17-66f0b87eb1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:58.256201 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153bbbd-fae3-440c-9d17-66f0b87eb1b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:58.266401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153bbbd-fae3-440c-9d17-66f0b87eb1b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:58.272538 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d769c97-570c-4d08-b05a-2a25e63c9c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:58.273449 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d769c97-570c-4d08-b05a-2a25e63c9c3d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:58.273723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d769c97-570c-4d08-b05a-2a25e63c9c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:58.273986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d769c97-570c-4d08-b05a-2a25e63c9c3d None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:58.274254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-0153bbbd-fae3-440c-9d17-66f0b87eb1b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 06:30:58.274254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:58.274254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:58.274254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:58.274254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:58.274254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:58.274254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:58.274254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:58.274254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:58.274254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:58.274254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:58.274254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:58.274254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:58.274254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:58.274254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:58.274254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:58.276089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:58.276089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:58.276089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:58.276089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:58.276089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:58.276089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:58.276089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:58.276089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:58.276089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:58.276089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:58.276089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:58.276089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:30:58.276089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:58.276089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:58.276089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:58.276089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:58.276916 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:58.276916 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:58.276916 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:58.276916 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:58.276916 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:58.276916 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:58.276916 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:58.276916 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:58.276916 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:58.276916 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:58.276916 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 06:30:58.276916 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:30:58.276916 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 111/219] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:30:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:30:58.277570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d769c97-570c-4d08-b05a-2a25e63c9c3d None admin] RBAC: Authorizing `identity:get_project(project_id=997175288e39489ead5929a225ecbf2c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:58.278063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d769c97-570c-4d08-b05a-2a25e63c9c3d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:58.279780 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 109/220] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:30:58 2022] GET /identity/v3/projects/997175288e39489ead5929a225ecbf2c => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:58.280533 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d769c97-570c-4d08-b05a-2a25e63c9c3d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:58.281272 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eca458-c9a9-49d6-8bbb-ef1be6874901 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:58.281563 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eca458-c9a9-49d6-8bbb-ef1be6874901 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:58.281843 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eca458-c9a9-49d6-8bbb-ef1be6874901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:58.299105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-84eca458-c9a9-49d6-8bbb-ef1be6874901 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:30:58.300321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-84eca458-c9a9-49d6-8bbb-ef1be6874901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:30:58.363731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 112/221] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:30:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:30:58.364551 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eca458-c9a9-49d6-8bbb-ef1be6874901 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:58.376219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d769c97-570c-4d08-b05a-2a25e63c9c3d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:58.408862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ce894-bef7-40c9-90b9-0f5d71cf5a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:58.409667 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ce894-bef7-40c9-90b9-0f5d71cf5a4f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:58.409950 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ce894-bef7-40c9-90b9-0f5d71cf5a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:58.410224 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ce894-bef7-40c9-90b9-0f5d71cf5a4f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:58.420682 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ce894-bef7-40c9-90b9-0f5d71cf5a4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:30:58.429141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-7f7ce894-bef7-40c9-90b9-0f5d71cf5a4f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:30:58.429141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:30:58.429141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:30:58.429141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:30:58.429141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:30:58.429141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:30:58.429141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:30:58.429141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:30:58.429141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:30:58.429141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:30:58.429141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:30:58.429141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:30:58.429141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:30:58.429141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:30:58.429141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:30:58.429141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:30:58.429997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:30:58.429997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:30:58.429997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:30:58.429997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:30:58.429997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:30:58.429997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:30:58.429997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:30:58.429997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:30:58.429997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:30:58.429997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:30:58.429997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:30:58.429997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:30:58.429997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:30:58.429997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:30:58.429997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:30:58.429997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:30:58.430817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:30:58.430817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:30:58.430817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:30:58.430817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:30:58.430817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:30:58.430817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:30:58.430817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:30:58.430817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:30:58.430817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:30:58.430817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:30:58.430817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:30:58.430817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:30:58.430817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 110/222] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:30:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:30:58.432133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ce894-bef7-40c9-90b9-0f5d71cf5a4f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:58.458736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eca458-c9a9-49d6-8bbb-ef1be6874901 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:58.493218 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922946ef-e5e4-41f3-851b-a948812f8fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:58.494630 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922946ef-e5e4-41f3-851b-a948812f8fc9 None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:58.494911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922946ef-e5e4-41f3-851b-a948812f8fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:58.495182 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922946ef-e5e4-41f3-851b-a948812f8fc9 None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c/users/fac9efcda68b47b9bce3f4a650586c64/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:58.497182 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922946ef-e5e4-41f3-851b-a948812f8fc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=997175288e39489ead5929a225ecbf2c, user_id=fac9efcda68b47b9bce3f4a650586c64, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:58.498635 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922946ef-e5e4-41f3-851b-a948812f8fc9 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:58.527542 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ce894-bef7-40c9-90b9-0f5d71cf5a4f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:58.559918 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406fde3-ee66-45fa-b6f4-64129f87e0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:58.560571 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406fde3-ee66-45fa-b6f4-64129f87e0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:58.560852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406fde3-ee66-45fa-b6f4-64129f87e0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:58.561125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406fde3-ee66-45fa-b6f4-64129f87e0c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:58.561897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406fde3-ee66-45fa-b6f4-64129f87e0c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:58.562212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406fde3-ee66-45fa-b6f4-64129f87e0c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:58.563576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406fde3-ee66-45fa-b6f4-64129f87e0c7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:58.564855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 113/223] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:30:58 2022] PUT /identity/v3/projects/997175288e39489ead5929a225ecbf2c/users/fac9efcda68b47b9bce3f4a650586c64/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:30:58.565727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922946ef-e5e4-41f3-851b-a948812f8fc9 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:58.572917 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 111/224] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:30:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:58.574083 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406fde3-ee66-45fa-b6f4-64129f87e0c7 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:58.670214 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922946ef-e5e4-41f3-851b-a948812f8fc9 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:58.686678 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406fde3-ee66-45fa-b6f4-64129f87e0c7 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:58.706564 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c60983-8eaf-47af-884c-141ef116acd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:58.707374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c60983-8eaf-47af-884c-141ef116acd2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:58.707654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c60983-8eaf-47af-884c-141ef116acd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:58.707956 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c60983-8eaf-47af-884c-141ef116acd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:58.709183 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c60983-8eaf-47af-884c-141ef116acd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:58.710650 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c60983-8eaf-47af-884c-141ef116acd2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:58.712613 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 114/225] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:30:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:58.713275 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c60983-8eaf-47af-884c-141ef116acd2 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:58.727101 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d19619-389a-497f-8ef1-42499223e25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:58.727828 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d19619-389a-497f-8ef1-42499223e25a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:58.728115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d19619-389a-497f-8ef1-42499223e25a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:58.728449 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d19619-389a-497f-8ef1-42499223e25a None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:58.729227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d19619-389a-497f-8ef1-42499223e25a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:58.729554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d19619-389a-497f-8ef1-42499223e25a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:58.731060 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d19619-389a-497f-8ef1-42499223e25a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:58.745002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 112/226] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:30:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:58.745002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d19619-389a-497f-8ef1-42499223e25a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:58.813490 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c60983-8eaf-47af-884c-141ef116acd2 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:58.845725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d19619-389a-497f-8ef1-42499223e25a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:58.846117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58eaccb-d105-4ab1-ae59-abb3c22223ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:58.846995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58eaccb-d105-4ab1-ae59-abb3c22223ad None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:58.847282 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58eaccb-d105-4ab1-ae59-abb3c22223ad None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:58.847557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58eaccb-d105-4ab1-ae59-abb3c22223ad None admin] PATH_INFO: `/v3/users/e8c01560d4044a2a813808a84f0abf95` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:58.861891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58eaccb-d105-4ab1-ae59-abb3c22223ad None admin] RBAC: Authorizing `identity:get_user(user_id=e8c01560d4044a2a813808a84f0abf95)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:58.863351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58eaccb-d105-4ab1-ae59-abb3c22223ad None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:58.869527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 115/227] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:58 2022] GET /identity/v3/users/e8c01560d4044a2a813808a84f0abf95 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:58.869527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58eaccb-d105-4ab1-ae59-abb3c22223ad None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:58.879249 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f2ca0-b0eb-487d-b277-4af2828601e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:58.879953 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f2ca0-b0eb-487d-b277-4af2828601e4 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:58.880237 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f2ca0-b0eb-487d-b277-4af2828601e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:58.880507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f2ca0-b0eb-487d-b277-4af2828601e4 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:58.881227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f2ca0-b0eb-487d-b277-4af2828601e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:58.882668 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f2ca0-b0eb-487d-b277-4af2828601e4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:58.966533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58eaccb-d105-4ab1-ae59-abb3c22223ad None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:58.999456 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8087bdc-54b6-4b15-8247-738dff61771e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:59.000018 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 113/228] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 12 06:30:58 2022] POST /identity/v3/users => generated 297 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:30:59.000929 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f2ca0-b0eb-487d-b277-4af2828601e4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:59.004559 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8087bdc-54b6-4b15-8247-738dff61771e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:59.004838 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8087bdc-54b6-4b15-8247-738dff61771e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:59.005127 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8087bdc-54b6-4b15-8247-738dff61771e None admin] PATH_INFO: `/v3/users/fac9efcda68b47b9bce3f4a650586c64` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:59.006469 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8087bdc-54b6-4b15-8247-738dff61771e None admin] RBAC: Authorizing `identity:get_user(user_id=fac9efcda68b47b9bce3f4a650586c64)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:59.008006 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8087bdc-54b6-4b15-8247-738dff61771e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:59.010474 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 116/229] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:30:58 2022] GET /identity/v3/users/fac9efcda68b47b9bce3f4a650586c64 => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:30:59.016202 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8087bdc-54b6-4b15-8247-738dff61771e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:59.122084 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f2ca0-b0eb-487d-b277-4af2828601e4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:59.122973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8087bdc-54b6-4b15-8247-738dff61771e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:59.160127 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8e261-f445-485e-9902-013e412dd62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:59.161080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8e261-f445-485e-9902-013e412dd62c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:59.161361 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8e261-f445-485e-9902-013e412dd62c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:59.161659 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b06eb5-dd5b-4cd5-ae41-aefda3f23ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:59.161778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8e261-f445-485e-9902-013e412dd62c None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:59.162782 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b06eb5-dd5b-4cd5-ae41-aefda3f23ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:59.163019 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8e261-f445-485e-9902-013e412dd62c None admin] RBAC: Authorizing `identity:get_project(project_id=997175288e39489ead5929a225ecbf2c)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:59.163495 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b06eb5-dd5b-4cd5-ae41-aefda3f23ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:59.163995 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b06eb5-dd5b-4cd5-ae41-aefda3f23ed0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:59.164604 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8e261-f445-485e-9902-013e412dd62c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:59.166717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 117/230] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:30:59 2022] GET /identity/v3/projects/997175288e39489ead5929a225ecbf2c => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:30:59.172679 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8e261-f445-485e-9902-013e412dd62c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:59.237027 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b06eb5-dd5b-4cd5-ae41-aefda3f23ed0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:59.238845 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b06eb5-dd5b-4cd5-ae41-aefda3f23ed0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:59.275594 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8e261-f445-485e-9902-013e412dd62c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:59.313289 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7479e-e4ef-4cbe-b5d8-995370c39540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:59.314197 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7479e-e4ef-4cbe-b5d8-995370c39540 None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:59.314479 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7479e-e4ef-4cbe-b5d8-995370c39540 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:59.314753 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7479e-e4ef-4cbe-b5d8-995370c39540 None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c/users/fac9efcda68b47b9bce3f4a650586c64/roles/cba01848eb624bfaaeeb1244e02e5bd7` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:59.317094 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7479e-e4ef-4cbe-b5d8-995370c39540 None admin] RBAC: Authorizing `identity:create_grant(project_id=997175288e39489ead5929a225ecbf2c, user_id=fac9efcda68b47b9bce3f4a650586c64, role_id=cba01848eb624bfaaeeb1244e02e5bd7)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:59.318566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7479e-e4ef-4cbe-b5d8-995370c39540 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:59.347095 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 114/231] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:30:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:30:59.352691 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b06eb5-dd5b-4cd5-ae41-aefda3f23ed0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:59.406263 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 118/232] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:30:59 2022] PUT /identity/v3/projects/997175288e39489ead5929a225ecbf2c/users/fac9efcda68b47b9bce3f4a650586c64/roles/cba01848eb624bfaaeeb1244e02e5bd7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:30:59.468220 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b06eb5-dd5b-4cd5-ae41-aefda3f23ed0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:59.507182 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69841af5-7fc9-4b01-bef4-8ef4f3119aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:59.508095 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69841af5-7fc9-4b01-bef4-8ef4f3119aec None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:59.508379 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69841af5-7fc9-4b01-bef4-8ef4f3119aec None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:59.508649 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69841af5-7fc9-4b01-bef4-8ef4f3119aec None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:59.510001 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69841af5-7fc9-4b01-bef4-8ef4f3119aec None admin] RBAC: Authorizing `identity:get_project(project_id=997175288e39489ead5929a225ecbf2c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:59.511567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69841af5-7fc9-4b01-bef4-8ef4f3119aec None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:59.513391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 115/233] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:30:59 2022] GET /identity/v3/projects/997175288e39489ead5929a225ecbf2c => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:30:59.519392 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7479e-e4ef-4cbe-b5d8-995370c39540 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:30:59.635592 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7479e-e4ef-4cbe-b5d8-995370c39540 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:30:59.673887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d4883-248d-414b-a056-494f5254c531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:30:59.674548 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d4883-248d-414b-a056-494f5254c531 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:30:59.674828 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d4883-248d-414b-a056-494f5254c531 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:30:59.675158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d4883-248d-414b-a056-494f5254c531 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:30:59.676081 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d4883-248d-414b-a056-494f5254c531 None admin] RBAC: Adding query filter params (role.id=2162d563a5344c26821a7961cb75468b, scope.project.id=997175288e39489ead5929a225ecbf2c, user.id=e8c01560d4044a2a813808a84f0abf95) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:30:59.676444 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d4883-248d-414b-a056-494f5254c531 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:30:59.677912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d4883-248d-414b-a056-494f5254c531 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:30:59.684124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 119/234] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:30:59 2022] GET /identity/v3/role_assignments?user.id=e8c01560d4044a2a813808a84f0abf95&scope.project.id=997175288e39489ead5929a225ecbf2c&role.id=2162d563a5344c26821a7961cb75468b => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:00.943881 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193e51e-ced5-4e4f-9363-0b4774608a6f None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:00.944406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193e51e-ced5-4e4f-9363-0b4774608a6f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:00.944406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193e51e-ced5-4e4f-9363-0b4774608a6f None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:00.945805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 116/235] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:00.951486 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa5238-5b0f-4e53-9148-231a9204214e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:00.951919 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa5238-5b0f-4e53-9148-231a9204214e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:00.952089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa5238-5b0f-4e53-9148-231a9204214e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:00.979945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-0afa5238-5b0f-4e53-9148-231a9204214e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:00.981143 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0afa5238-5b0f-4e53-9148-231a9204214e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:01.073176 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 120/236] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:01.109214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193e51e-ced5-4e4f-9363-0b4774608a6f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:01.232439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193e51e-ced5-4e4f-9363-0b4774608a6f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:01.273736 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3ed4f-231c-4441-8f9f-5f4f10fa0e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:01.274559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3ed4f-231c-4441-8f9f-5f4f10fa0e23 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:01.274844 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3ed4f-231c-4441-8f9f-5f4f10fa0e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:01.275178 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3ed4f-231c-4441-8f9f-5f4f10fa0e23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:01.285830 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3ed4f-231c-4441-8f9f-5f4f10fa0e23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:01.294374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5ef3ed4f-231c-4441-8f9f-5f4f10fa0e23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:31:01.294374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:01.294374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:01.294374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:01.294374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:01.294374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:01.294374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:01.294374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:01.294374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:01.294374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:01.294374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:01.294374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:01.294374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:01.294374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:01.294374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:01.294374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:01.295253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:01.295253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:01.295253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:01.295253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:01.295253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:01.295253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:01.295253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:01.295253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:01.295253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:01.295253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:01.295253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:01.295253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:01.295253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:01.295253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:01.295253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:01.295253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:01.296097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:01.296097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:01.296097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:01.296097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:01.296097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:01.296097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:01.296097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:01.296097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:01.296097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:01.296097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:01.296097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:31:01.296097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:01.300018 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 117/237] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:31:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:01.302988 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa5238-5b0f-4e53-9148-231a9204214e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:01.437455 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa5238-5b0f-4e53-9148-231a9204214e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:01.472418 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24278982-c574-483e-a20a-a92d36a10bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:01.473520 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24278982-c574-483e-a20a-a92d36a10bab None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:01.473520 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24278982-c574-483e-a20a-a92d36a10bab None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:01.473520 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24278982-c574-483e-a20a-a92d36a10bab None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:01.479831 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24278982-c574-483e-a20a-a92d36a10bab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:01.479831 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24278982-c574-483e-a20a-a92d36a10bab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:01.479831 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24278982-c574-483e-a20a-a92d36a10bab None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:01.489107 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 121/238] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:01.490391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3ed4f-231c-4441-8f9f-5f4f10fa0e23 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:01.617305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3ed4f-231c-4441-8f9f-5f4f10fa0e23 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:01.653899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4c004-4339-4465-9b59-dc2668c47548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:01.654869 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4c004-4339-4465-9b59-dc2668c47548 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:01.655158 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4c004-4339-4465-9b59-dc2668c47548 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:01.655430 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4c004-4339-4465-9b59-dc2668c47548 None admin] PATH_INFO: `/v3/users/fac9efcda68b47b9bce3f4a650586c64` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:01.656731 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4c004-4339-4465-9b59-dc2668c47548 None admin] RBAC: Authorizing `identity:get_user(user_id=fac9efcda68b47b9bce3f4a650586c64)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:01.658194 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4c004-4339-4465-9b59-dc2668c47548 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:01.663793 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 118/239] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:31:01 2022] GET /identity/v3/users/fac9efcda68b47b9bce3f4a650586c64 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:01.666036 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24278982-c574-483e-a20a-a92d36a10bab None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:01.767297 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24278982-c574-483e-a20a-a92d36a10bab None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:01.805743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ec559-f72b-4e77-8f54-df0e37d4d186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:01.806934 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ec559-f72b-4e77-8f54-df0e37d4d186 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:01.807214 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ec559-f72b-4e77-8f54-df0e37d4d186 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:01.807486 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ec559-f72b-4e77-8f54-df0e37d4d186 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:01.898919 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ec559-f72b-4e77-8f54-df0e37d4d186 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:01.900589 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ec559-f72b-4e77-8f54-df0e37d4d186 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:02.032751 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 122/240] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:02.038420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4c004-4339-4465-9b59-dc2668c47548 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:02.051223 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598856c1-aa61-477b-9dcf-341a4f2b60e7 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:02.051531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598856c1-aa61-477b-9dcf-341a4f2b60e7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:02.051800 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598856c1-aa61-477b-9dcf-341a4f2b60e7 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:02.057377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 123/241] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:02.058759 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2ae2d-3f44-4f1a-ba3f-8156a74f57e9 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:02.059043 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2ae2d-3f44-4f1a-ba3f-8156a74f57e9 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:02.059320 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2ae2d-3f44-4f1a-ba3f-8156a74f57e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:02.134328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d8f2ae2d-3f44-4f1a-ba3f-8156a74f57e9 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:02.135752 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d8f2ae2d-3f44-4f1a-ba3f-8156a74f57e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:02.221979 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 124/242] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:02.223485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95c56c-1085-4de2-862d-3d15140454f2 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:02.223799 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95c56c-1085-4de2-862d-3d15140454f2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:02.224073 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95c56c-1085-4de2-862d-3d15140454f2 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:02.225639 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 125/243] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:02.232382 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4c004-4339-4465-9b59-dc2668c47548 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:02.233906 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c021e-e948-415e-8a89-e8e2c0c2bc4e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:02.234396 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c021e-e948-415e-8a89-e8e2c0c2bc4e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:02.234890 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c021e-e948-415e-8a89-e8e2c0c2bc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:02.257541 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f25c021e-e948-415e-8a89-e8e2c0c2bc4e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:02.258799 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f25c021e-e948-415e-8a89-e8e2c0c2bc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:02.271636 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e9515-5eb0-4fc1-ae2a-fc237a440511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:02.272699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e9515-5eb0-4fc1-ae2a-fc237a440511 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:02.272987 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e9515-5eb0-4fc1-ae2a-fc237a440511 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:02.273652 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e9515-5eb0-4fc1-ae2a-fc237a440511 None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:02.275142 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e9515-5eb0-4fc1-ae2a-fc237a440511 None admin] RBAC: Authorizing `identity:get_project(project_id=997175288e39489ead5929a225ecbf2c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:02.277092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e9515-5eb0-4fc1-ae2a-fc237a440511 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:02.279182 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 119/244] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:02 2022] GET /identity/v3/projects/997175288e39489ead5929a225ecbf2c => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:02.280518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e9515-5eb0-4fc1-ae2a-fc237a440511 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:02.328740 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 126/245] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:02.329535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c021e-e948-415e-8a89-e8e2c0c2bc4e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:02.399552 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e9515-5eb0-4fc1-ae2a-fc237a440511 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:02.430316 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c021e-e948-415e-8a89-e8e2c0c2bc4e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:02.432624 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc273ff-cb0a-4ac1-b218-a1c645b4f43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:02.433413 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc273ff-cb0a-4ac1-b218-a1c645b4f43c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:02.433691 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc273ff-cb0a-4ac1-b218-a1c645b4f43c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:02.433959 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc273ff-cb0a-4ac1-b218-a1c645b4f43c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:02.443643 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc273ff-cb0a-4ac1-b218-a1c645b4f43c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:02.451429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-7fc273ff-cb0a-4ac1-b218-a1c645b4f43c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 06:31:02.451429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:02.451429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:02.451429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:02.451429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:02.451429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:02.451429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:02.451429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:02.451429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:02.451429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:02.451429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:02.451429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:02.451429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:02.451429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:02.451429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:02.451429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:02.452455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:02.452455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:02.452455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:02.452455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:02.452455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:02.452455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:02.452455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:02.452455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:02.452455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:02.452455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:02.452455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:02.452455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:02.452455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:02.452455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:02.452455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:02.452455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:02.453291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:02.453291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:02.453291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:02.453291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:02.453291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:02.453291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:02.453291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:02.453291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:02.453291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:02.453291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:02.453291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 06:31:02.453291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:02.453291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 120/246] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:02.453946 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb676676-db87-486d-ad2c-ee3fbfbdd234 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:02.454092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb676676-db87-486d-ad2c-ee3fbfbdd234 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:02.454366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb676676-db87-486d-ad2c-ee3fbfbdd234 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:02.455790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 121/247] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:02.460286 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb676676-db87-486d-ad2c-ee3fbfbdd234 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:02.470071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c0bd7-92b8-4be0-afe7-71d2c05a2e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:02.470884 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c0bd7-92b8-4be0-afe7-71d2c05a2e4a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:02.471015 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c0bd7-92b8-4be0-afe7-71d2c05a2e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:02.471263 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c0bd7-92b8-4be0-afe7-71d2c05a2e4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:02.472139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c0bd7-92b8-4be0-afe7-71d2c05a2e4a None admin] RBAC: Adding query filter params (role.id=5e6a73052f3b4ee7829ecb858925e5ca, scope.project.id=997175288e39489ead5929a225ecbf2c, user.id=fac9efcda68b47b9bce3f4a650586c64) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:02.472447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c0bd7-92b8-4be0-afe7-71d2c05a2e4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:02.473874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c0bd7-92b8-4be0-afe7-71d2c05a2e4a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:02.479798 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 127/248] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:31:02 2022] GET /identity/v3/role_assignments?user.id=fac9efcda68b47b9bce3f4a650586c64&scope.project.id=997175288e39489ead5929a225ecbf2c&role.id=5e6a73052f3b4ee7829ecb858925e5ca => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:02.480580 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c0bd7-92b8-4be0-afe7-71d2c05a2e4a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:02.579529 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb676676-db87-486d-ad2c-ee3fbfbdd234 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:02.590803 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c0bd7-92b8-4be0-afe7-71d2c05a2e4a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:02.614980 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749a00a-29c9-4e22-a4fa-00b9e32db905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:02.615817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749a00a-29c9-4e22-a4fa-00b9e32db905 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:02.618309 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749a00a-29c9-4e22-a4fa-00b9e32db905 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:02.618309 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749a00a-29c9-4e22-a4fa-00b9e32db905 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:02.618309 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749a00a-29c9-4e22-a4fa-00b9e32db905 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:02.619244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749a00a-29c9-4e22-a4fa-00b9e32db905 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:02.621173 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 122/249] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:02.625328 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95542ffa-1e60-4426-82e3-4b5536cf6967 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:02.626007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95542ffa-1e60-4426-82e3-4b5536cf6967 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:02.626439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95542ffa-1e60-4426-82e3-4b5536cf6967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:02.627824 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcb4d3-792c-4f2a-b0ae-69b04806e8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:02.628678 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcb4d3-792c-4f2a-b0ae-69b04806e8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:02.628967 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcb4d3-792c-4f2a-b0ae-69b04806e8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:02.629247 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcb4d3-792c-4f2a-b0ae-69b04806e8b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:02.630047 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcb4d3-792c-4f2a-b0ae-69b04806e8b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:02.630358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcb4d3-792c-4f2a-b0ae-69b04806e8b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:02.631809 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcb4d3-792c-4f2a-b0ae-69b04806e8b3 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:02.645978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 128/250] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:31:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:02.645978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb47dc-35b6-44bf-b4e9-05c26a742bd4 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:02.645978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb47dc-35b6-44bf-b4e9-05c26a742bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:02.645978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb47dc-35b6-44bf-b4e9-05c26a742bd4 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:02.645978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 129/251] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:02.645978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb47dc-35b6-44bf-b4e9-05c26a742bd4 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:02.653508 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-95542ffa-1e60-4426-82e3-4b5536cf6967 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:02.653508 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-95542ffa-1e60-4426-82e3-4b5536cf6967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:02.726688 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 123/252] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:02.727553 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95542ffa-1e60-4426-82e3-4b5536cf6967 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:02.758217 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb47dc-35b6-44bf-b4e9-05c26a742bd4 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:02.789875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10ab09-7472-457a-9305-a0fe17f43c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:02.791336 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10ab09-7472-457a-9305-a0fe17f43c6e None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:02.791614 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10ab09-7472-457a-9305-a0fe17f43c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:02.791912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10ab09-7472-457a-9305-a0fe17f43c6e None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:02.792625 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10ab09-7472-457a-9305-a0fe17f43c6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:02.794052 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10ab09-7472-457a-9305-a0fe17f43c6e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:02.832126 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95542ffa-1e60-4426-82e3-4b5536cf6967 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:02.863699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3d9f2-76be-4004-837f-376b8f48deb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:02.864567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3d9f2-76be-4004-837f-376b8f48deb3 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:02.864839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3d9f2-76be-4004-837f-376b8f48deb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:02.865106 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3d9f2-76be-4004-837f-376b8f48deb3 None admin] PATH_INFO: `/v3/users/2ec6ad903d5642ee9a7f4b75aea27b13` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:02.878023 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3d9f2-76be-4004-837f-376b8f48deb3 None admin] RBAC: Authorizing `identity:get_user(user_id=2ec6ad903d5642ee9a7f4b75aea27b13)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:02.881264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3d9f2-76be-4004-837f-376b8f48deb3 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:02.881264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 124/253] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:31:02 2022] GET /identity/v3/users/2ec6ad903d5642ee9a7f4b75aea27b13 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:02.882209 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feafcf1-d561-40d6-a7a8-8b172c75ae0a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:02.882491 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feafcf1-d561-40d6-a7a8-8b172c75ae0a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:02.882763 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feafcf1-d561-40d6-a7a8-8b172c75ae0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:02.897678 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0feafcf1-d561-40d6-a7a8-8b172c75ae0a None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:02.898836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0feafcf1-d561-40d6-a7a8-8b172c75ae0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:02.902039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 130/254] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 12 06:31:02 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:31:02.905069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10ab09-7472-457a-9305-a0fe17f43c6e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:02.981107 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 125/255] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:02.982465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feafcf1-d561-40d6-a7a8-8b172c75ae0a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:03.019017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10ab09-7472-457a-9305-a0fe17f43c6e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:03.054256 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441f4d1-8f9c-4894-8d5e-312cfeb5c9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:03.055076 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441f4d1-8f9c-4894-8d5e-312cfeb5c9ef None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:03.055420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441f4d1-8f9c-4894-8d5e-312cfeb5c9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:03.055709 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441f4d1-8f9c-4894-8d5e-312cfeb5c9ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:03.066672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441f4d1-8f9c-4894-8d5e-312cfeb5c9ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:03.075005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-f441f4d1-8f9c-4894-8d5e-312cfeb5c9ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:31:03.075005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:03.075005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:03.075005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:03.075005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:03.075005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:03.075005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:03.075005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:03.075005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:03.075005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:03.075005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:03.075005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:03.075005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:03.075005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:03.075005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:03.075005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:03.076037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:03.076037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:03.076037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:03.076037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:03.076037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:03.076037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:03.076037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:03.076037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:03.076037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:03.076037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:03.076037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:03.076037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:03.076037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:03.076037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:03.076037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:03.076037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:03.082611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:03.082611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:03.082611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:03.082611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:03.082611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:03.082611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:03.082611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:03.082611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:03.082611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:03.082611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:03.082611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:31:03.082611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:03.082611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 131/256] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:31:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:03.082611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441f4d1-8f9c-4894-8d5e-312cfeb5c9ef None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:03.103406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feafcf1-d561-40d6-a7a8-8b172c75ae0a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:03.138142 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de17e96-c65c-48dd-aea8-8bf0843d2d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:03.138791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de17e96-c65c-48dd-aea8-8bf0843d2d7d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:03.139063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de17e96-c65c-48dd-aea8-8bf0843d2d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:03.139337 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de17e96-c65c-48dd-aea8-8bf0843d2d7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:03.209450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441f4d1-8f9c-4894-8d5e-312cfeb5c9ef None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:03.215789 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de17e96-c65c-48dd-aea8-8bf0843d2d7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:03.217363 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de17e96-c65c-48dd-aea8-8bf0843d2d7d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:03.253499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e7d29-a8fc-4dff-90e4-459f03031106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:03.254311 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e7d29-a8fc-4dff-90e4-459f03031106 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:03.254584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e7d29-a8fc-4dff-90e4-459f03031106 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:03.254859 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e7d29-a8fc-4dff-90e4-459f03031106 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:03.277345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e7d29-a8fc-4dff-90e4-459f03031106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:03.285164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-238e7d29-a8fc-4dff-90e4-459f03031106 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:03.285164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:03.285164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:03.285164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:03.285164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:03.285164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:03.285164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:03.285164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:03.285164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:03.285164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:03.285164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:03.285164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:03.285164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:03.285164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:03.285164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:03.285164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:03.286086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:03.286086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:03.286086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:03.286086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:03.286086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:03.286086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:03.286086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:03.286086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:03.286086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:03.286086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:03.286086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:03.286086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:03.286086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:03.286086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:03.286086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:03.286086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:03.286912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:03.286912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:03.286912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:03.286912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:03.286912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:03.286912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:03.286912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:03.286912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:03.286912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:03.286912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:03.286912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:03.286912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:03.291437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 132/257] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:03.292325 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e7d29-a8fc-4dff-90e4-459f03031106 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:03.340991 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 126/258] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:03.341948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de17e96-c65c-48dd-aea8-8bf0843d2d7d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:03.394328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e7d29-a8fc-4dff-90e4-459f03031106 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:03.428213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd799e41-5300-41c7-9069-88787c32d04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:03.428889 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd799e41-5300-41c7-9069-88787c32d04a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:03.429169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd799e41-5300-41c7-9069-88787c32d04a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:03.429439 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd799e41-5300-41c7-9069-88787c32d04a None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:03.430190 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd799e41-5300-41c7-9069-88787c32d04a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:03.430490 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd799e41-5300-41c7-9069-88787c32d04a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:03.431980 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd799e41-5300-41c7-9069-88787c32d04a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:03.440432 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 133/259] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:03.441155 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd799e41-5300-41c7-9069-88787c32d04a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:03.462947 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de17e96-c65c-48dd-aea8-8bf0843d2d7d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:03.506734 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b9841-e740-47b5-80bf-52a354c80b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:03.507715 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b9841-e740-47b5-80bf-52a354c80b87 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:03.508028 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b9841-e740-47b5-80bf-52a354c80b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:03.508312 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b9841-e740-47b5-80bf-52a354c80b87 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:03.509078 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b9841-e740-47b5-80bf-52a354c80b87 None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:03.509607 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b9841-e740-47b5-80bf-52a354c80b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:03.511483 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b9841-e740-47b5-80bf-52a354c80b87 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:03.522174 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 127/260] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:31:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:03.523023 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b9841-e740-47b5-80bf-52a354c80b87 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:03.552229 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd799e41-5300-41c7-9069-88787c32d04a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:03.585449 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44553fb-b913-4f9c-8578-aa1b8f184edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:03.586323 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44553fb-b913-4f9c-8578-aa1b8f184edb None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:03.586603 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44553fb-b913-4f9c-8578-aa1b8f184edb None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:03.586877 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44553fb-b913-4f9c-8578-aa1b8f184edb None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:03.588132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44553fb-b913-4f9c-8578-aa1b8f184edb None admin] RBAC: Authorizing `identity:get_project(project_id=997175288e39489ead5929a225ecbf2c)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:03.589571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44553fb-b913-4f9c-8578-aa1b8f184edb None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:03.591331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 134/261] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:03 2022] GET /identity/v3/projects/997175288e39489ead5929a225ecbf2c => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:03.592086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44553fb-b913-4f9c-8578-aa1b8f184edb None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:03.642379 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b9841-e740-47b5-80bf-52a354c80b87 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:03.684843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f9359-620b-44ac-9643-c4247c396a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:03.686001 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f9359-620b-44ac-9643-c4247c396a71 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:03.686282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f9359-620b-44ac-9643-c4247c396a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:03.686555 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f9359-620b-44ac-9643-c4247c396a71 None admin] PATH_INFO: `/v3/users/fac9efcda68b47b9bce3f4a650586c64` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:03.687775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f9359-620b-44ac-9643-c4247c396a71 None admin] RBAC: Authorizing `identity:get_user(user_id=fac9efcda68b47b9bce3f4a650586c64)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:03.689953 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f9359-620b-44ac-9643-c4247c396a71 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:03.692381 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 128/262] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:31:03 2022] GET /identity/v3/users/fac9efcda68b47b9bce3f4a650586c64 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:03.693374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f9359-620b-44ac-9643-c4247c396a71 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:03.704252 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44553fb-b913-4f9c-8578-aa1b8f184edb None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:03.737448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3553f5e-1757-44e0-9fe3-b5c96ffb3cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:03.738330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3553f5e-1757-44e0-9fe3-b5c96ffb3cbe None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:03.738674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3553f5e-1757-44e0-9fe3-b5c96ffb3cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:03.738949 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3553f5e-1757-44e0-9fe3-b5c96ffb3cbe None admin] PATH_INFO: `/v3/users/e8c01560d4044a2a813808a84f0abf95` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:03.740252 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3553f5e-1757-44e0-9fe3-b5c96ffb3cbe None admin] RBAC: Authorizing `identity:get_user(user_id=e8c01560d4044a2a813808a84f0abf95)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:03.741715 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3553f5e-1757-44e0-9fe3-b5c96ffb3cbe None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:03.744201 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 135/263] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:31:03 2022] GET /identity/v3/users/e8c01560d4044a2a813808a84f0abf95 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:03.745068 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3553f5e-1757-44e0-9fe3-b5c96ffb3cbe None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:03.820411 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f9359-620b-44ac-9643-c4247c396a71 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:03.848449 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3553f5e-1757-44e0-9fe3-b5c96ffb3cbe None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:03.861681 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae46aed-32c0-4e04-9987-c32c292435fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:03.862694 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae46aed-32c0-4e04-9987-c32c292435fd None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:03.863240 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae46aed-32c0-4e04-9987-c32c292435fd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:03.863519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae46aed-32c0-4e04-9987-c32c292435fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:03.864542 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae46aed-32c0-4e04-9987-c32c292435fd None admin] RBAC: Adding query filter params (role.id=6499c37d9f3048e1b9966d520667bd09, scope.project.id=997175288e39489ead5929a225ecbf2c, user.id=2ec6ad903d5642ee9a7f4b75aea27b13) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:03.864858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae46aed-32c0-4e04-9987-c32c292435fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:03.866618 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae46aed-32c0-4e04-9987-c32c292435fd None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:03.879806 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 129/264] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:31:03 2022] GET /identity/v3/role_assignments?user.id=2ec6ad903d5642ee9a7f4b75aea27b13&scope.project.id=997175288e39489ead5929a225ecbf2c&role.id=6499c37d9f3048e1b9966d520667bd09 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:03.880975 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae46aed-32c0-4e04-9987-c32c292435fd None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:03.893137 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516490f1-5951-4f17-abf1-506bddb25874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:03.893877 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516490f1-5951-4f17-abf1-506bddb25874 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:03.894165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516490f1-5951-4f17-abf1-506bddb25874 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:03.894436 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516490f1-5951-4f17-abf1-506bddb25874 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:03.972564 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516490f1-5951-4f17-abf1-506bddb25874 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:03.974055 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516490f1-5951-4f17-abf1-506bddb25874 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:04.094862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 136/265] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:04.111836 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516490f1-5951-4f17-abf1-506bddb25874 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:04.123861 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae46aed-32c0-4e04-9987-c32c292435fd None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:04.169597 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22186b37-a994-484c-8e77-7ee68199b539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:04.170865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22186b37-a994-484c-8e77-7ee68199b539 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:04.171350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22186b37-a994-484c-8e77-7ee68199b539 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:04.171861 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22186b37-a994-484c-8e77-7ee68199b539 None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:04.173776 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22186b37-a994-484c-8e77-7ee68199b539 None admin] RBAC: Authorizing `identity:get_project(project_id=997175288e39489ead5929a225ecbf2c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:04.176383 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22186b37-a994-484c-8e77-7ee68199b539 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:04.179774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 130/266] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:03 2022] GET /identity/v3/projects/997175288e39489ead5929a225ecbf2c => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:04.185274 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22186b37-a994-484c-8e77-7ee68199b539 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:04.219882 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516490f1-5951-4f17-abf1-506bddb25874 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:04.292075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0ceb1-03ec-45fa-9038-bd418c1e81d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:04.293049 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0ceb1-03ec-45fa-9038-bd418c1e81d7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:04.293228 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0ceb1-03ec-45fa-9038-bd418c1e81d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:04.293501 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0ceb1-03ec-45fa-9038-bd418c1e81d7 None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:04.300469 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0ceb1-03ec-45fa-9038-bd418c1e81d7 None admin] RBAC: Authorizing `identity:get_project(project_id=997175288e39489ead5929a225ecbf2c)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:04.301947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0ceb1-03ec-45fa-9038-bd418c1e81d7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:04.302427 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22186b37-a994-484c-8e77-7ee68199b539 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:04.304092 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 137/267] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:04 2022] GET /identity/v3/projects/997175288e39489ead5929a225ecbf2c => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:04.309992 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0ceb1-03ec-45fa-9038-bd418c1e81d7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:04.339731 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c2c0f-be0e-438a-a759-57ad841a274e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:04.340970 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c2c0f-be0e-438a-a759-57ad841a274e None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:04.341548 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c2c0f-be0e-438a-a759-57ad841a274e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:04.342047 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c2c0f-be0e-438a-a759-57ad841a274e None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c/users/e8c01560d4044a2a813808a84f0abf95/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:04.344482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c2c0f-be0e-438a-a759-57ad841a274e None admin] RBAC: Authorizing `identity:create_grant(project_id=997175288e39489ead5929a225ecbf2c, user_id=e8c01560d4044a2a813808a84f0abf95, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:04.346293 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c2c0f-be0e-438a-a759-57ad841a274e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:04.436300 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 131/268] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:31:04 2022] PUT /identity/v3/projects/997175288e39489ead5929a225ecbf2c/users/e8c01560d4044a2a813808a84f0abf95/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:31:04.443198 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0ceb1-03ec-45fa-9038-bd418c1e81d7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:04.480296 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b8e2d-d2c6-41f2-9aa0-484b0f06564d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:04.480980 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b8e2d-d2c6-41f2-9aa0-484b0f06564d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:04.481265 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b8e2d-d2c6-41f2-9aa0-484b0f06564d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:04.481539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b8e2d-d2c6-41f2-9aa0-484b0f06564d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:04.482473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b8e2d-d2c6-41f2-9aa0-484b0f06564d None admin] RBAC: Adding query filter params (role.id=cba01848eb624bfaaeeb1244e02e5bd7, scope.project.id=997175288e39489ead5929a225ecbf2c, user.id=fac9efcda68b47b9bce3f4a650586c64) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:04.482791 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b8e2d-d2c6-41f2-9aa0-484b0f06564d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:04.484364 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b8e2d-d2c6-41f2-9aa0-484b0f06564d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:04.491343 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 138/269] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:31:04 2022] GET /identity/v3/role_assignments?user.id=fac9efcda68b47b9bce3f4a650586c64&scope.project.id=997175288e39489ead5929a225ecbf2c&role.id=cba01848eb624bfaaeeb1244e02e5bd7 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:05.401213 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516457f-9800-44a1-a8a5-cb6b0ad3a9f0 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:05.401696 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516457f-9800-44a1-a8a5-cb6b0ad3a9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:05.401696 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516457f-9800-44a1-a8a5-cb6b0ad3a9f0 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:05.403403 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 132/270] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:05.408676 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129edd39-7749-47e6-8d64-cae06dc289a7 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:05.409102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129edd39-7749-47e6-8d64-cae06dc289a7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:05.409272 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129edd39-7749-47e6-8d64-cae06dc289a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:05.418504 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8418f3-69d6-4d55-843e-2ee0c203e73b None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:05.419078 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8418f3-69d6-4d55-843e-2ee0c203e73b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:05.419544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8418f3-69d6-4d55-843e-2ee0c203e73b None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:05.421383 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 133/271] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:31:05.426475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764b2a4-fa46-4cbe-8e67-387cf7057cae None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:05.426987 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764b2a4-fa46-4cbe-8e67-387cf7057cae None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:05.427386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-129edd39-7749-47e6-8d64-cae06dc289a7 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:05.427670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764b2a4-fa46-4cbe-8e67-387cf7057cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:05.428606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-129edd39-7749-47e6-8d64-cae06dc289a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:05.444660 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a764b2a4-fa46-4cbe-8e67-387cf7057cae None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:05.446138 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a764b2a4-fa46-4cbe-8e67-387cf7057cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:05.495638 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 139/272] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:05.513451 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 134/273] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:31:05.519802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129edd39-7749-47e6-8d64-cae06dc289a7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:05.538545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764b2a4-fa46-4cbe-8e67-387cf7057cae None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:05.617077 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129edd39-7749-47e6-8d64-cae06dc289a7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:05.644093 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764b2a4-fa46-4cbe-8e67-387cf7057cae None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:05.650191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abb695-5374-4f0b-8a61-c8e19aa1f1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:05.650986 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abb695-5374-4f0b-8a61-c8e19aa1f1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:05.651315 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abb695-5374-4f0b-8a61-c8e19aa1f1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:05.651535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abb695-5374-4f0b-8a61-c8e19aa1f1c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:05.661658 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abb695-5374-4f0b-8a61-c8e19aa1f1c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:05.670440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-70abb695-5374-4f0b-8a61-c8e19aa1f1c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:05.670440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:05.670440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:05.670440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:05.670440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:05.670440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:05.670440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:05.670440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:05.670440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:05.670440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:05.670440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:05.670440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:05.670440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:05.670440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:05.670440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:05.670440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:05.671330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:05.671330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:05.671330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:05.671330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:05.671330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:05.671330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:05.671330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:05.671330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:05.671330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:05.671330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:05.671330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:05.671330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:05.671330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:05.671330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:05.671330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:05.671330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:05.672158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:05.672158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:05.672158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:05.672158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:05.672158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:05.672158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:05.672158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:05.672158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:05.672158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:05.672158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:05.672158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:05.672158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:05.676377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 140/274] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:05.677554 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abb695-5374-4f0b-8a61-c8e19aa1f1c4 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:05.683633 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608045e8-6279-432c-bc46-dbcfda6f88c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:05.684717 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608045e8-6279-432c-bc46-dbcfda6f88c2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:05.685214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608045e8-6279-432c-bc46-dbcfda6f88c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:05.685675 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608045e8-6279-432c-bc46-dbcfda6f88c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:05.687067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608045e8-6279-432c-bc46-dbcfda6f88c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:05.688813 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608045e8-6279-432c-bc46-dbcfda6f88c2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:05.695257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 135/275] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:05.696361 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608045e8-6279-432c-bc46-dbcfda6f88c2 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:05.779463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abb695-5374-4f0b-8a61-c8e19aa1f1c4 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:05.799250 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608045e8-6279-432c-bc46-dbcfda6f88c2 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:05.813245 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478e689-53f3-4ff2-a321-6f648baee84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:05.814148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478e689-53f3-4ff2-a321-6f648baee84f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:05.814257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478e689-53f3-4ff2-a321-6f648baee84f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:05.814450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478e689-53f3-4ff2-a321-6f648baee84f None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:05.815263 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478e689-53f3-4ff2-a321-6f648baee84f None admin] RBAC: Adding query filter params (name=member) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:05.815617 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478e689-53f3-4ff2-a321-6f648baee84f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:05.816966 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478e689-53f3-4ff2-a321-6f648baee84f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:05.825855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 141/276] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:31:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:05.831412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478e689-53f3-4ff2-a321-6f648baee84f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:05.836598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4840f-2a99-4cbe-b1f0-f35246ec1bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:05.837591 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4840f-2a99-4cbe-b1f0-f35246ec1bb2 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:05.838152 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4840f-2a99-4cbe-b1f0-f35246ec1bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:05.838616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4840f-2a99-4cbe-b1f0-f35246ec1bb2 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:05.839523 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4840f-2a99-4cbe-b1f0-f35246ec1bb2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:05.841162 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4840f-2a99-4cbe-b1f0-f35246ec1bb2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:05.927416 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478e689-53f3-4ff2-a321-6f648baee84f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:05.963335 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf31e94-ed70-4f22-ab92-298dd2e547fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:05.964378 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf31e94-ed70-4f22-ab92-298dd2e547fa None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:05.964659 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf31e94-ed70-4f22-ab92-298dd2e547fa None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:05.964951 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf31e94-ed70-4f22-ab92-298dd2e547fa None admin] PATH_INFO: `/v3/users/6f67f2fc8181466683201c60fb636f1d` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:05.973412 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 136/277] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 12 06:31:05 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:31:05.989371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf31e94-ed70-4f22-ab92-298dd2e547fa None admin] RBAC: Authorizing `identity:get_user(user_id=6f67f2fc8181466683201c60fb636f1d)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:05.989371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf31e94-ed70-4f22-ab92-298dd2e547fa None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:05.995490 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 142/278] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:31:05 2022] GET /identity/v3/users/6f67f2fc8181466683201c60fb636f1d => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:05.996923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4840f-2a99-4cbe-b1f0-f35246ec1bb2 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:06.126986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4840f-2a99-4cbe-b1f0-f35246ec1bb2 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:06.167987 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bde864-a207-4ccd-b66c-8fb00483abab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:06.169027 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bde864-a207-4ccd-b66c-8fb00483abab None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:06.169525 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bde864-a207-4ccd-b66c-8fb00483abab None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:06.170010 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bde864-a207-4ccd-b66c-8fb00483abab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:06.171076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bde864-a207-4ccd-b66c-8fb00483abab None admin] RBAC: Adding query filter params (role.id=2162d563a5344c26821a7961cb75468b, user.id=6f67f2fc8181466683201c60fb636f1d, scope.system=all) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:06.171591 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bde864-a207-4ccd-b66c-8fb00483abab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:06.173407 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bde864-a207-4ccd-b66c-8fb00483abab None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:06.180060 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 137/279] 10.222.0.25 () {56 vars in 1308 bytes} [Thu May 12 06:31:05 2022] GET /identity/v3/role_assignments?user.id=6f67f2fc8181466683201c60fb636f1d&scope.system=all&role.id=2162d563a5344c26821a7961cb75468b => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:06.381294 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d9924-4056-4d6f-ba83-1886f1f83e2e None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:06.381672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d9924-4056-4d6f-ba83-1886f1f83e2e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:06.381845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d9924-4056-4d6f-ba83-1886f1f83e2e None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:06.383365 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 143/280] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:06.390041 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8ba77-7919-4dff-b755-5cac7ca7a226 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:06.390588 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8ba77-7919-4dff-b755-5cac7ca7a226 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:06.391057 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8ba77-7919-4dff-b755-5cac7ca7a226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:06.410478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e7f8ba77-7919-4dff-b755-5cac7ca7a226 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:06.412430 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e7f8ba77-7919-4dff-b755-5cac7ca7a226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:06.484484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 138/281] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:06.506776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d9924-4056-4d6f-ba83-1886f1f83e2e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:06.632020 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d9924-4056-4d6f-ba83-1886f1f83e2e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:06.677552 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac60bd-55b9-4ecf-bb42-b43c5f686a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:06.678349 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac60bd-55b9-4ecf-bb42-b43c5f686a77 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:06.678626 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac60bd-55b9-4ecf-bb42-b43c5f686a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:06.678894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac60bd-55b9-4ecf-bb42-b43c5f686a77 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:06.695351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac60bd-55b9-4ecf-bb42-b43c5f686a77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:06.708507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-7aac60bd-55b9-4ecf-bb42-b43c5f686a77 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 06:31:06.708507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:06.708507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:06.708507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:06.708507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:06.708507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:06.708507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:06.708507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:06.708507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:06.708507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:06.708507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:06.708507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:06.708507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:06.708507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:06.708507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:06.708507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:06.709487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:06.709487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:06.709487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:06.709487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:06.709487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:06.709487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:06.709487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:06.709487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:06.709487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:06.709487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:06.709487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:06.709487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:06.709487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:06.709487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:06.709487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:06.709487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:06.710301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:06.710301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:06.710301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:06.710301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:06.710301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:06.710301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:06.710301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:06.710301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:06.710301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:06.710301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:06.710301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 06:31:06.710301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:06.710301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 144/282] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:06.718542 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8ba77-7919-4dff-b755-5cac7ca7a226 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:06.845785 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8ba77-7919-4dff-b755-5cac7ca7a226 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:06.882194 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff99324-8cdc-42fa-a486-8a5ea76eb13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:06.883306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff99324-8cdc-42fa-a486-8a5ea76eb13e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:06.883840 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff99324-8cdc-42fa-a486-8a5ea76eb13e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:06.884372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff99324-8cdc-42fa-a486-8a5ea76eb13e None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:06.885404 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff99324-8cdc-42fa-a486-8a5ea76eb13e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:06.885902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff99324-8cdc-42fa-a486-8a5ea76eb13e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:06.887472 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff99324-8cdc-42fa-a486-8a5ea76eb13e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:06.892072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529abd42-1371-4cb6-9f89-f33357da997e None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:06.892362 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529abd42-1371-4cb6-9f89-f33357da997e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:06.892640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529abd42-1371-4cb6-9f89-f33357da997e None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:06.895213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 145/283] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:06.897522 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 139/284] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:31:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:06.901878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57322f8e-c95d-4ff6-8f6f-f1fa59e78110 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:06.901878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57322f8e-c95d-4ff6-8f6f-f1fa59e78110 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:06.901878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57322f8e-c95d-4ff6-8f6f-f1fa59e78110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:06.903526 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff99324-8cdc-42fa-a486-8a5ea76eb13e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:06.923713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-57322f8e-c95d-4ff6-8f6f-f1fa59e78110 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:06.923713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-57322f8e-c95d-4ff6-8f6f-f1fa59e78110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:07.022110 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 146/285] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:07.058136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57322f8e-c95d-4ff6-8f6f-f1fa59e78110 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:07.081732 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff99324-8cdc-42fa-a486-8a5ea76eb13e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:07.151766 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541b687-5f86-4d8f-a2e4-9c66803a4d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:07.152564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541b687-5f86-4d8f-a2e4-9c66803a4d1e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:07.152850 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541b687-5f86-4d8f-a2e4-9c66803a4d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:07.153122 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541b687-5f86-4d8f-a2e4-9c66803a4d1e None admin] PATH_INFO: `/v3/users/2ec6ad903d5642ee9a7f4b75aea27b13` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:07.155593 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541b687-5f86-4d8f-a2e4-9c66803a4d1e None admin] RBAC: Authorizing `identity:get_user(user_id=2ec6ad903d5642ee9a7f4b75aea27b13)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:07.157761 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541b687-5f86-4d8f-a2e4-9c66803a4d1e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:07.160565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 140/286] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:31:06 2022] GET /identity/v3/users/2ec6ad903d5642ee9a7f4b75aea27b13 => generated 297 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:07.164941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541b687-5f86-4d8f-a2e4-9c66803a4d1e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:07.226971 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57322f8e-c95d-4ff6-8f6f-f1fa59e78110 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:07.302084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d99994-e07c-458a-a25e-39c4bee2a4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:07.302934 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d99994-e07c-458a-a25e-39c4bee2a4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:07.303893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d99994-e07c-458a-a25e-39c4bee2a4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:07.303893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d99994-e07c-458a-a25e-39c4bee2a4b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:07.320148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d99994-e07c-458a-a25e-39c4bee2a4b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:07.328545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-37d99994-e07c-458a-a25e-39c4bee2a4b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:07.328545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:07.328545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:07.328545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:07.328545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:07.328545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:07.328545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:07.328545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:07.328545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:07.328545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:07.328545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:07.328545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:07.328545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:07.328545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:07.328545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:07.328545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:07.329420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:07.329420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:07.329420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:07.329420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:07.329420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:07.329420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:07.329420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:07.329420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:07.329420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:07.329420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:07.329420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:07.329420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:07.329420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:07.329420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:07.329420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:07.329420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:07.330239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:07.330239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:07.330239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:07.330239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:07.330239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:07.330239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:07.330239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:07.330239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:07.330239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:07.330239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:07.330239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:07.330239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:07.330239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 147/287] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:31:07.338342 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d99994-e07c-458a-a25e-39c4bee2a4b9 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:07.356392 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541b687-5f86-4d8f-a2e4-9c66803a4d1e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:07.414609 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae3344-9467-4eea-b4a9-53c6085c163f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:07.416185 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae3344-9467-4eea-b4a9-53c6085c163f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:07.416467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae3344-9467-4eea-b4a9-53c6085c163f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:07.416735 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae3344-9467-4eea-b4a9-53c6085c163f None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:07.418621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae3344-9467-4eea-b4a9-53c6085c163f None admin] RBAC: Authorizing `identity:get_project(project_id=997175288e39489ead5929a225ecbf2c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:07.420101 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae3344-9467-4eea-b4a9-53c6085c163f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:07.421973 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 141/288] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:07 2022] GET /identity/v3/projects/997175288e39489ead5929a225ecbf2c => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:07.427927 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae3344-9467-4eea-b4a9-53c6085c163f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:07.513135 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d99994-e07c-458a-a25e-39c4bee2a4b9 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:07.560720 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d44bd-930c-4f11-b338-0974d8ef497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:07.561403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d44bd-930c-4f11-b338-0974d8ef497e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:07.561682 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d44bd-930c-4f11-b338-0974d8ef497e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:07.561955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d44bd-930c-4f11-b338-0974d8ef497e None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:07.562723 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d44bd-930c-4f11-b338-0974d8ef497e None admin] RBAC: Adding query filter params (name=member) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:07.563031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d44bd-930c-4f11-b338-0974d8ef497e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:07.564518 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d44bd-930c-4f11-b338-0974d8ef497e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:07.583250 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 148/289] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:31:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:07.589829 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d44bd-930c-4f11-b338-0974d8ef497e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:07.592154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae3344-9467-4eea-b4a9-53c6085c163f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:07.626785 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4f0bc-e076-4a70-af24-bbbb0a5bbeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:07.627671 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4f0bc-e076-4a70-af24-bbbb0a5bbeb3 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:07.627979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4f0bc-e076-4a70-af24-bbbb0a5bbeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:07.628251 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4f0bc-e076-4a70-af24-bbbb0a5bbeb3 None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c/users/2ec6ad903d5642ee9a7f4b75aea27b13/roles/6499c37d9f3048e1b9966d520667bd09` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:07.630347 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4f0bc-e076-4a70-af24-bbbb0a5bbeb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=997175288e39489ead5929a225ecbf2c, user_id=2ec6ad903d5642ee9a7f4b75aea27b13, role_id=6499c37d9f3048e1b9966d520667bd09)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:07.631909 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4f0bc-e076-4a70-af24-bbbb0a5bbeb3 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:07.725017 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 142/290] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:31:07 2022] PUT /identity/v3/projects/997175288e39489ead5929a225ecbf2c/users/2ec6ad903d5642ee9a7f4b75aea27b13/roles/6499c37d9f3048e1b9966d520667bd09 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:31:07.726546 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d44bd-930c-4f11-b338-0974d8ef497e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:07.763926 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5a5e3-8257-4639-a95b-1b69e676e1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:07.764821 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5a5e3-8257-4639-a95b-1b69e676e1bf None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:07.765105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5a5e3-8257-4639-a95b-1b69e676e1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:07.765378 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5a5e3-8257-4639-a95b-1b69e676e1bf None admin] PATH_INFO: `/v3/users/e8c01560d4044a2a813808a84f0abf95` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:07.766683 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5a5e3-8257-4639-a95b-1b69e676e1bf None admin] RBAC: Authorizing `identity:get_user(user_id=e8c01560d4044a2a813808a84f0abf95)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:07.768268 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5a5e3-8257-4639-a95b-1b69e676e1bf None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:07.769977 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 149/291] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:31:07 2022] GET /identity/v3/users/e8c01560d4044a2a813808a84f0abf95 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:07.775715 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4f0bc-e076-4a70-af24-bbbb0a5bbeb3 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:07.893163 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4f0bc-e076-4a70-af24-bbbb0a5bbeb3 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:07.936616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1ccac-7e3a-425d-bd2a-b95ac74a6c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:07.937270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1ccac-7e3a-425d-bd2a-b95ac74a6c65 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:07.937550 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1ccac-7e3a-425d-bd2a-b95ac74a6c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:07.937822 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1ccac-7e3a-425d-bd2a-b95ac74a6c65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:08.009552 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1ccac-7e3a-425d-bd2a-b95ac74a6c65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:08.011019 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1ccac-7e3a-425d-bd2a-b95ac74a6c65 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:08.108232 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 143/292] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:08.116786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5a5e3-8257-4639-a95b-1b69e676e1bf None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:08.254953 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5a5e3-8257-4639-a95b-1b69e676e1bf None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:08.288799 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4076a13-0d36-4220-94f2-5ebee1045075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:08.289672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4076a13-0d36-4220-94f2-5ebee1045075 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:08.289953 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4076a13-0d36-4220-94f2-5ebee1045075 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:08.290575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4076a13-0d36-4220-94f2-5ebee1045075 None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:08.291932 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4076a13-0d36-4220-94f2-5ebee1045075 None admin] RBAC: Authorizing `identity:get_project(project_id=997175288e39489ead5929a225ecbf2c)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:08.293379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4076a13-0d36-4220-94f2-5ebee1045075 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:08.295260 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 150/293] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:08 2022] GET /identity/v3/projects/997175288e39489ead5929a225ecbf2c => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:08.301079 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1ccac-7e3a-425d-bd2a-b95ac74a6c65 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:08.432196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1ccac-7e3a-425d-bd2a-b95ac74a6c65 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:08.484418 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345d6aa-3c36-4bdc-bf38-4cb57fcf4402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:08.485092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345d6aa-3c36-4bdc-bf38-4cb57fcf4402 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:08.485376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345d6aa-3c36-4bdc-bf38-4cb57fcf4402 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:08.485651 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345d6aa-3c36-4bdc-bf38-4cb57fcf4402 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:08.486508 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345d6aa-3c36-4bdc-bf38-4cb57fcf4402 None admin] RBAC: Adding query filter params (role.id=2162d563a5344c26821a7961cb75468b, scope.project.id=997175288e39489ead5929a225ecbf2c, user.id=e8c01560d4044a2a813808a84f0abf95) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:08.486882 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345d6aa-3c36-4bdc-bf38-4cb57fcf4402 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:08.488354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345d6aa-3c36-4bdc-bf38-4cb57fcf4402 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:08.495188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 144/294] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:31:08 2022] GET /identity/v3/role_assignments?user.id=e8c01560d4044a2a813808a84f0abf95&scope.project.id=997175288e39489ead5929a225ecbf2c&role.id=2162d563a5344c26821a7961cb75468b => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:08.759042 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49d214-0307-49c7-99ff-f89c830916be None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:08.759863 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49d214-0307-49c7-99ff-f89c830916be None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:08.759863 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49d214-0307-49c7-99ff-f89c830916be None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:08.761165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 151/295] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:08.767092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c04e7-523f-4edc-89a0-e79649cd56bd None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:08.767423 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c04e7-523f-4edc-89a0-e79649cd56bd None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:08.767637 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c04e7-523f-4edc-89a0-e79649cd56bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:08.792868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b22c04e7-523f-4edc-89a0-e79649cd56bd None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:08.794115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b22c04e7-523f-4edc-89a0-e79649cd56bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:08.854080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8414a7f-9700-4ad3-9687-dee8af061708 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:08.854415 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8414a7f-9700-4ad3-9687-dee8af061708 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:08.854629 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8414a7f-9700-4ad3-9687-dee8af061708 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:08.856105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 152/296] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:31:08.865383 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95daf4e0-15d2-4b4b-8d69-c5788846d13b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:08.865680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95daf4e0-15d2-4b4b-8d69-c5788846d13b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:08.865969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95daf4e0-15d2-4b4b-8d69-c5788846d13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:08.877868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 145/297] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:08.886583 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-95daf4e0-15d2-4b4b-8d69-c5788846d13b None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:08.887871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-95daf4e0-15d2-4b4b-8d69-c5788846d13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:08.903623 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c04e7-523f-4edc-89a0-e79649cd56bd None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:08.971798 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 153/298] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:31:08.999801 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95daf4e0-15d2-4b4b-8d69-c5788846d13b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:09.009528 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c04e7-523f-4edc-89a0-e79649cd56bd None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:09.044301 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055c85a-e667-49c8-9aef-36ba7399bbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:09.045497 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055c85a-e667-49c8-9aef-36ba7399bbb1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:09.045994 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055c85a-e667-49c8-9aef-36ba7399bbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:09.046477 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055c85a-e667-49c8-9aef-36ba7399bbb1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:09.057833 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055c85a-e667-49c8-9aef-36ba7399bbb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:09.066039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-f055c85a-e667-49c8-9aef-36ba7399bbb1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 06:31:09.066039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:09.066039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:09.066039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:09.066039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:09.066039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:09.066039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:09.066039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:09.066039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:09.066039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:09.066039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:09.066039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:09.066039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:09.066039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:09.066039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:09.066039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:09.066963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:09.066963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:09.066963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:09.066963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:09.066963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:09.066963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:09.066963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:09.066963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:09.066963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:09.066963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:09.066963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:09.066963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:09.066963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:09.066963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:09.066963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:09.066963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:09.067919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:09.067919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:09.067919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:09.067919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:09.067919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:09.067919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:09.067919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:09.067919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:09.067919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:09.067919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:09.067919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 06:31:09.067919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:09.070330 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 146/299] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:31:09.076153 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055c85a-e667-49c8-9aef-36ba7399bbb1 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:09.103138 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95daf4e0-15d2-4b4b-8d69-c5788846d13b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:09.141969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14748a-5acb-4127-87ee-0417f4c6ab7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:09.142843 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14748a-5acb-4127-87ee-0417f4c6ab7e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:09.143097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14748a-5acb-4127-87ee-0417f4c6ab7e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:09.143395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14748a-5acb-4127-87ee-0417f4c6ab7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:09.144600 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14748a-5acb-4127-87ee-0417f4c6ab7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:09.146094 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14748a-5acb-4127-87ee-0417f4c6ab7e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:09.152582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 154/300] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:09.153842 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdf75b-1f1a-46ab-a562-884c11410a6f None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:09.154130 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdf75b-1f1a-46ab-a562-884c11410a6f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:09.154405 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdf75b-1f1a-46ab-a562-884c11410a6f None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:09.159556 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 155/301] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:09.159556 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdf75b-1f1a-46ab-a562-884c11410a6f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:09.183188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055c85a-e667-49c8-9aef-36ba7399bbb1 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:09.216045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13fdf7-d968-4941-8caa-f55784f94563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:09.216708 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13fdf7-d968-4941-8caa-f55784f94563 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:09.216989 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13fdf7-d968-4941-8caa-f55784f94563 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:09.217266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13fdf7-d968-4941-8caa-f55784f94563 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:09.218013 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13fdf7-d968-4941-8caa-f55784f94563 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:09.218318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13fdf7-d968-4941-8caa-f55784f94563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:09.219717 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13fdf7-d968-4941-8caa-f55784f94563 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:09.231787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 147/302] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:31:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:09.231787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a931df-0ae1-4997-8272-fd0fd75e5e71 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:09.231787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a931df-0ae1-4997-8272-fd0fd75e5e71 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:09.231787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a931df-0ae1-4997-8272-fd0fd75e5e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:09.245370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-37a931df-0ae1-4997-8272-fd0fd75e5e71 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:09.246545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-37a931df-0ae1-4997-8272-fd0fd75e5e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:09.263825 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdf75b-1f1a-46ab-a562-884c11410a6f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:09.299362 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18cffb-742d-4f9b-9335-d148e032d409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:09.300076 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18cffb-742d-4f9b-9335-d148e032d409 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:09.300359 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18cffb-742d-4f9b-9335-d148e032d409 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:09.300632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18cffb-742d-4f9b-9335-d148e032d409 None admin] PATH_INFO: `/v3/groups` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:09.301329 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18cffb-742d-4f9b-9335-d148e032d409 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:09.302758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18cffb-742d-4f9b-9335-d148e032d409 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:09.312399 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 148/303] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:09.313570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a931df-0ae1-4997-8272-fd0fd75e5e71 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:09.387936 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 156/304] 10.222.0.25 () {60 vars in 1134 bytes} [Thu May 12 06:31:09 2022] POST /identity/v3/groups => generated 229 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:31:09.389179 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18cffb-742d-4f9b-9335-d148e032d409 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:09.424935 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a931df-0ae1-4997-8272-fd0fd75e5e71 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:09.462981 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50124eb9-e0f3-44cf-a96f-4a8c1f66d2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:09.464682 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50124eb9-e0f3-44cf-a96f-4a8c1f66d2fd None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:09.465158 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50124eb9-e0f3-44cf-a96f-4a8c1f66d2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:09.465627 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50124eb9-e0f3-44cf-a96f-4a8c1f66d2fd None admin] PATH_INFO: `/v3/users/cc6bb76147a8402a9f71596f9904d766` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:09.481228 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50124eb9-e0f3-44cf-a96f-4a8c1f66d2fd None admin] RBAC: Authorizing `identity:get_user(user_id=cc6bb76147a8402a9f71596f9904d766)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:09.483033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50124eb9-e0f3-44cf-a96f-4a8c1f66d2fd None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:09.485033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 149/305] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:31:09 2022] GET /identity/v3/users/cc6bb76147a8402a9f71596f9904d766 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:09.491297 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50124eb9-e0f3-44cf-a96f-4a8c1f66d2fd None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:09.510442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18cffb-742d-4f9b-9335-d148e032d409 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:09.549831 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61254e51-9edd-404b-8b36-58ec9eaa50f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:09.551034 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61254e51-9edd-404b-8b36-58ec9eaa50f4 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:09.551531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61254e51-9edd-404b-8b36-58ec9eaa50f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:09.552027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61254e51-9edd-404b-8b36-58ec9eaa50f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:09.563960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61254e51-9edd-404b-8b36-58ec9eaa50f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:09.574773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-61254e51-9edd-404b-8b36-58ec9eaa50f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:09.574773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:09.574773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:09.574773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:09.574773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:09.574773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:09.574773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:09.574773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:09.574773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:09.574773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:09.574773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:09.574773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:09.574773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:09.574773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:09.574773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:09.574773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:09.575743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:09.575743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:09.575743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:09.575743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:09.575743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:09.575743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:09.575743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:09.575743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:09.575743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:09.575743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:09.575743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:09.575743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:09.575743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:09.575743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:09.575743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:09.575743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:09.576572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:09.576572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:09.576572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:09.576572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:09.576572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:09.576572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:09.576572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:09.576572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:09.576572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:09.576572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:09.576572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:09.576572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:09.579164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 157/306] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:09.584755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61254e51-9edd-404b-8b36-58ec9eaa50f4 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:09.614044 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50124eb9-e0f3-44cf-a96f-4a8c1f66d2fd None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:09.648063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1183a3d-2543-4bbf-8772-73ea53809d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:09.648725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1183a3d-2543-4bbf-8772-73ea53809d48 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:09.649006 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1183a3d-2543-4bbf-8772-73ea53809d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:09.649281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1183a3d-2543-4bbf-8772-73ea53809d48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:09.650224 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1183a3d-2543-4bbf-8772-73ea53809d48 None admin] RBAC: Adding query filter params (role.id=6499c37d9f3048e1b9966d520667bd09, user.id=cc6bb76147a8402a9f71596f9904d766, scope.system=all) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:09.650857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1183a3d-2543-4bbf-8772-73ea53809d48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:09.651992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1183a3d-2543-4bbf-8772-73ea53809d48 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:09.662389 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 150/307] 10.222.0.25 () {56 vars in 1308 bytes} [Thu May 12 06:31:09 2022] GET /identity/v3/role_assignments?user.id=cc6bb76147a8402a9f71596f9904d766&scope.system=all&role.id=6499c37d9f3048e1b9966d520667bd09 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:09.695627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61254e51-9edd-404b-8b36-58ec9eaa50f4 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:09.733274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd92376-22c7-4a77-b646-463b12ead9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:09.733958 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd92376-22c7-4a77-b646-463b12ead9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:09.734240 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd92376-22c7-4a77-b646-463b12ead9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:09.734511 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd92376-22c7-4a77-b646-463b12ead9c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:09.735281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd92376-22c7-4a77-b646-463b12ead9c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:09.735585 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd92376-22c7-4a77-b646-463b12ead9c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:09.737019 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd92376-22c7-4a77-b646-463b12ead9c7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:09.747323 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 158/308] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:31:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:09.753049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1183a3d-2543-4bbf-8772-73ea53809d48 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:09.861820 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1183a3d-2543-4bbf-8772-73ea53809d48 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:09.895545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a0b03-b7d5-4721-9e86-e06416703cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:09.896443 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a0b03-b7d5-4721-9e86-e06416703cac None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:09.896723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a0b03-b7d5-4721-9e86-e06416703cac None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:09.896996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a0b03-b7d5-4721-9e86-e06416703cac None admin] PATH_INFO: `/v3/users/6f67f2fc8181466683201c60fb636f1d` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:09.898215 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a0b03-b7d5-4721-9e86-e06416703cac None admin] RBAC: Authorizing `identity:get_user(user_id=6f67f2fc8181466683201c60fb636f1d)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:09.900236 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a0b03-b7d5-4721-9e86-e06416703cac None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:09.902110 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 151/309] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:31:09 2022] GET /identity/v3/users/6f67f2fc8181466683201c60fb636f1d => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:09.907442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd92376-22c7-4a77-b646-463b12ead9c7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:10.013201 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd92376-22c7-4a77-b646-463b12ead9c7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:10.047015 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d39fe-4427-491d-9edd-82ee242b90d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:10.047930 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d39fe-4427-491d-9edd-82ee242b90d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:10.048213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d39fe-4427-491d-9edd-82ee242b90d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:10.048484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d39fe-4427-491d-9edd-82ee242b90d3 None admin] PATH_INFO: `/v3/system/users/6f67f2fc8181466683201c60fb636f1d/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:10.050025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d39fe-4427-491d-9edd-82ee242b90d3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6f67f2fc8181466683201c60fb636f1d, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:10.051423 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d39fe-4427-491d-9edd-82ee242b90d3 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:10.137248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 159/310] 10.222.0.25 () {58 vars in 1334 bytes} [Thu May 12 06:31:09 2022] PUT /identity/v3/system/users/6f67f2fc8181466683201c60fb636f1d/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:31:10.406465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61889733-2b49-4018-b5d7-aefdea9789dc None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:10.406817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61889733-2b49-4018-b5d7-aefdea9789dc None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:10.407001 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61889733-2b49-4018-b5d7-aefdea9789dc None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:10.408669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 152/311] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:10.415824 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9351e46-e5d8-452b-a7f4-cae6760f9414 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:10.415824 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9351e46-e5d8-452b-a7f4-cae6760f9414 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:10.415824 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9351e46-e5d8-452b-a7f4-cae6760f9414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:10.432356 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-c9351e46-e5d8-452b-a7f4-cae6760f9414 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:10.433871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c9351e46-e5d8-452b-a7f4-cae6760f9414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:10.499105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 160/312] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:10.522478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61889733-2b49-4018-b5d7-aefdea9789dc None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:10.627489 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61889733-2b49-4018-b5d7-aefdea9789dc None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:10.661478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f2740-419f-49d6-a339-2a9cc964acbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:10.662504 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f2740-419f-49d6-a339-2a9cc964acbc None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:10.662979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f2740-419f-49d6-a339-2a9cc964acbc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:10.663393 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f2740-419f-49d6-a339-2a9cc964acbc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:10.674093 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f2740-419f-49d6-a339-2a9cc964acbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:10.682519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-8e3f2740-419f-49d6-a339-2a9cc964acbc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 06:31:10.682519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:10.682519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:10.682519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:10.682519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:10.682519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:10.682519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:10.682519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:10.682519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:10.682519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:10.682519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:10.682519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:10.682519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:10.682519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:10.682519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:10.682519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:10.683586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:10.683586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:10.683586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:10.683586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:10.683586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:10.683586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:10.683586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:10.683586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:10.683586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:10.683586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:10.683586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:10.683586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:10.683586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:10.683586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:10.683586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:10.683586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:10.684680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:10.684680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:10.684680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:10.684680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:10.684680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:10.684680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:10.684680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:10.684680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:10.684680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:10.684680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:10.684680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 06:31:10.684680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:10.691470 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 153/313] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:10.693036 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9351e46-e5d8-452b-a7f4-cae6760f9414 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:10.796214 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9351e46-e5d8-452b-a7f4-cae6760f9414 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:10.833264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84e2fc-14a8-4e85-97bb-e8197a3b2f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:10.833943 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84e2fc-14a8-4e85-97bb-e8197a3b2f21 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:10.834226 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84e2fc-14a8-4e85-97bb-e8197a3b2f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:10.834500 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84e2fc-14a8-4e85-97bb-e8197a3b2f21 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:10.835256 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84e2fc-14a8-4e85-97bb-e8197a3b2f21 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:10.835562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84e2fc-14a8-4e85-97bb-e8197a3b2f21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:10.837518 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84e2fc-14a8-4e85-97bb-e8197a3b2f21 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:10.846287 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 161/314] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:31:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:10.851789 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f2740-419f-49d6-a339-2a9cc964acbc None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:10.952199 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f2740-419f-49d6-a339-2a9cc964acbc None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:10.997129 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34d1b9-0f3a-4d9d-aaf7-57776141b248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:10.998259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34d1b9-0f3a-4d9d-aaf7-57776141b248 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:10.998732 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34d1b9-0f3a-4d9d-aaf7-57776141b248 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:10.999194 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34d1b9-0f3a-4d9d-aaf7-57776141b248 None admin] PATH_INFO: `/v3/users/2ec6ad903d5642ee9a7f4b75aea27b13` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:11.000645 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34d1b9-0f3a-4d9d-aaf7-57776141b248 None admin] RBAC: Authorizing `identity:get_user(user_id=2ec6ad903d5642ee9a7f4b75aea27b13)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:11.002300 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34d1b9-0f3a-4d9d-aaf7-57776141b248 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:11.008595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 154/315] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:31:10 2022] GET /identity/v3/users/2ec6ad903d5642ee9a7f4b75aea27b13 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:11.012775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84e2fc-14a8-4e85-97bb-e8197a3b2f21 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:11.111990 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84e2fc-14a8-4e85-97bb-e8197a3b2f21 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:11.145084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b174f4-2b13-4eae-ae9a-4598abddf0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:11.146059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b174f4-2b13-4eae-ae9a-4598abddf0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:11.146534 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b174f4-2b13-4eae-ae9a-4598abddf0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:11.147024 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b174f4-2b13-4eae-ae9a-4598abddf0a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:11.215274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b174f4-2b13-4eae-ae9a-4598abddf0a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:11.216691 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b174f4-2b13-4eae-ae9a-4598abddf0a7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:11.318267 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 162/316] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:11.324037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34d1b9-0f3a-4d9d-aaf7-57776141b248 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:11.425146 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34d1b9-0f3a-4d9d-aaf7-57776141b248 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:11.459283 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9245c2-f1e1-47be-8f59-b91567336c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:11.460533 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9245c2-f1e1-47be-8f59-b91567336c1e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:11.461029 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9245c2-f1e1-47be-8f59-b91567336c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:11.461507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9245c2-f1e1-47be-8f59-b91567336c1e None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:11.463419 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9245c2-f1e1-47be-8f59-b91567336c1e None admin] RBAC: Authorizing `identity:get_project(project_id=997175288e39489ead5929a225ecbf2c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:11.465131 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9245c2-f1e1-47be-8f59-b91567336c1e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:11.471937 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 155/317] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:11 2022] GET /identity/v3/projects/997175288e39489ead5929a225ecbf2c => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:11.473528 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b174f4-2b13-4eae-ae9a-4598abddf0a7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:11.583204 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b174f4-2b13-4eae-ae9a-4598abddf0a7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:11.618044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58b4f8-0052-4b1b-8818-717e0d7eb9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:11.618732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58b4f8-0052-4b1b-8818-717e0d7eb9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:11.619014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58b4f8-0052-4b1b-8818-717e0d7eb9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:11.619286 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58b4f8-0052-4b1b-8818-717e0d7eb9f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:11.620166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58b4f8-0052-4b1b-8818-717e0d7eb9f9 None admin] RBAC: Adding query filter params (role.id=6499c37d9f3048e1b9966d520667bd09, scope.project.id=997175288e39489ead5929a225ecbf2c, user.id=2ec6ad903d5642ee9a7f4b75aea27b13) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:11.620478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58b4f8-0052-4b1b-8818-717e0d7eb9f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:11.621906 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58b4f8-0052-4b1b-8818-717e0d7eb9f9 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:11.628159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 163/318] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:31:11 2022] GET /identity/v3/role_assignments?user.id=2ec6ad903d5642ee9a7f4b75aea27b13&scope.project.id=997175288e39489ead5929a225ecbf2c&role.id=6499c37d9f3048e1b9966d520667bd09 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:11.708619 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b8af3-1658-42c1-8134-dc93163d4890 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:11.709148 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b8af3-1658-42c1-8134-dc93163d4890 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:11.709148 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b8af3-1658-42c1-8134-dc93163d4890 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:11.710702 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 156/319] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:11.716256 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025134b8-d4cb-4ef7-b916-34a3640cbc53 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:11.716541 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025134b8-d4cb-4ef7-b916-34a3640cbc53 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:11.716816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025134b8-d4cb-4ef7-b916-34a3640cbc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:11.735959 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-025134b8-d4cb-4ef7-b916-34a3640cbc53 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:11.737117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-025134b8-d4cb-4ef7-b916-34a3640cbc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:11.811960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 164/320] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:11.834691 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b8af3-1658-42c1-8134-dc93163d4890 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:11.939532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf2573-b632-4210-99d1-6cc5b8e94d2e None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:11.939861 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf2573-b632-4210-99d1-6cc5b8e94d2e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:11.940139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf2573-b632-4210-99d1-6cc5b8e94d2e None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:11.941708 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 165/321] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:31:11.947056 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef34f06-7a8f-41d1-bb97-fb67b31b56a4 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:11.947339 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef34f06-7a8f-41d1-bb97-fb67b31b56a4 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:11.947607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef34f06-7a8f-41d1-bb97-fb67b31b56a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:11.948090 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b8af3-1658-42c1-8134-dc93163d4890 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:11.965934 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-8ef34f06-7a8f-41d1-bb97-fb67b31b56a4 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:11.967196 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8ef34f06-7a8f-41d1-bb97-fb67b31b56a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:11.981043 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71585bd3-cc6e-4764-bc30-d7caffb144a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:11.982754 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71585bd3-cc6e-4764-bc30-d7caffb144a6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:11.982754 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71585bd3-cc6e-4764-bc30-d7caffb144a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:11.982754 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71585bd3-cc6e-4764-bc30-d7caffb144a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:11.983662 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71585bd3-cc6e-4764-bc30-d7caffb144a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:11.985125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71585bd3-cc6e-4764-bc30-d7caffb144a6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:11.991581 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 157/322] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:11.992893 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71585bd3-cc6e-4764-bc30-d7caffb144a6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:12.036746 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 166/323] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:31:12.059621 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef34f06-7a8f-41d1-bb97-fb67b31b56a4 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:12.089122 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71585bd3-cc6e-4764-bc30-d7caffb144a6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:12.123564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42484fb-baa1-4df4-b3cc-e3bd31bc8fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:12.124252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42484fb-baa1-4df4-b3cc-e3bd31bc8fdc None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:12.124538 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42484fb-baa1-4df4-b3cc-e3bd31bc8fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:12.124809 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42484fb-baa1-4df4-b3cc-e3bd31bc8fdc None admin] PATH_INFO: `/v3/groups` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:12.125499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42484fb-baa1-4df4-b3cc-e3bd31bc8fdc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:12.126928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42484fb-baa1-4df4-b3cc-e3bd31bc8fdc None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:12.153955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef34f06-7a8f-41d1-bb97-fb67b31b56a4 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:12.186656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f2224-5a2b-48c4-abc5-0b5e7d027fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:12.187443 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f2224-5a2b-48c4-abc5-0b5e7d027fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:12.187748 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f2224-5a2b-48c4-abc5-0b5e7d027fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:12.188016 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f2224-5a2b-48c4-abc5-0b5e7d027fa3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:12.198301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f2224-5a2b-48c4-abc5-0b5e7d027fa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:12.206167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-782f2224-5a2b-48c4-abc5-0b5e7d027fa3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 06:31:12.206167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:12.206167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:12.206167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:12.206167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:12.206167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:12.206167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:12.206167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:12.206167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:12.206167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:12.206167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:12.206167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:12.206167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:12.206167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:12.206167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:12.206167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:12.207058 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:12.207058 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:12.207058 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:12.207058 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:12.207058 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:12.207058 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:12.207058 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:12.207058 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:12.207058 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:12.207058 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:12.207058 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:12.207058 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:12.207058 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:12.207058 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:12.207058 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:12.207058 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:12.208321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:12.208321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:12.208321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:12.208321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:12.208321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:12.208321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:12.208321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:12.208321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:12.208321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:12.208321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:12.208321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 06:31:12.208321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:12.208321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 167/324] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:31:12.212862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 158/325] 10.222.0.25 () {60 vars in 1134 bytes} [Thu May 12 06:31:11 2022] POST /identity/v3/groups => generated 226 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:31:12.213388 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f2224-5a2b-48c4-abc5-0b5e7d027fa3 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:12.322827 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f2224-5a2b-48c4-abc5-0b5e7d027fa3 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:12.356962 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5988e4-7186-4707-b480-d5e3994fc1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:12.357658 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5988e4-7186-4707-b480-d5e3994fc1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:12.357941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5988e4-7186-4707-b480-d5e3994fc1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:12.358213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5988e4-7186-4707-b480-d5e3994fc1e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:12.358980 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5988e4-7186-4707-b480-d5e3994fc1e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:12.359286 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5988e4-7186-4707-b480-d5e3994fc1e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:12.360715 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5988e4-7186-4707-b480-d5e3994fc1e4 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:12.370522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 168/326] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:31:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:12.376281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42484fb-baa1-4df4-b3cc-e3bd31bc8fdc None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:12.468414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c5f7f-3a96-4ffb-93d2-c68d0cc33be9 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:12.468705 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c5f7f-3a96-4ffb-93d2-c68d0cc33be9 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:12.468977 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c5f7f-3a96-4ffb-93d2-c68d0cc33be9 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:12.470373 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 169/327] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:31:12.475370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42484fb-baa1-4df4-b3cc-e3bd31bc8fdc None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:12.475616 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d4b0b-d132-4d71-beca-dab0ad0249f8 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:12.476000 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d4b0b-d132-4d71-beca-dab0ad0249f8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:12.476273 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d4b0b-d132-4d71-beca-dab0ad0249f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:12.498252 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-611d4b0b-d132-4d71-beca-dab0ad0249f8 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:12.499830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-611d4b0b-d132-4d71-beca-dab0ad0249f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:12.512362 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808708c-cb85-4872-9762-ed7fc0821504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:12.513236 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808708c-cb85-4872-9762-ed7fc0821504 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:12.513517 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808708c-cb85-4872-9762-ed7fc0821504 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:12.513847 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808708c-cb85-4872-9762-ed7fc0821504 None admin] PATH_INFO: `/v3/users/cc6bb76147a8402a9f71596f9904d766` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:12.515003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808708c-cb85-4872-9762-ed7fc0821504 None admin] RBAC: Authorizing `identity:get_user(user_id=cc6bb76147a8402a9f71596f9904d766)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:12.516748 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808708c-cb85-4872-9762-ed7fc0821504 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:12.518121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 159/328] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:31:12 2022] GET /identity/v3/users/cc6bb76147a8402a9f71596f9904d766 => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:12.526353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808708c-cb85-4872-9762-ed7fc0821504 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:12.574344 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 170/329] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:31:12.597502 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d4b0b-d132-4d71-beca-dab0ad0249f8 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:12.636704 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808708c-cb85-4872-9762-ed7fc0821504 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:12.677434 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7f2df-f4c1-4ead-ad16-35d63a4e522c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:12.678309 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7f2df-f4c1-4ead-ad16-35d63a4e522c None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:12.678595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7f2df-f4c1-4ead-ad16-35d63a4e522c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:12.678869 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7f2df-f4c1-4ead-ad16-35d63a4e522c None admin] PATH_INFO: `/v3/system/users/cc6bb76147a8402a9f71596f9904d766/roles/6499c37d9f3048e1b9966d520667bd09` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:12.680585 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7f2df-f4c1-4ead-ad16-35d63a4e522c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cc6bb76147a8402a9f71596f9904d766, role_id=6499c37d9f3048e1b9966d520667bd09)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:12.681990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7f2df-f4c1-4ead-ad16-35d63a4e522c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:12.703604 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d4b0b-d132-4d71-beca-dab0ad0249f8 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:12.737744 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1271a0-4965-4a64-a1ed-233e59e3f442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:12.737973 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 160/330] 10.222.0.25 () {58 vars in 1334 bytes} [Thu May 12 06:31:12 2022] PUT /identity/v3/system/users/cc6bb76147a8402a9f71596f9904d766/roles/6499c37d9f3048e1b9966d520667bd09 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:31:12.738688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1271a0-4965-4a64-a1ed-233e59e3f442 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:12.738976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1271a0-4965-4a64-a1ed-233e59e3f442 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:12.739281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1271a0-4965-4a64-a1ed-233e59e3f442 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:12.752361 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1271a0-4965-4a64-a1ed-233e59e3f442 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:12.760816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-8f1271a0-4965-4a64-a1ed-233e59e3f442 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:12.760816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:12.760816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:12.760816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:12.760816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:12.760816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:12.760816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:12.760816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:12.760816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:12.760816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:12.760816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:12.760816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:12.760816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:12.760816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:12.760816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:12.760816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:12.761778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:12.761778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:12.761778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:12.761778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:12.761778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:12.761778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:12.761778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:12.761778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:12.761778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:12.761778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:12.761778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:12.761778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:12.761778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:12.761778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:12.761778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:12.761778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:12.762623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:12.762623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:12.762623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:12.762623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:12.762623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:12.762623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:12.762623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:12.762623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:12.762623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:12.762623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:12.762623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:12.762623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:12.762623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 171/331] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:12.768125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7f2df-f4c1-4ead-ad16-35d63a4e522c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:12.888702 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7f2df-f4c1-4ead-ad16-35d63a4e522c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:12.929451 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf8a9e-c1dd-4630-9836-81d7d4d73782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:12.930142 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf8a9e-c1dd-4630-9836-81d7d4d73782 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:12.930425 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf8a9e-c1dd-4630-9836-81d7d4d73782 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:12.931246 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf8a9e-c1dd-4630-9836-81d7d4d73782 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:12.932070 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf8a9e-c1dd-4630-9836-81d7d4d73782 None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:12.936196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf8a9e-c1dd-4630-9836-81d7d4d73782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:12.936196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf8a9e-c1dd-4630-9836-81d7d4d73782 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:12.946299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 161/332] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:31:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:12.953339 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1271a0-4965-4a64-a1ed-233e59e3f442 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:13.074213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1271a0-4965-4a64-a1ed-233e59e3f442 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:13.108692 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189cd5a-8681-464e-85ee-bf34c7a71805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:13.109566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189cd5a-8681-464e-85ee-bf34c7a71805 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:13.109843 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189cd5a-8681-464e-85ee-bf34c7a71805 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:13.110114 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189cd5a-8681-464e-85ee-bf34c7a71805 None admin] PATH_INFO: `/v3/users/6f67f2fc8181466683201c60fb636f1d` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:13.111327 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189cd5a-8681-464e-85ee-bf34c7a71805 None admin] RBAC: Authorizing `identity:get_user(user_id=6f67f2fc8181466683201c60fb636f1d)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:13.112903 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189cd5a-8681-464e-85ee-bf34c7a71805 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:13.114853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 172/333] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:31:12 2022] GET /identity/v3/users/6f67f2fc8181466683201c60fb636f1d => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:13.123084 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf8a9e-c1dd-4630-9836-81d7d4d73782 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:13.225606 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf8a9e-c1dd-4630-9836-81d7d4d73782 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:13.260081 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da37897-76c2-444f-86be-7f6f609a147e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:13.260736 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da37897-76c2-444f-86be-7f6f609a147e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:13.261020 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da37897-76c2-444f-86be-7f6f609a147e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:13.261288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da37897-76c2-444f-86be-7f6f609a147e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:13.262124 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da37897-76c2-444f-86be-7f6f609a147e None admin] RBAC: Adding query filter params (role.id=2162d563a5344c26821a7961cb75468b, user.id=6f67f2fc8181466683201c60fb636f1d, scope.system=all) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:13.262429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da37897-76c2-444f-86be-7f6f609a147e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:13.263891 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da37897-76c2-444f-86be-7f6f609a147e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:13.276385 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 162/334] 10.222.0.25 () {56 vars in 1308 bytes} [Thu May 12 06:31:13 2022] GET /identity/v3/role_assignments?user.id=6f67f2fc8181466683201c60fb636f1d&scope.system=all&role.id=2162d563a5344c26821a7961cb75468b => generated 510 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:14.906644 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bbd73-5b89-4b4c-92b3-d1ecbe9738eb None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:14.907656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bbd73-5b89-4b4c-92b3-d1ecbe9738eb None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:14.908167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bbd73-5b89-4b4c-92b3-d1ecbe9738eb None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:14.909962 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 173/335] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:14.916406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab469ff0-19e4-462e-b632-22a1a5a55431 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:14.917236 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab469ff0-19e4-462e-b632-22a1a5a55431 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:14.917705 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab469ff0-19e4-462e-b632-22a1a5a55431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:14.939747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ab469ff0-19e4-462e-b632-22a1a5a55431 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:14.941232 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ab469ff0-19e4-462e-b632-22a1a5a55431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:15.047972 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 163/336] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:15.093300 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bbd73-5b89-4b4c-92b3-d1ecbe9738eb None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:15.227949 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bbd73-5b89-4b4c-92b3-d1ecbe9738eb None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:15.271566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5a552-4f68-440b-8774-b7366be724fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:15.272450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5a552-4f68-440b-8774-b7366be724fe None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:15.272736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5a552-4f68-440b-8774-b7366be724fe None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:15.273008 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5a552-4f68-440b-8774-b7366be724fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:15.290342 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5a552-4f68-440b-8774-b7366be724fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:15.298805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-f4e5a552-4f68-440b-8774-b7366be724fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:31:15.298805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:15.298805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:15.298805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:15.298805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:15.298805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:15.298805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:15.298805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:15.298805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:15.298805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:15.298805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:15.298805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:15.298805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:15.298805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:15.298805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:15.298805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:15.299822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:15.299822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:15.299822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:15.299822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:15.299822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:15.299822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:15.299822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:15.299822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:15.299822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:15.299822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:15.299822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:15.299822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:15.299822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:15.299822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:15.299822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:15.299822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:15.300622 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:15.300622 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:15.300622 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:15.300622 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:15.300622 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:15.300622 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:15.300622 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:15.300622 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:15.300622 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:15.300622 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:15.300622 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:31:15.300622 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:15.304689 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 174/337] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:31:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:15.311165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab469ff0-19e4-462e-b632-22a1a5a55431 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:15.421899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab469ff0-19e4-462e-b632-22a1a5a55431 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:15.462927 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5f1ed-7804-40dd-912d-4f64497c9db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:15.463601 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5f1ed-7804-40dd-912d-4f64497c9db2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:15.463961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5f1ed-7804-40dd-912d-4f64497c9db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:15.464238 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5f1ed-7804-40dd-912d-4f64497c9db2 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:15.464998 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5f1ed-7804-40dd-912d-4f64497c9db2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:15.465303 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5f1ed-7804-40dd-912d-4f64497c9db2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:15.466685 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5f1ed-7804-40dd-912d-4f64497c9db2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:15.479422 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 164/338] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:15.484901 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5a552-4f68-440b-8774-b7366be724fe None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:15.496700 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d08ff-ef27-4ee4-8dfa-e858744466a4 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:15.496992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d08ff-ef27-4ee4-8dfa-e858744466a4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:15.497250 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d08ff-ef27-4ee4-8dfa-e858744466a4 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:15.498624 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 165/339] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:15.504172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcc275-efc7-46a9-bec1-1f87531c37aa None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:15.504456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcc275-efc7-46a9-bec1-1f87531c37aa None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:15.504733 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcc275-efc7-46a9-bec1-1f87531c37aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:15.537053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1bbcc275-efc7-46a9-bec1-1f87531c37aa None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:15.538261 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1bbcc275-efc7-46a9-bec1-1f87531c37aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:15.616929 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5a552-4f68-440b-8774-b7366be724fe None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:15.660739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4b9d3-ab17-4e64-9c47-354a30be4e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:15.661404 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4b9d3-ab17-4e64-9c47-354a30be4e09 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:15.661688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4b9d3-ab17-4e64-9c47-354a30be4e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:15.661964 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4b9d3-ab17-4e64-9c47-354a30be4e09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:15.682655 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 166/340] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:15.738091 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcc275-efc7-46a9-bec1-1f87531c37aa None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:15.752443 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4b9d3-ab17-4e64-9c47-354a30be4e09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:15.754677 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4b9d3-ab17-4e64-9c47-354a30be4e09 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:15.874040 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 175/341] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:15.875380 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c80dd6-cca3-454b-8323-aaa8baa113a2 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:15.875671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c80dd6-cca3-454b-8323-aaa8baa113a2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:15.880048 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c80dd6-cca3-454b-8323-aaa8baa113a2 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:15.881423 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 176/342] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:15.882705 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c80dd6-cca3-454b-8323-aaa8baa113a2 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:15.942670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcc275-efc7-46a9-bec1-1f87531c37aa None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:16.020408 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fb878-370a-4cb0-9dcf-3652026b0d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:16.021223 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fb878-370a-4cb0-9dcf-3652026b0d3e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:16.021502 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fb878-370a-4cb0-9dcf-3652026b0d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:16.021771 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fb878-370a-4cb0-9dcf-3652026b0d3e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:16.037757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fb878-370a-4cb0-9dcf-3652026b0d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:16.038696 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c80dd6-cca3-454b-8323-aaa8baa113a2 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:16.048615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-f82fb878-370a-4cb0-9dcf-3652026b0d3e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 06:31:16.048615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:16.048615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:16.048615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:16.048615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:16.048615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:16.048615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:16.048615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:16.048615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:16.048615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:16.048615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:16.048615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:16.048615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:16.048615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:16.048615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:16.048615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:16.049584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:16.049584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:16.049584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:16.049584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:16.049584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:16.049584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:16.049584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:16.049584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:16.049584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:16.049584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:16.049584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:16.049584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:16.049584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:16.049584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:16.049584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:16.049584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:16.056252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:16.056252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:16.056252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:16.056252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:16.056252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:16.056252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:16.056252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:16.056252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:16.056252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:16.056252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:16.056252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 06:31:16.056252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:16.056252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 167/343] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:31:16.056252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca3015-ab30-4146-a86c-06c2dd3c0fb8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:16.056982 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca3015-ab30-4146-a86c-06c2dd3c0fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:16.056982 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca3015-ab30-4146-a86c-06c2dd3c0fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:16.088749 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a9ca3015-ab30-4146-a86c-06c2dd3c0fb8 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:16.089934 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a9ca3015-ab30-4146-a86c-06c2dd3c0fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:16.111731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdb9b0-4fc4-4aed-8b8d-20438834c966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:16.112602 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdb9b0-4fc4-4aed-8b8d-20438834c966 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:16.112880 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdb9b0-4fc4-4aed-8b8d-20438834c966 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:16.113157 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdb9b0-4fc4-4aed-8b8d-20438834c966 None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:16.114833 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcdb9b0-4fc4-4aed-8b8d-20438834c966 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3884c9c1c84b738e43a478898c36f8)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:16.116309 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcdb9b0-4fc4-4aed-8b8d-20438834c966 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:16.122447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 177/344] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:15 2022] GET /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:16.123292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdb9b0-4fc4-4aed-8b8d-20438834c966 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:16.214040 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 168/345] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:16.214968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca3015-ab30-4146-a86c-06c2dd3c0fb8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:16.277466 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdb9b0-4fc4-4aed-8b8d-20438834c966 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:16.332319 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad094d6-21c7-470a-94bb-6384f2507153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:16.332990 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad094d6-21c7-470a-94bb-6384f2507153 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:16.333267 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad094d6-21c7-470a-94bb-6384f2507153 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:16.333535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad094d6-21c7-470a-94bb-6384f2507153 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:16.334286 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad094d6-21c7-470a-94bb-6384f2507153 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:16.334586 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad094d6-21c7-470a-94bb-6384f2507153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:16.335979 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad094d6-21c7-470a-94bb-6384f2507153 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:16.343412 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca3015-ab30-4146-a86c-06c2dd3c0fb8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:16.347920 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 178/346] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:31:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:16.349240 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfc67b-6cf1-4f45-a45c-5259998521b3 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:16.349524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfc67b-6cf1-4f45-a45c-5259998521b3 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:16.349796 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfc67b-6cf1-4f45-a45c-5259998521b3 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:16.355565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 179/347] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:16.355565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfc67b-6cf1-4f45-a45c-5259998521b3 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:16.396387 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144e26f-0d30-4513-b61a-c5ce9212b700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:16.397671 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144e26f-0d30-4513-b61a-c5ce9212b700 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:16.398860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144e26f-0d30-4513-b61a-c5ce9212b700 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:16.399333 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144e26f-0d30-4513-b61a-c5ce9212b700 None admin] PATH_INFO: `/v3/groups/a9063f187e764e92ba327b1d7e6a805e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:16.406495 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144e26f-0d30-4513-b61a-c5ce9212b700 None admin] RBAC: Authorizing `identity:get_group(group_id=a9063f187e764e92ba327b1d7e6a805e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:16.408768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144e26f-0d30-4513-b61a-c5ce9212b700 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:16.411161 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 169/348] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 12 06:31:16 2022] GET /identity/v3/groups/a9063f187e764e92ba327b1d7e6a805e => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:16.412253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144e26f-0d30-4513-b61a-c5ce9212b700 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:16.492091 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfc67b-6cf1-4f45-a45c-5259998521b3 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:16.530831 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6c2cd-1c22-49ab-9d7b-915c42aab529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:16.531713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6c2cd-1c22-49ab-9d7b-915c42aab529 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:16.532201 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6c2cd-1c22-49ab-9d7b-915c42aab529 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:16.532603 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6c2cd-1c22-49ab-9d7b-915c42aab529 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:16.544631 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144e26f-0d30-4513-b61a-c5ce9212b700 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:16.544997 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6c2cd-1c22-49ab-9d7b-915c42aab529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:16.553345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-bcb6c2cd-1c22-49ab-9d7b-915c42aab529 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:16.553345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:16.553345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:16.553345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:16.553345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:16.553345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:16.553345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:16.553345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:16.553345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:16.553345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:16.553345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:16.553345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:16.553345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:16.553345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:16.553345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:16.553345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:16.554290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:16.554290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:16.554290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:16.554290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:16.554290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:16.554290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:16.554290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:16.554290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:16.554290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:16.554290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:16.554290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:16.554290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:16.554290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:16.554290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:16.554290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:16.554290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:16.555331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:16.555331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:16.555331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:16.555331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:16.555331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:16.555331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:16.555331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:16.555331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:16.555331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:16.555331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:16.555331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:16.555331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:16.555331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 180/349] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:16.557158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f0572-4f73-423e-8b75-9180d2cd2c50 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:16.557525 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f0572-4f73-423e-8b75-9180d2cd2c50 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:16.558009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f0572-4f73-423e-8b75-9180d2cd2c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:16.576090 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-5a7f0572-4f73-423e-8b75-9180d2cd2c50 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:16.577407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5a7f0572-4f73-423e-8b75-9180d2cd2c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:16.583712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a143be-f6c6-4a68-82c9-05e0198cd4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:16.584847 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a143be-f6c6-4a68-82c9-05e0198cd4fd None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:16.585308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a143be-f6c6-4a68-82c9-05e0198cd4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:16.585784 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a143be-f6c6-4a68-82c9-05e0198cd4fd None admin] PATH_INFO: `/v3/users/cc6bb76147a8402a9f71596f9904d766` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:16.587739 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a143be-f6c6-4a68-82c9-05e0198cd4fd None admin] RBAC: Authorizing `identity:get_user(user_id=cc6bb76147a8402a9f71596f9904d766)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:16.589400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a143be-f6c6-4a68-82c9-05e0198cd4fd None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:16.591588 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 170/350] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:31:16 2022] GET /identity/v3/users/cc6bb76147a8402a9f71596f9904d766 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:16.592658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a143be-f6c6-4a68-82c9-05e0198cd4fd None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:16.650979 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 181/351] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:16.651778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f0572-4f73-423e-8b75-9180d2cd2c50 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:16.694437 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a143be-f6c6-4a68-82c9-05e0198cd4fd None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:16.737616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040db2d-7b67-4851-9aa3-d6b8be7778bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:16.738299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040db2d-7b67-4851-9aa3-d6b8be7778bf None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:16.738584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040db2d-7b67-4851-9aa3-d6b8be7778bf None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:16.738854 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040db2d-7b67-4851-9aa3-d6b8be7778bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:16.739796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040db2d-7b67-4851-9aa3-d6b8be7778bf None admin] RBAC: Adding query filter params (group.id=a9063f187e764e92ba327b1d7e6a805e, role.id=cba01848eb624bfaaeeb1244e02e5bd7, scope.project.id=0c3884c9c1c84b738e43a478898c36f8) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:16.740041 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040db2d-7b67-4851-9aa3-d6b8be7778bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:16.741476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040db2d-7b67-4851-9aa3-d6b8be7778bf None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:16.747842 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 171/352] 10.222.0.25 () {56 vars in 1376 bytes} [Thu May 12 06:31:16 2022] GET /identity/v3/role_assignments?group.id=a9063f187e764e92ba327b1d7e6a805e&scope.project.id=0c3884c9c1c84b738e43a478898c36f8&role.id=cba01848eb624bfaaeeb1244e02e5bd7 => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:16.748432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040db2d-7b67-4851-9aa3-d6b8be7778bf None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:16.780098 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f0572-4f73-423e-8b75-9180d2cd2c50 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:16.820755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680558db-0cd8-42d7-82ce-888c010c6490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:16.821452 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680558db-0cd8-42d7-82ce-888c010c6490 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:16.821805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680558db-0cd8-42d7-82ce-888c010c6490 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:16.822092 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680558db-0cd8-42d7-82ce-888c010c6490 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:16.823218 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680558db-0cd8-42d7-82ce-888c010c6490 None admin] RBAC: Adding query filter params (name=member) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:16.823529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680558db-0cd8-42d7-82ce-888c010c6490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:16.825736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680558db-0cd8-42d7-82ce-888c010c6490 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:16.838759 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 182/353] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:31:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:16.844387 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b5bf9-8b17-45b6-b1fe-241a168d9a2b None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:16.844721 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b5bf9-8b17-45b6-b1fe-241a168d9a2b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:16.844950 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b5bf9-8b17-45b6-b1fe-241a168d9a2b None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:16.847405 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 183/354] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:16.848290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b5bf9-8b17-45b6-b1fe-241a168d9a2b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:16.886100 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040db2d-7b67-4851-9aa3-d6b8be7778bf None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:16.930102 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f3081-947c-4eb1-af49-d1ead62ae337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:16.932944 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f3081-947c-4eb1-af49-d1ead62ae337 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:16.932944 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f3081-947c-4eb1-af49-d1ead62ae337 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:16.932944 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f3081-947c-4eb1-af49-d1ead62ae337 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:16.932944 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f3081-947c-4eb1-af49-d1ead62ae337 None admin] RBAC: Adding query filter params (role.id=6499c37d9f3048e1b9966d520667bd09, user.id=cc6bb76147a8402a9f71596f9904d766, scope.system=all) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:16.932944 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f3081-947c-4eb1-af49-d1ead62ae337 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:16.934054 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f3081-947c-4eb1-af49-d1ead62ae337 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:16.950615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 172/355] 10.222.0.25 () {56 vars in 1308 bytes} [Thu May 12 06:31:16 2022] GET /identity/v3/role_assignments?user.id=cc6bb76147a8402a9f71596f9904d766&scope.system=all&role.id=6499c37d9f3048e1b9966d520667bd09 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:16.951274 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f3081-947c-4eb1-af49-d1ead62ae337 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:16.977021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b5bf9-8b17-45b6-b1fe-241a168d9a2b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:17.019766 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21d2d6-726d-411e-986e-9215609d4bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:17.020933 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21d2d6-726d-411e-986e-9215609d4bbb None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:17.021623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21d2d6-726d-411e-986e-9215609d4bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:17.022122 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21d2d6-726d-411e-986e-9215609d4bbb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:17.034779 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21d2d6-726d-411e-986e-9215609d4bbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:17.044075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-ae21d2d6-726d-411e-986e-9215609d4bbb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:17.044075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:17.044075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:17.044075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:17.044075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:17.044075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:17.044075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:17.044075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:17.044075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:17.044075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:17.044075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:17.044075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:17.044075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:17.044075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:17.044075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:17.044075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:17.045538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:17.045538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:17.045538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:17.045538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:17.045538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:17.045538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:17.045538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:17.045538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:17.045538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:17.045538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:17.045538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:17.045538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:17.045538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:17.045538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:17.045538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:17.045538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:17.046345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:17.046345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:17.046345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:17.046345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:17.046345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:17.046345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:17.046345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:17.046345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:17.046345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:17.046345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:17.046345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:17.046345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:17.048885 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 184/356] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:17.050527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd625426-5ea7-4072-9c05-bd7e710901cf None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:17.051145 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd625426-5ea7-4072-9c05-bd7e710901cf None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:17.051633 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd625426-5ea7-4072-9c05-bd7e710901cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:17.071897 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-dd625426-5ea7-4072-9c05-bd7e710901cf None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:17.074023 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-dd625426-5ea7-4072-9c05-bd7e710901cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:17.146878 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f3081-947c-4eb1-af49-d1ead62ae337 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:17.172235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 185/357] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:17.174860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd625426-5ea7-4072-9c05-bd7e710901cf None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:17.201009 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029814f-421a-46c1-91ea-53a819153e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:17.201349 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029814f-421a-46c1-91ea-53a819153e2a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:17.201560 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029814f-421a-46c1-91ea-53a819153e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:17.201884 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029814f-421a-46c1-91ea-53a819153e2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:17.289250 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029814f-421a-46c1-91ea-53a819153e2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:17.291514 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029814f-421a-46c1-91ea-53a819153e2a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:17.293585 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd625426-5ea7-4072-9c05-bd7e710901cf None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:17.335860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49ca46-3258-4c3d-8646-8a19922578af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:17.336183 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49ca46-3258-4c3d-8646-8a19922578af None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:17.336465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49ca46-3258-4c3d-8646-8a19922578af None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:17.337331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49ca46-3258-4c3d-8646-8a19922578af None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:17.338120 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49ca46-3258-4c3d-8646-8a19922578af None admin] RBAC: Adding query filter params (name=member) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:17.338427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49ca46-3258-4c3d-8646-8a19922578af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:17.339896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49ca46-3258-4c3d-8646-8a19922578af None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:17.349918 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 186/358] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:31:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:17.355944 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49ca46-3258-4c3d-8646-8a19922578af None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:17.417861 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 173/359] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:17.419003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029814f-421a-46c1-91ea-53a819153e2a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:17.474016 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49ca46-3258-4c3d-8646-8a19922578af None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:17.508778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacba5a-3b36-4df6-bbe3-54be6e7cd528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:17.509976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacba5a-3b36-4df6-bbe3-54be6e7cd528 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:17.510457 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacba5a-3b36-4df6-bbe3-54be6e7cd528 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:17.510948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacba5a-3b36-4df6-bbe3-54be6e7cd528 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:17.522771 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eacba5a-3b36-4df6-bbe3-54be6e7cd528 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:17.532113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-5eacba5a-3b36-4df6-bbe3-54be6e7cd528 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:31:17.532113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:17.532113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:17.532113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:17.532113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:17.532113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:17.532113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:17.532113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:17.532113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:17.532113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:17.532113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:17.532113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:17.532113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:17.532113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:17.532113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:17.532113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:17.533039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:17.533039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:17.533039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:17.533039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:17.533039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:17.533039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:17.533039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:17.533039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:17.533039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:17.533039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:17.533039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:17.533039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:17.533039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:17.533039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:17.533039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:17.533039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:17.533848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:17.533848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:17.533848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:17.533848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:17.533848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:17.533848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:17.533848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:17.533848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:17.533848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:17.533848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:17.533848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:31:17.533848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:17.536701 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 187/360] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:31:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:17.537714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacba5a-3b36-4df6-bbe3-54be6e7cd528 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:17.547855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029814f-421a-46c1-91ea-53a819153e2a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:17.605245 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d9d91-141c-488c-9158-b16837bc1806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:17.606735 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d9d91-141c-488c-9158-b16837bc1806 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:17.607399 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d9d91-141c-488c-9158-b16837bc1806 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:17.607985 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d9d91-141c-488c-9158-b16837bc1806 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:17.654707 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacba5a-3b36-4df6-bbe3-54be6e7cd528 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:17.696472 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f86d7-5b2e-428f-b577-8d491701b410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:17.697381 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f86d7-5b2e-428f-b577-8d491701b410 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:17.697670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f86d7-5b2e-428f-b577-8d491701b410 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:17.697942 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f86d7-5b2e-428f-b577-8d491701b410 None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:17.699208 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f86d7-5b2e-428f-b577-8d491701b410 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3884c9c1c84b738e43a478898c36f8)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:17.701667 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f86d7-5b2e-428f-b577-8d491701b410 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:17.702781 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 188/361] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:17 2022] GET /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:17.703640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f86d7-5b2e-428f-b577-8d491701b410 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:17.710663 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d9d91-141c-488c-9158-b16837bc1806 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:17.712650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d9d91-141c-488c-9158-b16837bc1806 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:17.827868 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f86d7-5b2e-428f-b577-8d491701b410 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:17.836726 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 174/362] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:17.838099 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d45ff-1087-46e8-9a9d-4cd875f5344c None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:17.838390 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d45ff-1087-46e8-9a9d-4cd875f5344c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:17.838668 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d45ff-1087-46e8-9a9d-4cd875f5344c None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:17.839993 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 175/363] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:17.840689 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d45ff-1087-46e8-9a9d-4cd875f5344c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:17.877298 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3044f-b8a3-4961-ba74-208d3ff043dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:17.877904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3044f-b8a3-4961-ba74-208d3ff043dd None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:17.878181 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3044f-b8a3-4961-ba74-208d3ff043dd None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:17.878458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3044f-b8a3-4961-ba74-208d3ff043dd None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:17.879226 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3044f-b8a3-4961-ba74-208d3ff043dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:17.879532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3044f-b8a3-4961-ba74-208d3ff043dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:17.881955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3044f-b8a3-4961-ba74-208d3ff043dd None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:17.891765 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 189/364] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:17.892802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3044f-b8a3-4961-ba74-208d3ff043dd None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:17.962931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d45ff-1087-46e8-9a9d-4cd875f5344c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:18.002202 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2047c38-86db-4f13-8227-94dfb2393119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:18.003050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2047c38-86db-4f13-8227-94dfb2393119 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:18.003336 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2047c38-86db-4f13-8227-94dfb2393119 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:18.003611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2047c38-86db-4f13-8227-94dfb2393119 None admin] PATH_INFO: `/v3/groups/a9063f187e764e92ba327b1d7e6a805e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:18.005866 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2047c38-86db-4f13-8227-94dfb2393119 None admin] RBAC: Authorizing `identity:get_group(group_id=a9063f187e764e92ba327b1d7e6a805e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:18.007310 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2047c38-86db-4f13-8227-94dfb2393119 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:18.009119 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 176/365] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 12 06:31:17 2022] GET /identity/v3/groups/a9063f187e764e92ba327b1d7e6a805e => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:18.010551 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3044f-b8a3-4961-ba74-208d3ff043dd None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:18.012956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84835fc6-57d6-42b6-b384-bc41196f5fae None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:18.013468 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84835fc6-57d6-42b6-b384-bc41196f5fae None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:18.014005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84835fc6-57d6-42b6-b384-bc41196f5fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:18.032549 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-84835fc6-57d6-42b6-b384-bc41196f5fae None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:18.034165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-84835fc6-57d6-42b6-b384-bc41196f5fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:18.046855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a176bb-9b1d-440b-a800-da8ba14e047d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:18.047764 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a176bb-9b1d-440b-a800-da8ba14e047d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:18.048054 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a176bb-9b1d-440b-a800-da8ba14e047d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:18.048333 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a176bb-9b1d-440b-a800-da8ba14e047d None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:18.050111 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a176bb-9b1d-440b-a800-da8ba14e047d None admin] RBAC: Authorizing `identity:get_project(project_id=997175288e39489ead5929a225ecbf2c)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:18.051325 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a176bb-9b1d-440b-a800-da8ba14e047d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:18.053303 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 190/366] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:17 2022] GET /identity/v3/projects/997175288e39489ead5929a225ecbf2c => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:18.053886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a176bb-9b1d-440b-a800-da8ba14e047d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:18.120435 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 177/367] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:18.121644 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84835fc6-57d6-42b6-b384-bc41196f5fae None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:18.168240 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a176bb-9b1d-440b-a800-da8ba14e047d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:18.203977 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133b5c5-84fd-45e9-b939-2da61c4a6bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:18.204877 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133b5c5-84fd-45e9-b939-2da61c4a6bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:18.205166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133b5c5-84fd-45e9-b939-2da61c4a6bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:18.205444 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133b5c5-84fd-45e9-b939-2da61c4a6bb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:18.236909 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84835fc6-57d6-42b6-b384-bc41196f5fae None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:18.277290 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb3ba7-616a-4de3-94dc-c039dce71934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:18.278465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb3ba7-616a-4de3-94dc-c039dce71934 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:18.279447 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb3ba7-616a-4de3-94dc-c039dce71934 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:18.279945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb3ba7-616a-4de3-94dc-c039dce71934 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:18.281027 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb3ba7-616a-4de3-94dc-c039dce71934 None admin] RBAC: Adding query filter params (group.id=a9063f187e764e92ba327b1d7e6a805e, role.id=2162d563a5344c26821a7961cb75468b, scope.project.id=0c3884c9c1c84b738e43a478898c36f8) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:18.281244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133b5c5-84fd-45e9-b939-2da61c4a6bb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:18.281353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb3ba7-616a-4de3-94dc-c039dce71934 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:18.282704 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133b5c5-84fd-45e9-b939-2da61c4a6bb1 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:18.282801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb3ba7-616a-4de3-94dc-c039dce71934 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:18.290991 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 178/368] 10.222.0.25 () {56 vars in 1376 bytes} [Thu May 12 06:31:18 2022] GET /identity/v3/role_assignments?group.id=a9063f187e764e92ba327b1d7e6a805e&scope.project.id=0c3884c9c1c84b738e43a478898c36f8&role.id=2162d563a5344c26821a7961cb75468b => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:18.290991 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb3ba7-616a-4de3-94dc-c039dce71934 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:18.395975 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 191/369] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:18.396866 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133b5c5-84fd-45e9-b939-2da61c4a6bb1 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:18.432442 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb3ba7-616a-4de3-94dc-c039dce71934 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:18.481187 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f117d-e7ec-4679-ad71-c07ce70c41ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:18.482067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f117d-e7ec-4679-ad71-c07ce70c41ef None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:18.482347 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f117d-e7ec-4679-ad71-c07ce70c41ef None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:18.482618 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f117d-e7ec-4679-ad71-c07ce70c41ef None admin] PATH_INFO: `/v3/groups/a9063f187e764e92ba327b1d7e6a805e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:18.484595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f117d-e7ec-4679-ad71-c07ce70c41ef None admin] RBAC: Authorizing `identity:get_group(group_id=a9063f187e764e92ba327b1d7e6a805e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:18.486217 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f117d-e7ec-4679-ad71-c07ce70c41ef None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:18.488957 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 179/370] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 12 06:31:18 2022] GET /identity/v3/groups/a9063f187e764e92ba327b1d7e6a805e => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:18.489768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f117d-e7ec-4679-ad71-c07ce70c41ef None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:18.507610 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133b5c5-84fd-45e9-b939-2da61c4a6bb1 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:18.557619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00647e3-6bcf-4a55-adeb-fc455f14b570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:18.558825 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00647e3-6bcf-4a55-adeb-fc455f14b570 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:18.559158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00647e3-6bcf-4a55-adeb-fc455f14b570 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:18.559435 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00647e3-6bcf-4a55-adeb-fc455f14b570 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:18.572962 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00647e3-6bcf-4a55-adeb-fc455f14b570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:18.584041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-a00647e3-6bcf-4a55-adeb-fc455f14b570 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:31:18.584041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:18.584041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:18.584041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:18.584041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:18.584041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:18.584041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:18.584041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:18.584041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:18.584041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:18.584041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:18.584041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:18.584041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:18.584041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:18.584041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:18.584041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:18.584955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:18.584955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:18.584955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:18.584955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:18.584955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:18.584955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:18.584955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:18.584955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:18.584955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:18.584955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:18.584955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:18.584955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:18.584955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:18.584955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:18.584955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:18.584955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:18.586191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:18.586191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:18.586191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:18.586191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:18.586191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:18.586191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:18.586191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:18.586191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:18.586191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:18.586191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:18.586191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:31:18.586191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:18.586191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 192/371] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:31:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:18.586950 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00647e3-6bcf-4a55-adeb-fc455f14b570 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:18.626751 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f117d-e7ec-4679-ad71-c07ce70c41ef None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:18.671456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772944ca-45da-4fc0-ac5d-08e17ca9b50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:18.672408 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772944ca-45da-4fc0-ac5d-08e17ca9b50b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:18.672687 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772944ca-45da-4fc0-ac5d-08e17ca9b50b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:18.672957 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772944ca-45da-4fc0-ac5d-08e17ca9b50b None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:18.674145 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772944ca-45da-4fc0-ac5d-08e17ca9b50b None admin] RBAC: Authorizing `identity:get_project(project_id=997175288e39489ead5929a225ecbf2c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:18.675578 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772944ca-45da-4fc0-ac5d-08e17ca9b50b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:18.678125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 180/372] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:18 2022] GET /identity/v3/projects/997175288e39489ead5929a225ecbf2c => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:18.679267 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772944ca-45da-4fc0-ac5d-08e17ca9b50b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:18.704638 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00647e3-6bcf-4a55-adeb-fc455f14b570 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:18.743501 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945f0e6-ca5a-4b49-81d7-0ba385f65ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:18.744612 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945f0e6-ca5a-4b49-81d7-0ba385f65ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:18.745116 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945f0e6-ca5a-4b49-81d7-0ba385f65ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:18.745586 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945f0e6-ca5a-4b49-81d7-0ba385f65ca3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:18.746647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945f0e6-ca5a-4b49-81d7-0ba385f65ca3 None admin] RBAC: Adding query filter params (group.id=a9063f187e764e92ba327b1d7e6a805e, role.id=2162d563a5344c26821a7961cb75468b, scope.project.id=997175288e39489ead5929a225ecbf2c) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:18.747198 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945f0e6-ca5a-4b49-81d7-0ba385f65ca3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:18.748890 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945f0e6-ca5a-4b49-81d7-0ba385f65ca3 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:18.755281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 193/373] 10.222.0.25 () {56 vars in 1376 bytes} [Thu May 12 06:31:18 2022] GET /identity/v3/role_assignments?group.id=a9063f187e764e92ba327b1d7e6a805e&scope.project.id=997175288e39489ead5929a225ecbf2c&role.id=2162d563a5344c26821a7961cb75468b => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:18.756475 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945f0e6-ca5a-4b49-81d7-0ba385f65ca3 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:18.811145 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772944ca-45da-4fc0-ac5d-08e17ca9b50b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:18.856070 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8d3e5-7982-4d58-83bd-6b1502c4122b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:18.856779 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8d3e5-7982-4d58-83bd-6b1502c4122b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:18.857056 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8d3e5-7982-4d58-83bd-6b1502c4122b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:18.857727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8d3e5-7982-4d58-83bd-6b1502c4122b None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:18.858767 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8d3e5-7982-4d58-83bd-6b1502c4122b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:18.859077 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8d3e5-7982-4d58-83bd-6b1502c4122b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:18.860629 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8d3e5-7982-4d58-83bd-6b1502c4122b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:18.873279 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 181/374] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:18.878872 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8d3e5-7982-4d58-83bd-6b1502c4122b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:18.880546 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945f0e6-ca5a-4b49-81d7-0ba385f65ca3 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:18.918022 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f231d-9057-4e42-b276-c84357f8ee75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:18.919311 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f231d-9057-4e42-b276-c84357f8ee75 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:18.919864 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f231d-9057-4e42-b276-c84357f8ee75 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:18.920328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f231d-9057-4e42-b276-c84357f8ee75 None admin] PATH_INFO: `/v3/groups/a9063f187e764e92ba327b1d7e6a805e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:18.921813 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f231d-9057-4e42-b276-c84357f8ee75 None admin] RBAC: Authorizing `identity:get_group(group_id=a9063f187e764e92ba327b1d7e6a805e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:18.923438 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f231d-9057-4e42-b276-c84357f8ee75 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:18.927577 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 194/375] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 12 06:31:18 2022] GET /identity/v3/groups/a9063f187e764e92ba327b1d7e6a805e => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:18.932730 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f231d-9057-4e42-b276-c84357f8ee75 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:18.991473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8d3e5-7982-4d58-83bd-6b1502c4122b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:19.029805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc956b5-71ee-464c-9207-29e1b59c51bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:19.030636 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc956b5-71ee-464c-9207-29e1b59c51bf None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:19.031019 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc956b5-71ee-464c-9207-29e1b59c51bf None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:19.031393 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc956b5-71ee-464c-9207-29e1b59c51bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:19.048502 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f231d-9057-4e42-b276-c84357f8ee75 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:19.087357 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d43754-163d-4e0b-a3ad-b0a4a548b07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:19.088059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d43754-163d-4e0b-a3ad-b0a4a548b07f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:19.088339 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d43754-163d-4e0b-a3ad-b0a4a548b07f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:19.088611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d43754-163d-4e0b-a3ad-b0a4a548b07f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:19.089549 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d43754-163d-4e0b-a3ad-b0a4a548b07f None admin] RBAC: Adding query filter params (group.id=a9063f187e764e92ba327b1d7e6a805e, role.id=cba01848eb624bfaaeeb1244e02e5bd7, scope.project.id=997175288e39489ead5929a225ecbf2c) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:19.089915 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d43754-163d-4e0b-a3ad-b0a4a548b07f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:19.091387 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d43754-163d-4e0b-a3ad-b0a4a548b07f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:19.098045 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 195/376] 10.222.0.25 () {56 vars in 1376 bytes} [Thu May 12 06:31:18 2022] GET /identity/v3/role_assignments?group.id=a9063f187e764e92ba327b1d7e6a805e&scope.project.id=997175288e39489ead5929a225ecbf2c&role.id=cba01848eb624bfaaeeb1244e02e5bd7 => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:19.110819 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc956b5-71ee-464c-9207-29e1b59c51bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:19.112547 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc956b5-71ee-464c-9207-29e1b59c51bf None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:19.228397 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 182/377] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:19.234290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d43754-163d-4e0b-a3ad-b0a4a548b07f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:19.347378 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d43754-163d-4e0b-a3ad-b0a4a548b07f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:19.386737 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce44e0d-ba5d-4de1-8399-4c810d22e2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:19.387609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce44e0d-ba5d-4de1-8399-4c810d22e2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:19.387947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce44e0d-ba5d-4de1-8399-4c810d22e2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:19.388220 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce44e0d-ba5d-4de1-8399-4c810d22e2b8 None admin] PATH_INFO: `/v3/projects/ce2018cacb6f4eb3a54694e57a783679` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:19.389508 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce44e0d-ba5d-4de1-8399-4c810d22e2b8 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2018cacb6f4eb3a54694e57a783679)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:19.391074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce44e0d-ba5d-4de1-8399-4c810d22e2b8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:19.393258 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 196/378] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:19 2022] GET /identity/v3/projects/ce2018cacb6f4eb3a54694e57a783679 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:19.400098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc956b5-71ee-464c-9207-29e1b59c51bf None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:19.513345 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc956b5-71ee-464c-9207-29e1b59c51bf None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:19.548689 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efde9f5-e016-4448-8038-1688517fd680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:19.549530 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efde9f5-e016-4448-8038-1688517fd680 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:19.549804 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efde9f5-e016-4448-8038-1688517fd680 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:19.550070 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efde9f5-e016-4448-8038-1688517fd680 None admin] PATH_INFO: `/v3/groups/6b8a5f35ac14435ca6e85d7dc472be08` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:19.554794 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efde9f5-e016-4448-8038-1688517fd680 None admin] RBAC: Authorizing `identity:get_group(group_id=6b8a5f35ac14435ca6e85d7dc472be08)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:19.556817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efde9f5-e016-4448-8038-1688517fd680 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:19.558498 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 183/379] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 12 06:31:19 2022] GET /identity/v3/groups/6b8a5f35ac14435ca6e85d7dc472be08 => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:19.564449 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce44e0d-ba5d-4de1-8399-4c810d22e2b8 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:19.670713 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0d5e6-715d-4a90-b366-769d847b693f None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:19.670713 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0d5e6-715d-4a90-b366-769d847b693f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:19.670713 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0d5e6-715d-4a90-b366-769d847b693f None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:19.672385 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 184/380] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:19.681511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26661b4e-de54-4a50-859f-f847954a0f21 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:19.682058 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26661b4e-de54-4a50-859f-f847954a0f21 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:19.682558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26661b4e-de54-4a50-859f-f847954a0f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:19.690521 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce44e0d-ba5d-4de1-8399-4c810d22e2b8 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:19.720940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-26661b4e-de54-4a50-859f-f847954a0f21 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:19.722539 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-26661b4e-de54-4a50-859f-f847954a0f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:19.728021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17468f1-1b6c-4110-b17a-31263cf08e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:19.731707 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17468f1-1b6c-4110-b17a-31263cf08e37 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:19.731707 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17468f1-1b6c-4110-b17a-31263cf08e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:19.731707 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17468f1-1b6c-4110-b17a-31263cf08e37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:19.731707 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17468f1-1b6c-4110-b17a-31263cf08e37 None admin] RBAC: Adding query filter params (group.id=6b8a5f35ac14435ca6e85d7dc472be08, role.id=5e6a73052f3b4ee7829ecb858925e5ca, scope.project.id=ce2018cacb6f4eb3a54694e57a783679) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:19.731707 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17468f1-1b6c-4110-b17a-31263cf08e37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:19.732071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17468f1-1b6c-4110-b17a-31263cf08e37 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:19.746309 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 197/381] 10.222.0.25 () {56 vars in 1376 bytes} [Thu May 12 06:31:19 2022] GET /identity/v3/role_assignments?group.id=6b8a5f35ac14435ca6e85d7dc472be08&scope.project.id=ce2018cacb6f4eb3a54694e57a783679&role.id=5e6a73052f3b4ee7829ecb858925e5ca => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:19.844139 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 185/382] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:31:19.868057 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17468f1-1b6c-4110-b17a-31263cf08e37 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:19.991152 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17468f1-1b6c-4110-b17a-31263cf08e37 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:20.028692 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee88d42-ca7f-4dd2-8ad1-d4440a394e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:20.029507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee88d42-ca7f-4dd2-8ad1-d4440a394e26 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:20.029789 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee88d42-ca7f-4dd2-8ad1-d4440a394e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:20.030059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee88d42-ca7f-4dd2-8ad1-d4440a394e26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:20.041511 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee88d42-ca7f-4dd2-8ad1-d4440a394e26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:20.049960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-9ee88d42-ca7f-4dd2-8ad1-d4440a394e26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:31:20.049960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:20.049960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:20.049960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:20.049960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:20.049960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:20.049960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:20.049960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:20.049960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:20.049960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:20.049960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:20.049960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:20.049960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:20.049960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:20.049960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:20.049960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:20.051351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:20.051351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:20.051351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:20.051351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:20.051351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:20.051351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:20.051351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:20.051351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:20.051351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:20.051351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:20.051351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:20.051351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:20.051351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:20.051351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:20.051351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:20.051351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:20.052299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:20.052299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:20.052299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:20.052299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:20.052299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:20.052299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:20.052299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:20.052299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:20.052299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:20.052299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:20.052299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:31:20.052299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:20.052299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 198/383] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:31:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:20.059980 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26661b4e-de54-4a50-859f-f847954a0f21 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:20.164057 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26661b4e-de54-4a50-859f-f847954a0f21 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:20.198648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70694bc-e4e9-4c68-b6b7-17aa1cd67a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:20.199322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70694bc-e4e9-4c68-b6b7-17aa1cd67a94 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:20.199600 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70694bc-e4e9-4c68-b6b7-17aa1cd67a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:20.199902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70694bc-e4e9-4c68-b6b7-17aa1cd67a94 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:20.200655 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70694bc-e4e9-4c68-b6b7-17aa1cd67a94 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:20.200959 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70694bc-e4e9-4c68-b6b7-17aa1cd67a94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:20.202344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70694bc-e4e9-4c68-b6b7-17aa1cd67a94 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:20.210871 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 186/384] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:20.220839 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee88d42-ca7f-4dd2-8ad1-d4440a394e26 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:20.328321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee88d42-ca7f-4dd2-8ad1-d4440a394e26 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:20.363105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c014c-9b5f-4b7b-862b-177405735a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:20.363995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c014c-9b5f-4b7b-862b-177405735a04 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:20.364275 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c014c-9b5f-4b7b-862b-177405735a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:20.364548 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c014c-9b5f-4b7b-862b-177405735a04 None admin] PATH_INFO: `/v3/groups/a9063f187e764e92ba327b1d7e6a805e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:20.365740 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c014c-9b5f-4b7b-862b-177405735a04 None admin] RBAC: Authorizing `identity:get_group(group_id=a9063f187e764e92ba327b1d7e6a805e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:20.367169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c014c-9b5f-4b7b-862b-177405735a04 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:20.369713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 199/385] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 12 06:31:20 2022] GET /identity/v3/groups/a9063f187e764e92ba327b1d7e6a805e => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:20.375125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70694bc-e4e9-4c68-b6b7-17aa1cd67a94 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:20.483642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70694bc-e4e9-4c68-b6b7-17aa1cd67a94 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:20.520553 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82da5c-1393-4149-8d64-dc163bbfb433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:20.520553 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82da5c-1393-4149-8d64-dc163bbfb433 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:20.520553 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82da5c-1393-4149-8d64-dc163bbfb433 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:20.520870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82da5c-1393-4149-8d64-dc163bbfb433 None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:20.521929 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82da5c-1393-4149-8d64-dc163bbfb433 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3884c9c1c84b738e43a478898c36f8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:20.523372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82da5c-1393-4149-8d64-dc163bbfb433 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:20.526043 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 187/386] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:20 2022] GET /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:20.532190 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c014c-9b5f-4b7b-862b-177405735a04 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:20.719912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c014c-9b5f-4b7b-862b-177405735a04 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:20.755148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0279c3-f243-4ad0-b5d6-06c3ec6305d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:20.756074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0279c3-f243-4ad0-b5d6-06c3ec6305d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:20.756367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0279c3-f243-4ad0-b5d6-06c3ec6305d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:20.756630 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0279c3-f243-4ad0-b5d6-06c3ec6305d6 None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8/groups/a9063f187e764e92ba327b1d7e6a805e/roles/cba01848eb624bfaaeeb1244e02e5bd7` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:20.760019 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0279c3-f243-4ad0-b5d6-06c3ec6305d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c3884c9c1c84b738e43a478898c36f8, group_id=a9063f187e764e92ba327b1d7e6a805e, role_id=cba01848eb624bfaaeeb1244e02e5bd7)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:20.761464 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0279c3-f243-4ad0-b5d6-06c3ec6305d6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:20.846177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 200/387] 10.222.0.25 () {58 vars in 1442 bytes} [Thu May 12 06:31:20 2022] PUT /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8/groups/a9063f187e764e92ba327b1d7e6a805e/roles/cba01848eb624bfaaeeb1244e02e5bd7 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:31:21.549767 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091006b6-4496-4995-800e-6303f1adde4c None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:21.550289 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091006b6-4496-4995-800e-6303f1adde4c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:21.550289 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091006b6-4496-4995-800e-6303f1adde4c None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:21.551853 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 188/388] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:21.559392 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3f883-bae4-422d-b6eb-c432ebd65800 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:21.559392 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3f883-bae4-422d-b6eb-c432ebd65800 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:21.559392 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3f883-bae4-422d-b6eb-c432ebd65800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:21.584693 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-8fa3f883-bae4-422d-b6eb-c432ebd65800 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:21.586254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8fa3f883-bae4-422d-b6eb-c432ebd65800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:21.665635 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 201/389] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:21.705113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091006b6-4496-4995-800e-6303f1adde4c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:21.842274 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091006b6-4496-4995-800e-6303f1adde4c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:21.879286 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24691559-866e-4b34-aad8-1efc4d6c55e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:21.880101 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24691559-866e-4b34-aad8-1efc4d6c55e2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:21.880381 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24691559-866e-4b34-aad8-1efc4d6c55e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:21.880646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24691559-866e-4b34-aad8-1efc4d6c55e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:21.893681 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24691559-866e-4b34-aad8-1efc4d6c55e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:21.902024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-24691559-866e-4b34-aad8-1efc4d6c55e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:21.902024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:21.902024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:21.902024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:21.902024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:21.902024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:21.902024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:21.902024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:21.902024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:21.902024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:21.902024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:21.902024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:21.902024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:21.902024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:21.902024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:21.902024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:21.902912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:21.902912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:21.902912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:21.902912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:21.902912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:21.902912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:21.902912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:21.902912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:21.902912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:21.902912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:21.902912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:21.902912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:21.902912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:21.902912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:21.902912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:21.902912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:21.903790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:21.903790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:21.903790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:21.903790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:21.903790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:21.903790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:21.903790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:21.903790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:21.903790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:21.903790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:21.903790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:21.903790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:21.903790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 189/390] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:21.909249 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3f883-bae4-422d-b6eb-c432ebd65800 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:21.997416 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd095b5-7544-46ea-b749-e2ec5a02c5c0 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:21.997701 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd095b5-7544-46ea-b749-e2ec5a02c5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:21.997974 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd095b5-7544-46ea-b749-e2ec5a02c5c0 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:21.999577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 190/391] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:22.008317 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81e80d-39ca-4572-abd1-65a1589e996e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:22.008610 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81e80d-39ca-4572-abd1-65a1589e996e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:22.008891 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81e80d-39ca-4572-abd1-65a1589e996e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:22.028870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9d81e80d-39ca-4572-abd1-65a1589e996e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:22.030053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9d81e80d-39ca-4572-abd1-65a1589e996e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:22.084220 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3f883-bae4-422d-b6eb-c432ebd65800 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:22.114888 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 191/392] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:31:22.139729 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6275152-265c-4897-89ab-2d70d11f5b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:22.140424 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6275152-265c-4897-89ab-2d70d11f5b67 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:22.140706 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6275152-265c-4897-89ab-2d70d11f5b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:22.140982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6275152-265c-4897-89ab-2d70d11f5b67 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:22.141747 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6275152-265c-4897-89ab-2d70d11f5b67 None admin] RBAC: Adding query filter params (name=member) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:22.142202 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6275152-265c-4897-89ab-2d70d11f5b67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:22.143637 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6275152-265c-4897-89ab-2d70d11f5b67 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:22.152791 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 202/393] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:31:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:22.153419 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81e80d-39ca-4572-abd1-65a1589e996e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:22.161628 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6275152-265c-4897-89ab-2d70d11f5b67 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:22.275675 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6275152-265c-4897-89ab-2d70d11f5b67 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:22.316363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1d08a-d722-4bb6-8cec-ceb42175d0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:22.318444 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1d08a-d722-4bb6-8cec-ceb42175d0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:22.319254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1d08a-d722-4bb6-8cec-ceb42175d0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:22.319773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1d08a-d722-4bb6-8cec-ceb42175d0b2 None admin] PATH_INFO: `/v3/groups/a9063f187e764e92ba327b1d7e6a805e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:22.321901 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1d08a-d722-4bb6-8cec-ceb42175d0b2 None admin] RBAC: Authorizing `identity:get_group(group_id=a9063f187e764e92ba327b1d7e6a805e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:22.323589 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1d08a-d722-4bb6-8cec-ceb42175d0b2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:22.326336 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 203/394] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 12 06:31:22 2022] GET /identity/v3/groups/a9063f187e764e92ba327b1d7e6a805e => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:22.332381 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1d08a-d722-4bb6-8cec-ceb42175d0b2 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:22.430708 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81e80d-39ca-4572-abd1-65a1589e996e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:22.446798 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1d08a-d722-4bb6-8cec-ceb42175d0b2 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:22.483029 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6123e9b-f263-4c87-8e29-5e9da6f097fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:22.484697 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6123e9b-f263-4c87-8e29-5e9da6f097fe None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:22.485190 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6123e9b-f263-4c87-8e29-5e9da6f097fe None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:22.485670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6123e9b-f263-4c87-8e29-5e9da6f097fe None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:22.487179 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6123e9b-f263-4c87-8e29-5e9da6f097fe None admin] RBAC: Authorizing `identity:get_project(project_id=0c3884c9c1c84b738e43a478898c36f8)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:22.489321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6123e9b-f263-4c87-8e29-5e9da6f097fe None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:22.491255 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 204/395] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:22 2022] GET /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:22.492454 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dc34d-8c1e-4294-a2ca-764a5375ad9c None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:22.493513 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dc34d-8c1e-4294-a2ca-764a5375ad9c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:22.493513 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dc34d-8c1e-4294-a2ca-764a5375ad9c None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:22.494903 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 205/396] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:22.500510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dc34d-8c1e-4294-a2ca-764a5375ad9c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:22.507117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc2513-0e75-4aa4-b4e1-885fd1ee4583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:22.508899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc2513-0e75-4aa4-b4e1-885fd1ee4583 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:22.511042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc2513-0e75-4aa4-b4e1-885fd1ee4583 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:22.511545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc2513-0e75-4aa4-b4e1-885fd1ee4583 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:22.525531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc2513-0e75-4aa4-b4e1-885fd1ee4583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:22.536457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-1bfc2513-0e75-4aa4-b4e1-885fd1ee4583 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:22.536457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:22.536457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:22.536457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:22.536457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:22.536457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:22.536457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:22.536457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:22.536457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:22.536457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:22.536457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:22.536457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:22.536457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:22.536457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:22.536457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:22.536457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:22.537376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:22.537376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:22.537376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:22.537376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:22.537376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:22.537376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:22.537376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:22.537376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:22.537376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:22.537376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:22.537376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:22.537376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:22.537376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:22.537376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:22.537376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:22.537376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:22.538184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:22.538184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:22.538184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:22.538184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:22.538184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:22.538184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:22.538184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:22.538184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:22.538184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:22.538184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:22.538184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:22.538184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:22.541206 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 192/397] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:31:22.542721 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df251e4-8096-4a30-a8f1-8784a20a8a31 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:22.543138 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df251e4-8096-4a30-a8f1-8784a20a8a31 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:22.543542 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df251e4-8096-4a30-a8f1-8784a20a8a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:22.564652 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0df251e4-8096-4a30-a8f1-8784a20a8a31 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:22.566685 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0df251e4-8096-4a30-a8f1-8784a20a8a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:22.614561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dc34d-8c1e-4294-a2ca-764a5375ad9c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:22.638505 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 193/398] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:22.640589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df251e4-8096-4a30-a8f1-8784a20a8a31 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:22.652129 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e89a4a-05ef-46d4-8215-1cd3e500b953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:22.653404 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e89a4a-05ef-46d4-8215-1cd3e500b953 None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:22.653964 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e89a4a-05ef-46d4-8215-1cd3e500b953 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:22.654495 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e89a4a-05ef-46d4-8215-1cd3e500b953 None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8/groups/a9063f187e764e92ba327b1d7e6a805e/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:22.656767 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e89a4a-05ef-46d4-8215-1cd3e500b953 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c3884c9c1c84b738e43a478898c36f8, group_id=a9063f187e764e92ba327b1d7e6a805e, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:22.658541 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e89a4a-05ef-46d4-8215-1cd3e500b953 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:22.724387 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 206/399] 10.222.0.25 () {58 vars in 1442 bytes} [Thu May 12 06:31:22 2022] PUT /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8/groups/a9063f187e764e92ba327b1d7e6a805e/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:31:22.725610 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b08310-4296-4b29-8aa4-444742bf1f0b None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:22.725891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b08310-4296-4b29-8aa4-444742bf1f0b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:22.726162 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b08310-4296-4b29-8aa4-444742bf1f0b None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:22.727663 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 207/400] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:22.731960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b08310-4296-4b29-8aa4-444742bf1f0b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:22.748459 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df251e4-8096-4a30-a8f1-8784a20a8a31 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:22.786352 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787d93d-9f64-4eb9-bf1e-ed50c80b4a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:22.787121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787d93d-9f64-4eb9-bf1e-ed50c80b4a8a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:22.787403 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787d93d-9f64-4eb9-bf1e-ed50c80b4a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:22.787738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787d93d-9f64-4eb9-bf1e-ed50c80b4a8a None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:22.788568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787d93d-9f64-4eb9-bf1e-ed50c80b4a8a None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:22.788926 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787d93d-9f64-4eb9-bf1e-ed50c80b4a8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:22.790700 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787d93d-9f64-4eb9-bf1e-ed50c80b4a8a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:22.800237 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 194/401] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:31:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:22.801600 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c080088-29a6-4422-a1b3-3fb3a41ece2f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:22.801887 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c080088-29a6-4422-a1b3-3fb3a41ece2f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:22.802160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c080088-29a6-4422-a1b3-3fb3a41ece2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:22.819561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6c080088-29a6-4422-a1b3-3fb3a41ece2f None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:22.820881 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6c080088-29a6-4422-a1b3-3fb3a41ece2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:22.864906 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b08310-4296-4b29-8aa4-444742bf1f0b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:22.896027 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 195/402] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:22.896857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c080088-29a6-4422-a1b3-3fb3a41ece2f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:22.909461 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac4841-6be4-4cf9-8d03-89d18866c312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:22.911223 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac4841-6be4-4cf9-8d03-89d18866c312 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:22.911761 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac4841-6be4-4cf9-8d03-89d18866c312 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:22.912275 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac4841-6be4-4cf9-8d03-89d18866c312 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:22.925861 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac4841-6be4-4cf9-8d03-89d18866c312 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:22.937712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-a5ac4841-6be4-4cf9-8d03-89d18866c312 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:31:22.937712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:22.937712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:22.937712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:22.937712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:22.937712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:22.937712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:22.937712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:22.937712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:22.937712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:22.937712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:22.937712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:22.937712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:22.937712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:22.937712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:22.937712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:22.938739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:22.938739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:22.938739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:22.938739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:22.938739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:22.938739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:22.938739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:22.938739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:22.938739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:22.938739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:22.938739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:22.938739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:22.938739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:22.938739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:22.938739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:22.938739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:22.939568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:22.939568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:22.939568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:22.939568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:22.939568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:22.939568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:22.939568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:22.939568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:22.939568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:22.939568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:22.939568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:31:22.939568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:22.941112 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 208/403] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:31:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:22.941917 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac4841-6be4-4cf9-8d03-89d18866c312 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:23.032870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c080088-29a6-4422-a1b3-3fb3a41ece2f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:23.067569 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16548e46-83f1-43cd-85cf-408b66c3a07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:23.068573 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16548e46-83f1-43cd-85cf-408b66c3a07f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:23.068923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16548e46-83f1-43cd-85cf-408b66c3a07f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:23.069266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16548e46-83f1-43cd-85cf-408b66c3a07f None admin] PATH_INFO: `/v3/groups/a9063f187e764e92ba327b1d7e6a805e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:23.070322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac4841-6be4-4cf9-8d03-89d18866c312 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:23.071123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16548e46-83f1-43cd-85cf-408b66c3a07f None admin] RBAC: Authorizing `identity:get_group(group_id=a9063f187e764e92ba327b1d7e6a805e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:23.072694 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16548e46-83f1-43cd-85cf-408b66c3a07f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:23.074732 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 196/404] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 12 06:31:22 2022] GET /identity/v3/groups/a9063f187e764e92ba327b1d7e6a805e => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:23.075713 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16548e46-83f1-43cd-85cf-408b66c3a07f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:23.106236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8fd29-44b6-4901-b106-4acff197ee62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:23.107179 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8fd29-44b6-4901-b106-4acff197ee62 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:23.107535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8fd29-44b6-4901-b106-4acff197ee62 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:23.107922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8fd29-44b6-4901-b106-4acff197ee62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:23.118880 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8fd29-44b6-4901-b106-4acff197ee62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:23.127066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-66a8fd29-44b6-4901-b106-4acff197ee62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:31:23.127066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:23.127066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:23.127066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:23.127066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:23.127066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:23.127066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:23.127066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:23.127066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:23.127066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:23.127066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:23.127066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:23.127066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:23.127066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:23.127066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:23.127066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:23.128044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:23.128044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:23.128044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:23.128044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:23.128044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:23.128044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:23.128044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:23.128044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:23.128044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:23.128044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:23.128044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:23.128044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:23.128044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:23.128044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:23.128044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:23.128044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:23.128852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:23.128852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:23.128852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:23.128852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:23.128852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:23.128852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:23.128852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:23.128852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:23.128852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:23.128852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:23.128852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:31:23.128852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:23.128852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 209/405] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:31:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:23.134068 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8fd29-44b6-4901-b106-4acff197ee62 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:23.191991 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16548e46-83f1-43cd-85cf-408b66c3a07f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:23.240199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8fd29-44b6-4901-b106-4acff197ee62 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:23.241207 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b71db-2fc8-4e35-a47f-eec9f4ea1699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:23.242262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b71db-2fc8-4e35-a47f-eec9f4ea1699 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:23.244118 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b71db-2fc8-4e35-a47f-eec9f4ea1699 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:23.244594 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b71db-2fc8-4e35-a47f-eec9f4ea1699 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:23.245550 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b71db-2fc8-4e35-a47f-eec9f4ea1699 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:23.246068 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b71db-2fc8-4e35-a47f-eec9f4ea1699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:23.248068 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b71db-2fc8-4e35-a47f-eec9f4ea1699 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:23.258927 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 197/406] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:23.260126 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b71db-2fc8-4e35-a47f-eec9f4ea1699 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:23.284258 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b83a1-ff0f-4234-9bd2-df44e8e68a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:23.285654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b83a1-ff0f-4234-9bd2-df44e8e68a0c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:23.286004 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b83a1-ff0f-4234-9bd2-df44e8e68a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:23.286616 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b83a1-ff0f-4234-9bd2-df44e8e68a0c None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:23.288135 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b83a1-ff0f-4234-9bd2-df44e8e68a0c None admin] RBAC: Authorizing `identity:get_project(project_id=997175288e39489ead5929a225ecbf2c)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:23.290646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b83a1-ff0f-4234-9bd2-df44e8e68a0c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:23.293235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 210/407] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:23 2022] GET /identity/v3/projects/997175288e39489ead5929a225ecbf2c => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:23.294137 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b83a1-ff0f-4234-9bd2-df44e8e68a0c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:23.379141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b71db-2fc8-4e35-a47f-eec9f4ea1699 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:23.406138 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b83a1-ff0f-4234-9bd2-df44e8e68a0c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:23.413056 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426a907-0f42-43d2-af0f-4cb7e8e01650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:23.413732 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426a907-0f42-43d2-af0f-4cb7e8e01650 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:23.414013 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426a907-0f42-43d2-af0f-4cb7e8e01650 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:23.414285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426a907-0f42-43d2-af0f-4cb7e8e01650 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:23.415944 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426a907-0f42-43d2-af0f-4cb7e8e01650 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:23.416252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426a907-0f42-43d2-af0f-4cb7e8e01650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:23.417618 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426a907-0f42-43d2-af0f-4cb7e8e01650 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:23.430409 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 198/408] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:23.431249 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426a907-0f42-43d2-af0f-4cb7e8e01650 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:23.440853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad6b64-2075-4b58-8012-bfbbab4d6089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:23.441770 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad6b64-2075-4b58-8012-bfbbab4d6089 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:23.442051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad6b64-2075-4b58-8012-bfbbab4d6089 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:23.442325 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad6b64-2075-4b58-8012-bfbbab4d6089 None admin] PATH_INFO: `/v3/groups/a9063f187e764e92ba327b1d7e6a805e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:23.443565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad6b64-2075-4b58-8012-bfbbab4d6089 None admin] RBAC: Authorizing `identity:get_group(group_id=a9063f187e764e92ba327b1d7e6a805e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:23.445088 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad6b64-2075-4b58-8012-bfbbab4d6089 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:23.446793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 211/409] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 12 06:31:23 2022] GET /identity/v3/groups/a9063f187e764e92ba327b1d7e6a805e => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:23.447612 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad6b64-2075-4b58-8012-bfbbab4d6089 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:23.530502 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426a907-0f42-43d2-af0f-4cb7e8e01650 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:23.553100 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad6b64-2075-4b58-8012-bfbbab4d6089 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:23.565364 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33911340-f2dc-402f-8e56-bba1f8b8a372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:23.566411 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33911340-f2dc-402f-8e56-bba1f8b8a372 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:23.566693 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33911340-f2dc-402f-8e56-bba1f8b8a372 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:23.566969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33911340-f2dc-402f-8e56-bba1f8b8a372 None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c/groups/a9063f187e764e92ba327b1d7e6a805e/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:23.569166 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33911340-f2dc-402f-8e56-bba1f8b8a372 None admin] RBAC: Authorizing `identity:create_grant(project_id=997175288e39489ead5929a225ecbf2c, group_id=a9063f187e764e92ba327b1d7e6a805e, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:23.571217 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33911340-f2dc-402f-8e56-bba1f8b8a372 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:23.590766 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c0c18-4e41-45e6-b9e5-88be547ce62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:23.592734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c0c18-4e41-45e6-b9e5-88be547ce62f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:23.592734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c0c18-4e41-45e6-b9e5-88be547ce62f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:23.592734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c0c18-4e41-45e6-b9e5-88be547ce62f None admin] PATH_INFO: `/v3/groups/6b8a5f35ac14435ca6e85d7dc472be08` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:23.593774 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c0c18-4e41-45e6-b9e5-88be547ce62f None admin] RBAC: Authorizing `identity:get_group(group_id=6b8a5f35ac14435ca6e85d7dc472be08)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:23.595237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c0c18-4e41-45e6-b9e5-88be547ce62f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:23.601619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 212/410] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 12 06:31:23 2022] GET /identity/v3/groups/6b8a5f35ac14435ca6e85d7dc472be08 => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:23.601619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c0c18-4e41-45e6-b9e5-88be547ce62f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:23.647974 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 199/411] 10.222.0.25 () {58 vars in 1442 bytes} [Thu May 12 06:31:23 2022] PUT /identity/v3/projects/997175288e39489ead5929a225ecbf2c/groups/a9063f187e764e92ba327b1d7e6a805e/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:31:23.649348 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33911340-f2dc-402f-8e56-bba1f8b8a372 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:23.707084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c0c18-4e41-45e6-b9e5-88be547ce62f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:23.742600 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c95b12-1787-4457-bd93-4afc1e7d1c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:23.747766 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c95b12-1787-4457-bd93-4afc1e7d1c1e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:23.747766 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c95b12-1787-4457-bd93-4afc1e7d1c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:23.747766 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c95b12-1787-4457-bd93-4afc1e7d1c1e None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:23.749780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c95b12-1787-4457-bd93-4afc1e7d1c1e None admin] RBAC: Authorizing `identity:get_project(project_id=997175288e39489ead5929a225ecbf2c)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:23.752450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c95b12-1787-4457-bd93-4afc1e7d1c1e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:23.762687 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 213/412] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:23 2022] GET /identity/v3/projects/997175288e39489ead5929a225ecbf2c => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:23.768327 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c95b12-1787-4457-bd93-4afc1e7d1c1e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:23.835018 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33911340-f2dc-402f-8e56-bba1f8b8a372 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:23.872081 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ec928-2f82-4e7f-8935-f0ba9c2efb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:23.872959 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ec928-2f82-4e7f-8935-f0ba9c2efb64 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:23.873239 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ec928-2f82-4e7f-8935-f0ba9c2efb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:23.873513 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ec928-2f82-4e7f-8935-f0ba9c2efb64 None admin] PATH_INFO: `/v3/projects/ce2018cacb6f4eb3a54694e57a783679` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:23.874831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ec928-2f82-4e7f-8935-f0ba9c2efb64 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2018cacb6f4eb3a54694e57a783679)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:23.876523 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ec928-2f82-4e7f-8935-f0ba9c2efb64 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:23.878809 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 200/413] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:23 2022] GET /identity/v3/projects/ce2018cacb6f4eb3a54694e57a783679 => generated 344 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:23.880103 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95790490-a331-4e5e-b138-cf7738d13d40 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:23.880453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95790490-a331-4e5e-b138-cf7738d13d40 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:23.880729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95790490-a331-4e5e-b138-cf7738d13d40 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:23.882110 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 201/414] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:23.887499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95790490-a331-4e5e-b138-cf7738d13d40 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:23.889719 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c95b12-1787-4457-bd93-4afc1e7d1c1e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:23.931779 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e025b66-c3f9-4898-89f8-a6df3bdb9ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:23.932747 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e025b66-c3f9-4898-89f8-a6df3bdb9ff9 None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:23.933035 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e025b66-c3f9-4898-89f8-a6df3bdb9ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:23.933309 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e025b66-c3f9-4898-89f8-a6df3bdb9ff9 None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c/groups/a9063f187e764e92ba327b1d7e6a805e/roles/cba01848eb624bfaaeeb1244e02e5bd7` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:23.935606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e025b66-c3f9-4898-89f8-a6df3bdb9ff9 None admin] RBAC: Authorizing `identity:create_grant(project_id=997175288e39489ead5929a225ecbf2c, group_id=a9063f187e764e92ba327b1d7e6a805e, role_id=cba01848eb624bfaaeeb1244e02e5bd7)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:23.937140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e025b66-c3f9-4898-89f8-a6df3bdb9ff9 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:24.009159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95790490-a331-4e5e-b138-cf7738d13d40 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:24.039188 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 214/415] 10.222.0.25 () {58 vars in 1442 bytes} [Thu May 12 06:31:23 2022] PUT /identity/v3/projects/997175288e39489ead5929a225ecbf2c/groups/a9063f187e764e92ba327b1d7e6a805e/roles/cba01848eb624bfaaeeb1244e02e5bd7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:31:24.042832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5ea2d-0128-4055-8c86-e17bd6479b38 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:24.044205 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5ea2d-0128-4055-8c86-e17bd6479b38 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:24.044943 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5ea2d-0128-4055-8c86-e17bd6479b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:24.067154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8bb73-9072-4e67-b748-eb14c085f09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:24.068549 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8bb73-9072-4e67-b748-eb14c085f09d None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:24.071001 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8bb73-9072-4e67-b748-eb14c085f09d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:24.071585 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8bb73-9072-4e67-b748-eb14c085f09d None admin] PATH_INFO: `/v3/projects/ce2018cacb6f4eb3a54694e57a783679/groups/6b8a5f35ac14435ca6e85d7dc472be08/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:24.077032 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8bb73-9072-4e67-b748-eb14c085f09d None admin] RBAC: Authorizing `identity:create_grant(project_id=ce2018cacb6f4eb3a54694e57a783679, group_id=6b8a5f35ac14435ca6e85d7dc472be08, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:24.081103 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8bb73-9072-4e67-b748-eb14c085f09d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:24.085554 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e5c5ea2d-0128-4055-8c86-e17bd6479b38 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:24.088429 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e5c5ea2d-0128-4055-8c86-e17bd6479b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:24.170493 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 202/416] 10.222.0.25 () {58 vars in 1442 bytes} [Thu May 12 06:31:23 2022] PUT /identity/v3/projects/ce2018cacb6f4eb3a54694e57a783679/groups/6b8a5f35ac14435ca6e85d7dc472be08/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:31:24.173699 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 215/417] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:24.212564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8bb73-9072-4e67-b748-eb14c085f09d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:24.335664 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8bb73-9072-4e67-b748-eb14c085f09d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:24.373977 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1a86e-580e-4fd8-b9ef-6fe655cd1103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:24.375165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1a86e-580e-4fd8-b9ef-6fe655cd1103 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:24.375677 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1a86e-580e-4fd8-b9ef-6fe655cd1103 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:24.376212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1a86e-580e-4fd8-b9ef-6fe655cd1103 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:24.387245 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1a86e-580e-4fd8-b9ef-6fe655cd1103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:24.395904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-bff1a86e-580e-4fd8-b9ef-6fe655cd1103 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:31:24.395904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:24.395904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:24.395904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:24.395904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:24.395904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:24.395904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:24.395904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:24.395904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:24.395904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:24.395904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:24.395904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:24.395904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:24.395904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:24.395904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:24.395904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:24.396826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:24.396826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:24.396826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:24.396826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:24.396826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:24.396826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:24.396826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:24.396826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:24.396826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:24.396826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:24.396826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:24.396826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:24.396826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:24.396826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:24.396826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:24.396826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:24.397642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:24.397642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:24.397642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:24.397642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:24.397642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:24.397642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:24.397642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:24.397642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:24.397642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:24.397642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:24.397642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:31:24.397642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:24.400552 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 203/418] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:31:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:24.406888 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5ea2d-0128-4055-8c86-e17bd6479b38 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:24.513513 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5ea2d-0128-4055-8c86-e17bd6479b38 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:24.551461 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d53246-28b6-4c2a-a414-a58f52167eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:24.552185 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d53246-28b6-4c2a-a414-a58f52167eef None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:24.552468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d53246-28b6-4c2a-a414-a58f52167eef None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:24.552739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d53246-28b6-4c2a-a414-a58f52167eef None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:24.553509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d53246-28b6-4c2a-a414-a58f52167eef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:24.553813 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d53246-28b6-4c2a-a414-a58f52167eef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:24.555313 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d53246-28b6-4c2a-a414-a58f52167eef None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:24.567799 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 216/419] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:24.572790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1a86e-580e-4fd8-b9ef-6fe655cd1103 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:24.699950 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1a86e-580e-4fd8-b9ef-6fe655cd1103 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:24.739109 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddf56d-912a-46ae-99c2-08ad526492af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:24.739795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddf56d-912a-46ae-99c2-08ad526492af None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:24.740078 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddf56d-912a-46ae-99c2-08ad526492af None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:24.740351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddf56d-912a-46ae-99c2-08ad526492af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:24.817619 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddf56d-912a-46ae-99c2-08ad526492af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:24.819088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddf56d-912a-46ae-99c2-08ad526492af None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:24.918482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 204/420] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:24.928772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d53246-28b6-4c2a-a414-a58f52167eef None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:25.058985 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d53246-28b6-4c2a-a414-a58f52167eef None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:25.099166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd990a48-af32-4bce-8726-e9100ed36a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:25.100063 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd990a48-af32-4bce-8726-e9100ed36a4f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:25.100346 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd990a48-af32-4bce-8726-e9100ed36a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:25.100619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd990a48-af32-4bce-8726-e9100ed36a4f None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:25.101887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd990a48-af32-4bce-8726-e9100ed36a4f None admin] RBAC: Authorizing `identity:get_project(project_id=0c3884c9c1c84b738e43a478898c36f8)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:25.103340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd990a48-af32-4bce-8726-e9100ed36a4f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:25.105053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 217/421] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:24 2022] GET /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:25.112783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddf56d-912a-46ae-99c2-08ad526492af None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:25.176643 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ac1fe-0b07-4ee7-bbc4-5465f53f9e8f None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:25.177301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ac1fe-0b07-4ee7-bbc4-5465f53f9e8f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:25.177779 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ac1fe-0b07-4ee7-bbc4-5465f53f9e8f None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:25.179356 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 218/422] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:25.184637 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd2e88-062d-41c1-a4a0-e3f9c6ea440a None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:25.184982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd2e88-062d-41c1-a4a0-e3f9c6ea440a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:25.185258 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd2e88-062d-41c1-a4a0-e3f9c6ea440a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:25.217072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-ccdd2e88-062d-41c1-a4a0-e3f9c6ea440a None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:25.218285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ccdd2e88-062d-41c1-a4a0-e3f9c6ea440a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:25.229491 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddf56d-912a-46ae-99c2-08ad526492af None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:25.263784 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadd20a-c949-4288-a97a-cab57d344a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:25.265246 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadd20a-c949-4288-a97a-cab57d344a4d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:25.265521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadd20a-c949-4288-a97a-cab57d344a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:25.265788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadd20a-c949-4288-a97a-cab57d344a4d None admin] PATH_INFO: `/v3/groups/a9063f187e764e92ba327b1d7e6a805e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:25.268835 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadd20a-c949-4288-a97a-cab57d344a4d None admin] RBAC: Authorizing `identity:get_group(group_id=a9063f187e764e92ba327b1d7e6a805e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:25.270290 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadd20a-c949-4288-a97a-cab57d344a4d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:25.271933 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 205/423] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 12 06:31:25 2022] GET /identity/v3/groups/a9063f187e764e92ba327b1d7e6a805e => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:25.280060 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadd20a-c949-4288-a97a-cab57d344a4d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:25.353852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 219/424] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:25.389088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadd20a-c949-4288-a97a-cab57d344a4d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:25.390723 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd2e88-062d-41c1-a4a0-e3f9c6ea440a None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:25.426224 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e032d-8f32-477f-8d3f-dd45f6cafbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:25.426886 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e032d-8f32-477f-8d3f-dd45f6cafbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:25.427161 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e032d-8f32-477f-8d3f-dd45f6cafbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:25.427430 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e032d-8f32-477f-8d3f-dd45f6cafbd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:25.428298 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e032d-8f32-477f-8d3f-dd45f6cafbd6 None admin] RBAC: Adding query filter params (group.id=a9063f187e764e92ba327b1d7e6a805e, role.id=cba01848eb624bfaaeeb1244e02e5bd7, scope.project.id=0c3884c9c1c84b738e43a478898c36f8) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:25.428607 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e032d-8f32-477f-8d3f-dd45f6cafbd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:25.430125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e032d-8f32-477f-8d3f-dd45f6cafbd6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:25.436903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 206/425] 10.222.0.25 () {56 vars in 1376 bytes} [Thu May 12 06:31:25 2022] GET /identity/v3/role_assignments?group.id=a9063f187e764e92ba327b1d7e6a805e&scope.project.id=0c3884c9c1c84b738e43a478898c36f8&role.id=cba01848eb624bfaaeeb1244e02e5bd7 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:25.527743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd2e88-062d-41c1-a4a0-e3f9c6ea440a None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:25.564794 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0effd1b-4b2d-4f30-8b3e-93dfe311b6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:25.565628 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0effd1b-4b2d-4f30-8b3e-93dfe311b6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:25.565909 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0effd1b-4b2d-4f30-8b3e-93dfe311b6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:25.566187 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0effd1b-4b2d-4f30-8b3e-93dfe311b6c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:25.579324 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0effd1b-4b2d-4f30-8b3e-93dfe311b6c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:25.587922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-f0effd1b-4b2d-4f30-8b3e-93dfe311b6c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:25.587922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:25.587922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:25.587922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:25.587922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:25.587922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:25.587922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:25.587922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:25.587922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:25.587922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:25.587922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:25.587922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:25.587922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:25.587922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:25.587922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:25.587922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:25.588883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:25.588883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:25.588883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:25.588883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:25.588883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:25.588883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:25.588883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:25.588883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:25.588883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:25.588883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:25.588883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:25.588883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:25.588883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:25.588883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:25.588883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:25.588883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:25.589716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:25.589716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:25.589716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:25.589716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:25.589716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:25.589716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:25.589716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:25.589716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:25.589716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:25.589716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:25.589716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:25.589716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:25.592697 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 220/426] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:31:25.599810 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e032d-8f32-477f-8d3f-dd45f6cafbd6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:25.748154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e032d-8f32-477f-8d3f-dd45f6cafbd6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:25.787952 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b587c-e5b0-4361-93a2-96426fd41b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:25.788955 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b587c-e5b0-4361-93a2-96426fd41b6d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:25.789549 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b587c-e5b0-4361-93a2-96426fd41b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:25.790304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b587c-e5b0-4361-93a2-96426fd41b6d None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:25.791274 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b587c-e5b0-4361-93a2-96426fd41b6d None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:25.791818 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b587c-e5b0-4361-93a2-96426fd41b6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:25.794732 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b587c-e5b0-4361-93a2-96426fd41b6d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:25.808134 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 207/427] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:31:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:25.813249 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0effd1b-4b2d-4f30-8b3e-93dfe311b6c3 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:25.918384 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0effd1b-4b2d-4f30-8b3e-93dfe311b6c3 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:25.952922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08137f6-d795-48bb-a480-544def759285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:25.954345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08137f6-d795-48bb-a480-544def759285 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:25.954830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08137f6-d795-48bb-a480-544def759285 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:25.955303 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08137f6-d795-48bb-a480-544def759285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:26.024773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08137f6-d795-48bb-a480-544def759285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:26.026246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08137f6-d795-48bb-a480-544def759285 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:26.130850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 221/428] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:26.136097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b587c-e5b0-4361-93a2-96426fd41b6d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:26.234603 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b587c-e5b0-4361-93a2-96426fd41b6d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:26.258705 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb368b74-900a-4568-b290-e28d1b95d1f0 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:26.259013 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb368b74-900a-4568-b290-e28d1b95d1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:26.259257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb368b74-900a-4568-b290-e28d1b95d1f0 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:26.260906 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 222/429] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:31:26.265863 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105100d-cbd5-4474-954e-a876d2a03781 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:26.266150 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105100d-cbd5-4474-954e-a876d2a03781 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:26.266415 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105100d-cbd5-4474-954e-a876d2a03781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:26.270000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4765ae-a2cb-4040-88af-4e51d4d82fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:26.270859 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4765ae-a2cb-4040-88af-4e51d4d82fcc None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:26.271143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4765ae-a2cb-4040-88af-4e51d4d82fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:26.271420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4765ae-a2cb-4040-88af-4e51d4d82fcc None admin] PATH_INFO: `/v3/projects/0c3884c9c1c84b738e43a478898c36f8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:26.272658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4765ae-a2cb-4040-88af-4e51d4d82fcc None admin] RBAC: Authorizing `identity:get_project(project_id=0c3884c9c1c84b738e43a478898c36f8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:26.274642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4765ae-a2cb-4040-88af-4e51d4d82fcc None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:26.276715 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 208/430] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:26 2022] GET /identity/v3/projects/0c3884c9c1c84b738e43a478898c36f8 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:26.281937 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4765ae-a2cb-4040-88af-4e51d4d82fcc None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:26.284321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d105100d-cbd5-4474-954e-a876d2a03781 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:26.285494 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d105100d-cbd5-4474-954e-a876d2a03781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:26.360787 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 223/431] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:26.379815 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105100d-cbd5-4474-954e-a876d2a03781 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:26.381105 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4765ae-a2cb-4040-88af-4e51d4d82fcc None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:26.414679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea6e1b-2f35-4507-9a8a-020763927485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:26.415806 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea6e1b-2f35-4507-9a8a-020763927485 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:26.416084 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea6e1b-2f35-4507-9a8a-020763927485 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:26.416351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea6e1b-2f35-4507-9a8a-020763927485 None admin] PATH_INFO: `/v3/groups/a9063f187e764e92ba327b1d7e6a805e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:26.417544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea6e1b-2f35-4507-9a8a-020763927485 None admin] RBAC: Authorizing `identity:get_group(group_id=a9063f187e764e92ba327b1d7e6a805e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:26.418985 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea6e1b-2f35-4507-9a8a-020763927485 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:26.420936 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 209/432] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 12 06:31:26 2022] GET /identity/v3/groups/a9063f187e764e92ba327b1d7e6a805e => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:26.426527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea6e1b-2f35-4507-9a8a-020763927485 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:26.484166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105100d-cbd5-4474-954e-a876d2a03781 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:26.518826 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d592c5-5b51-4a0f-8241-e44c933bdf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:26.519703 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d592c5-5b51-4a0f-8241-e44c933bdf4a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:26.519997 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d592c5-5b51-4a0f-8241-e44c933bdf4a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:26.520267 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d592c5-5b51-4a0f-8241-e44c933bdf4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:26.530381 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea6e1b-2f35-4507-9a8a-020763927485 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:26.533320 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d592c5-5b51-4a0f-8241-e44c933bdf4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:26.543178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-79d592c5-5b51-4a0f-8241-e44c933bdf4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:26.543178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:26.543178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:26.543178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:26.543178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:26.543178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:26.543178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:26.543178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:26.543178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:26.543178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:26.543178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:26.543178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:26.543178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:26.543178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:26.543178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:26.543178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:26.545445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:26.545445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:26.545445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:26.545445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:26.545445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:26.545445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:26.545445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:26.545445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:26.545445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:26.545445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:26.545445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:26.545445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:26.545445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:26.545445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:26.545445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:26.545445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:26.547462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:26.547462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:26.547462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:26.547462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:26.547462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:26.547462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:26.547462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:26.547462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:26.547462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:26.547462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:26.547462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 06:31:26.547462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:26.555714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 224/433] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:31:26.555714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d592c5-5b51-4a0f-8241-e44c933bdf4a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:26.567609 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a6c21-f75b-4b39-a119-9d69962bcf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:26.568294 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a6c21-f75b-4b39-a119-9d69962bcf9b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:26.568575 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a6c21-f75b-4b39-a119-9d69962bcf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:26.568848 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a6c21-f75b-4b39-a119-9d69962bcf9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:26.569686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a6c21-f75b-4b39-a119-9d69962bcf9b None admin] RBAC: Adding query filter params (group.id=a9063f187e764e92ba327b1d7e6a805e, role.id=2162d563a5344c26821a7961cb75468b, scope.project.id=0c3884c9c1c84b738e43a478898c36f8) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:26.569995 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a6c21-f75b-4b39-a119-9d69962bcf9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:26.571514 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a6c21-f75b-4b39-a119-9d69962bcf9b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:26.577450 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 210/434] 10.222.0.25 () {56 vars in 1376 bytes} [Thu May 12 06:31:26 2022] GET /identity/v3/role_assignments?group.id=a9063f187e764e92ba327b1d7e6a805e&scope.project.id=0c3884c9c1c84b738e43a478898c36f8&role.id=2162d563a5344c26821a7961cb75468b => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:26.664792 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d592c5-5b51-4a0f-8241-e44c933bdf4a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:26.702420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dcc1a-dfc7-4a73-8bc2-769ae73a678a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:26.703110 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dcc1a-dfc7-4a73-8bc2-769ae73a678a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:26.703391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dcc1a-dfc7-4a73-8bc2-769ae73a678a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:26.703663 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dcc1a-dfc7-4a73-8bc2-769ae73a678a None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:26.704460 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dcc1a-dfc7-4a73-8bc2-769ae73a678a None admin] RBAC: Adding query filter params (name=member) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:26.704837 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dcc1a-dfc7-4a73-8bc2-769ae73a678a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:26.706323 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dcc1a-dfc7-4a73-8bc2-769ae73a678a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:26.716778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 225/435] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:31:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:26.722400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a6c21-f75b-4b39-a119-9d69962bcf9b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:26.733473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde1b0a-8230-4940-af19-a64b41fd3eb1 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:26.733473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde1b0a-8230-4940-af19-a64b41fd3eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:26.733473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde1b0a-8230-4940-af19-a64b41fd3eb1 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:26.733473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 226/436] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:31:26.737951 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be9c5b-0242-4f8f-94ae-e0bbfc72f804 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:26.738512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be9c5b-0242-4f8f-94ae-e0bbfc72f804 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:26.738920 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be9c5b-0242-4f8f-94ae-e0bbfc72f804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:26.756808 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-68be9c5b-0242-4f8f-94ae-e0bbfc72f804 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:26.758811 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-68be9c5b-0242-4f8f-94ae-e0bbfc72f804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:26.846540 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 227/437] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:31:26.850308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a6c21-f75b-4b39-a119-9d69962bcf9b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:26.871511 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be9c5b-0242-4f8f-94ae-e0bbfc72f804 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:26.893980 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6ee16-cddf-42f8-a206-0d2b6dc6e5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:26.894789 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6ee16-cddf-42f8-a206-0d2b6dc6e5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:26.895176 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6ee16-cddf-42f8-a206-0d2b6dc6e5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:26.895549 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6ee16-cddf-42f8-a206-0d2b6dc6e5b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:26.986507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6ee16-cddf-42f8-a206-0d2b6dc6e5b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:26.990664 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6ee16-cddf-42f8-a206-0d2b6dc6e5b4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:27.007604 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be9c5b-0242-4f8f-94ae-e0bbfc72f804 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:27.053024 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d0438-21fb-4061-b0a0-6121cf4829ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:27.053840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d0438-21fb-4061-b0a0-6121cf4829ac None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:27.054116 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d0438-21fb-4061-b0a0-6121cf4829ac None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:27.054381 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d0438-21fb-4061-b0a0-6121cf4829ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:27.068951 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d0438-21fb-4061-b0a0-6121cf4829ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:27.077191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-481d0438-21fb-4061-b0a0-6121cf4829ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:31:27.077191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:27.077191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:27.077191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:27.077191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:27.077191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:27.077191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:27.077191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:27.077191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:27.077191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:27.077191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:27.077191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:27.077191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:27.077191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:27.077191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:27.077191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:27.078102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:27.078102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:27.078102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:27.078102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:27.078102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:27.078102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:27.078102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:27.078102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:27.078102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:27.078102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:27.078102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:27.078102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:27.078102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:27.078102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:27.078102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:27.078102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:27.078935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:27.078935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:27.078935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:27.078935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:27.078935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:27.078935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:27.078935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:27.078935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:27.078935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:27.078935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:27.078935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:31:27.078935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:27.078935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 228/438] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:31:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:31:27.080112 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20298b-ba20-440b-9b04-952976e3d33b None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:27.080112 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20298b-ba20-440b-9b04-952976e3d33b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:27.080262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20298b-ba20-440b-9b04-952976e3d33b None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:27.081611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 229/439] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:27.086713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20298b-ba20-440b-9b04-952976e3d33b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:27.101725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 211/440] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:27.103458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a1216-5a43-44a7-a71d-81cccaafee80 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:27.103873 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a1216-5a43-44a7-a71d-81cccaafee80 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:27.104127 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a1216-5a43-44a7-a71d-81cccaafee80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:27.122212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-956a1216-5a43-44a7-a71d-81cccaafee80 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:27.123421 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-956a1216-5a43-44a7-a71d-81cccaafee80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:27.201703 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20298b-ba20-440b-9b04-952976e3d33b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:27.201898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 212/441] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:27.202591 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a1216-5a43-44a7-a71d-81cccaafee80 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:27.237857 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4ca6a-c419-4c8f-a24a-857f82602a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:27.238447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4ca6a-c419-4c8f-a24a-857f82602a6a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:27.238724 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4ca6a-c419-4c8f-a24a-857f82602a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:27.238994 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4ca6a-c419-4c8f-a24a-857f82602a6a None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:27.239761 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4ca6a-c419-4c8f-a24a-857f82602a6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:27.240067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4ca6a-c419-4c8f-a24a-857f82602a6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:27.241406 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4ca6a-c419-4c8f-a24a-857f82602a6a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:27.249454 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 230/442] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:27.250216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4ca6a-c419-4c8f-a24a-857f82602a6a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:27.296420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a1216-5a43-44a7-a71d-81cccaafee80 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:27.328765 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdff24c-d99e-4380-9e38-d2a6d9a5a3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:27.329617 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdff24c-d99e-4380-9e38-d2a6d9a5a3ed None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:27.329904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdff24c-d99e-4380-9e38-d2a6d9a5a3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:27.330167 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdff24c-d99e-4380-9e38-d2a6d9a5a3ed None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:27.331389 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdff24c-d99e-4380-9e38-d2a6d9a5a3ed None admin] RBAC: Authorizing `identity:get_project(project_id=997175288e39489ead5929a225ecbf2c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:27.333710 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdff24c-d99e-4380-9e38-d2a6d9a5a3ed None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:27.334704 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 213/443] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:27 2022] GET /identity/v3/projects/997175288e39489ead5929a225ecbf2c => generated 302 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:27.335393 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdff24c-d99e-4380-9e38-d2a6d9a5a3ed None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:27.344279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4ca6a-c419-4c8f-a24a-857f82602a6a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:27.376237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6468e-1cea-436a-8f3a-4b1dae551451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:27.377117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6468e-1cea-436a-8f3a-4b1dae551451 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:27.377395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6468e-1cea-436a-8f3a-4b1dae551451 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:27.377661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6468e-1cea-436a-8f3a-4b1dae551451 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:27.387368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6468e-1cea-436a-8f3a-4b1dae551451 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:27.395065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-80f6468e-1cea-436a-8f3a-4b1dae551451 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:31:27.395065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:27.395065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:27.395065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:27.395065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:27.395065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:27.395065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:27.395065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:27.395065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:27.395065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:27.395065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:27.395065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:27.395065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:27.395065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:27.395065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:27.395065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:27.396235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:27.396235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:27.396235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:27.396235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:27.396235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:27.396235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:27.396235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:27.396235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:27.396235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:27.396235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:27.396235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:27.396235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:27.396235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:27.396235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:27.396235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:27.396235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:27.397038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:27.397038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:27.397038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:27.397038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:27.397038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:27.397038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:27.397038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:27.397038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:27.397038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:27.397038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:27.397038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:31:27.397038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:27.397038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 231/444] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:31:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:27.397038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6468e-1cea-436a-8f3a-4b1dae551451 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:27.431112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdff24c-d99e-4380-9e38-d2a6d9a5a3ed None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:27.464017 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eaa1ab-41ba-4845-baf6-8615b6a414f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:27.464658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eaa1ab-41ba-4845-baf6-8615b6a414f8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:27.464940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eaa1ab-41ba-4845-baf6-8615b6a414f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:27.465211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eaa1ab-41ba-4845-baf6-8615b6a414f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:27.488868 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6468e-1cea-436a-8f3a-4b1dae551451 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:27.520578 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba44b22-8801-4b1b-9aff-66359e30764d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:27.521405 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba44b22-8801-4b1b-9aff-66359e30764d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:27.521679 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba44b22-8801-4b1b-9aff-66359e30764d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:27.521950 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba44b22-8801-4b1b-9aff-66359e30764d None admin] PATH_INFO: `/v3/groups/a9063f187e764e92ba327b1d7e6a805e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:27.523110 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba44b22-8801-4b1b-9aff-66359e30764d None admin] RBAC: Authorizing `identity:get_group(group_id=a9063f187e764e92ba327b1d7e6a805e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:27.525148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba44b22-8801-4b1b-9aff-66359e30764d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:27.526910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 232/445] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 12 06:31:27 2022] GET /identity/v3/groups/a9063f187e764e92ba327b1d7e6a805e => generated 226 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:27.527480 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba44b22-8801-4b1b-9aff-66359e30764d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:27.532613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eaa1ab-41ba-4845-baf6-8615b6a414f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:27.534080 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eaa1ab-41ba-4845-baf6-8615b6a414f8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:27.618196 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba44b22-8801-4b1b-9aff-66359e30764d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:27.625362 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 214/446] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:27.626181 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eaa1ab-41ba-4845-baf6-8615b6a414f8 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:27.650016 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35536a61-6691-4da4-b1bd-d3b477f966af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:27.650670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35536a61-6691-4da4-b1bd-d3b477f966af None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:27.650949 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35536a61-6691-4da4-b1bd-d3b477f966af None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:27.651219 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35536a61-6691-4da4-b1bd-d3b477f966af None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:27.652000 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35536a61-6691-4da4-b1bd-d3b477f966af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:27.652304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35536a61-6691-4da4-b1bd-d3b477f966af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:27.653652 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35536a61-6691-4da4-b1bd-d3b477f966af None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:27.661665 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 233/447] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:27.662432 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35536a61-6691-4da4-b1bd-d3b477f966af None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:27.719220 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eaa1ab-41ba-4845-baf6-8615b6a414f8 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:27.751204 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b07d0-22d8-4459-8533-d5512880e6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:27.751883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b07d0-22d8-4459-8533-d5512880e6c1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:27.752169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b07d0-22d8-4459-8533-d5512880e6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:27.752443 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b07d0-22d8-4459-8533-d5512880e6c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:27.753310 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b07d0-22d8-4459-8533-d5512880e6c1 None admin] RBAC: Adding query filter params (group.id=a9063f187e764e92ba327b1d7e6a805e, role.id=2162d563a5344c26821a7961cb75468b, scope.project.id=997175288e39489ead5929a225ecbf2c) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:27.753619 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b07d0-22d8-4459-8533-d5512880e6c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:27.754544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35536a61-6691-4da4-b1bd-d3b477f966af None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:27.755039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b07d0-22d8-4459-8533-d5512880e6c1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:27.760759 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 215/448] 10.222.0.25 () {56 vars in 1376 bytes} [Thu May 12 06:31:27 2022] GET /identity/v3/role_assignments?group.id=a9063f187e764e92ba327b1d7e6a805e&scope.project.id=997175288e39489ead5929a225ecbf2c&role.id=2162d563a5344c26821a7961cb75468b => generated 611 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:27.761540 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b07d0-22d8-4459-8533-d5512880e6c1 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:27.789055 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b260e05-2109-4192-9559-4b46c9fe8bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:27.790811 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b260e05-2109-4192-9559-4b46c9fe8bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:27.791100 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b260e05-2109-4192-9559-4b46c9fe8bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:27.791379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b260e05-2109-4192-9559-4b46c9fe8bb9 None admin] PATH_INFO: `/v3/projects/997175288e39489ead5929a225ecbf2c` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:27.792736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b260e05-2109-4192-9559-4b46c9fe8bb9 None admin] RBAC: Authorizing `identity:get_project(project_id=997175288e39489ead5929a225ecbf2c)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:27.794231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b260e05-2109-4192-9559-4b46c9fe8bb9 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:27.796078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 234/449] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:27 2022] GET /identity/v3/projects/997175288e39489ead5929a225ecbf2c => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:27.801681 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b260e05-2109-4192-9559-4b46c9fe8bb9 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:27.868860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b07d0-22d8-4459-8533-d5512880e6c1 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:27.903875 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cff5ae-a80e-463d-8848-5ed0154a8db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:27.904542 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cff5ae-a80e-463d-8848-5ed0154a8db6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:27.904826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cff5ae-a80e-463d-8848-5ed0154a8db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:27.904986 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b260e05-2109-4192-9559-4b46c9fe8bb9 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:27.905084 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cff5ae-a80e-463d-8848-5ed0154a8db6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:27.940848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01539021-b193-4d74-a1be-a3a210f288c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:27.941822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01539021-b193-4d74-a1be-a3a210f288c0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:27.943118 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01539021-b193-4d74-a1be-a3a210f288c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:27.943118 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01539021-b193-4d74-a1be-a3a210f288c0 None admin] PATH_INFO: `/v3/groups/a9063f187e764e92ba327b1d7e6a805e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:27.943577 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01539021-b193-4d74-a1be-a3a210f288c0 None admin] RBAC: Authorizing `identity:get_group(group_id=a9063f187e764e92ba327b1d7e6a805e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:27.945071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01539021-b193-4d74-a1be-a3a210f288c0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:27.946855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 235/450] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 12 06:31:27 2022] GET /identity/v3/groups/a9063f187e764e92ba327b1d7e6a805e => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:27.952905 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01539021-b193-4d74-a1be-a3a210f288c0 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:27.983621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cff5ae-a80e-463d-8848-5ed0154a8db6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:27.985142 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cff5ae-a80e-463d-8848-5ed0154a8db6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:28.062821 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01539021-b193-4d74-a1be-a3a210f288c0 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:28.098838 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fb1fb-2d95-42f9-8760-52ffdb5e6d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:28.099501 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fb1fb-2d95-42f9-8760-52ffdb5e6d99 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:28.099836 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fb1fb-2d95-42f9-8760-52ffdb5e6d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:28.100117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fb1fb-2d95-42f9-8760-52ffdb5e6d99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:28.100958 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fb1fb-2d95-42f9-8760-52ffdb5e6d99 None admin] RBAC: Adding query filter params (group.id=a9063f187e764e92ba327b1d7e6a805e, role.id=cba01848eb624bfaaeeb1244e02e5bd7, scope.project.id=997175288e39489ead5929a225ecbf2c) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:28.101269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fb1fb-2d95-42f9-8760-52ffdb5e6d99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:28.102769 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fb1fb-2d95-42f9-8760-52ffdb5e6d99 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:28.107788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 216/451] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:28.110350 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 236/452] 10.222.0.25 () {56 vars in 1376 bytes} [Thu May 12 06:31:27 2022] GET /identity/v3/role_assignments?group.id=a9063f187e764e92ba327b1d7e6a805e&scope.project.id=997175288e39489ead5929a225ecbf2c&role.id=cba01848eb624bfaaeeb1244e02e5bd7 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:28.114172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cff5ae-a80e-463d-8848-5ed0154a8db6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:28.220984 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cff5ae-a80e-463d-8848-5ed0154a8db6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:28.255592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ea771-958a-4c04-ba3a-e0943a3e7105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:28.256480 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ea771-958a-4c04-ba3a-e0943a3e7105 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:28.256763 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ea771-958a-4c04-ba3a-e0943a3e7105 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:28.257036 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ea771-958a-4c04-ba3a-e0943a3e7105 None admin] PATH_INFO: `/v3/projects/ce2018cacb6f4eb3a54694e57a783679` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:28.258811 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ea771-958a-4c04-ba3a-e0943a3e7105 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2018cacb6f4eb3a54694e57a783679)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:28.260321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ea771-958a-4c04-ba3a-e0943a3e7105 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:28.262065 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 217/453] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:31:28 2022] GET /identity/v3/projects/ce2018cacb6f4eb3a54694e57a783679 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:28.267854 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fb1fb-2d95-42f9-8760-52ffdb5e6d99 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:28.368831 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fb1fb-2d95-42f9-8760-52ffdb5e6d99 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:28.400533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04eebb-30b7-44df-b866-21f39bd66d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:28.401387 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04eebb-30b7-44df-b866-21f39bd66d62 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:28.401665 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04eebb-30b7-44df-b866-21f39bd66d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:28.401935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04eebb-30b7-44df-b866-21f39bd66d62 None admin] PATH_INFO: `/v3/groups/6b8a5f35ac14435ca6e85d7dc472be08` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:28.403091 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04eebb-30b7-44df-b866-21f39bd66d62 None admin] RBAC: Authorizing `identity:get_group(group_id=6b8a5f35ac14435ca6e85d7dc472be08)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:28.404547 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04eebb-30b7-44df-b866-21f39bd66d62 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:28.406149 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 237/454] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 12 06:31:28 2022] GET /identity/v3/groups/6b8a5f35ac14435ca6e85d7dc472be08 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:28.411973 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ea771-958a-4c04-ba3a-e0943a3e7105 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:28.515766 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ea771-958a-4c04-ba3a-e0943a3e7105 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:28.548580 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402444c0-4f47-4ab2-83fe-8c49cbf231a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:28.549232 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402444c0-4f47-4ab2-83fe-8c49cbf231a9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:28.549513 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402444c0-4f47-4ab2-83fe-8c49cbf231a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:28.549786 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402444c0-4f47-4ab2-83fe-8c49cbf231a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:28.550620 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402444c0-4f47-4ab2-83fe-8c49cbf231a9 None admin] RBAC: Adding query filter params (group.id=6b8a5f35ac14435ca6e85d7dc472be08, role.id=5e6a73052f3b4ee7829ecb858925e5ca, scope.project.id=ce2018cacb6f4eb3a54694e57a783679) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:28.550929 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402444c0-4f47-4ab2-83fe-8c49cbf231a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:28.552384 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402444c0-4f47-4ab2-83fe-8c49cbf231a9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:28.558421 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 218/455] 10.222.0.25 () {56 vars in 1376 bytes} [Thu May 12 06:31:28 2022] GET /identity/v3/role_assignments?group.id=6b8a5f35ac14435ca6e85d7dc472be08&scope.project.id=ce2018cacb6f4eb3a54694e57a783679&role.id=5e6a73052f3b4ee7829ecb858925e5ca => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:31.419612 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4205f-dc82-470e-8ee9-0962dfa48f26 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:31.420144 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4205f-dc82-470e-8ee9-0962dfa48f26 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:31.420144 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4205f-dc82-470e-8ee9-0962dfa48f26 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:31.421753 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 238/456] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:31.427717 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5c411-46f0-4e2b-8734-2343555f02f9 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:31.428220 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5c411-46f0-4e2b-8734-2343555f02f9 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:31.428294 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5c411-46f0-4e2b-8734-2343555f02f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:31.452734 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-97c5c411-46f0-4e2b-8734-2343555f02f9 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:31.453944 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-97c5c411-46f0-4e2b-8734-2343555f02f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:31.538227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 219/457] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:31.574531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4205f-dc82-470e-8ee9-0962dfa48f26 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:31.609020 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd316b-bda8-4dfe-aab8-7e0d92a09f69 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:31.609449 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd316b-bda8-4dfe-aab8-7e0d92a09f69 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:31.609724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd316b-bda8-4dfe-aab8-7e0d92a09f69 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:31.611903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 220/458] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:31.617512 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f9b0e-f78b-4550-a915-11823b38e034 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:31.618024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f9b0e-f78b-4550-a915-11823b38e034 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:31.618508 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f9b0e-f78b-4550-a915-11823b38e034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:31.642248 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8d8f9b0e-f78b-4550-a915-11823b38e034 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:31.643460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8d8f9b0e-f78b-4550-a915-11823b38e034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:31.737404 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4205f-dc82-470e-8ee9-0962dfa48f26 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:31.763850 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 221/459] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:31:31.765486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ad234-6070-4f84-b7ce-87dfe8418d02 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:31.765929 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ad234-6070-4f84-b7ce-87dfe8418d02 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:31.766252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ad234-6070-4f84-b7ce-87dfe8418d02 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:31.771742 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 222/460] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:31.774094 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4822d-8304-4fa5-a796-4afcabdaf9ec None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:31.774373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4822d-8304-4fa5-a796-4afcabdaf9ec None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:31.774643 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4822d-8304-4fa5-a796-4afcabdaf9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:31.783787 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e453b-1f16-4520-8337-b6b830c12143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:31.784856 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e453b-1f16-4520-8337-b6b830c12143 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:31.785334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e453b-1f16-4520-8337-b6b830c12143 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:31.785802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e453b-1f16-4520-8337-b6b830c12143 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:31.792011 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-18f4822d-8304-4fa5-a796-4afcabdaf9ec None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:31.793190 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-18f4822d-8304-4fa5-a796-4afcabdaf9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:31.797726 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e453b-1f16-4520-8337-b6b830c12143 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:31.799458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e453b-1f16-4520-8337-b6b830c12143 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:31.817848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-c48e453b-1f16-4520-8337-b6b830c12143 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:31.817848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:31.817848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:31.817848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:31.817848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:31.817848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:31.817848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:31.817848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:31.817848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:31.817848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:31.817848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:31.817848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:31.817848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:31.817848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:31.817848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:31.818758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:31.818758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:31.818758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:31.818758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:31.818758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:31.818758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:31.818758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:31.818758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:31.818758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:31.818758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:31.818758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:31.818758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:31.818758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:31.818758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:31.818758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:31.818758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:31.818758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:31.819595 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:31.819595 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:31.819595 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:31.819595 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:31.821884 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 239/461] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:31.822890 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e453b-1f16-4520-8337-b6b830c12143 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:31.865265 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 223/462] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:31:31.866432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4822d-8304-4fa5-a796-4afcabdaf9ec None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:31.934608 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e453b-1f16-4520-8337-b6b830c12143 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:31.968305 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7520283-a75a-4201-bcfa-f4dcbad8e7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:31.969096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7520283-a75a-4201-bcfa-f4dcbad8e7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:31.969371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7520283-a75a-4201-bcfa-f4dcbad8e7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:31.969640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7520283-a75a-4201-bcfa-f4dcbad8e7c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:31.969841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4822d-8304-4fa5-a796-4afcabdaf9ec None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:31.980384 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7520283-a75a-4201-bcfa-f4dcbad8e7c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:31.981812 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7520283-a75a-4201-bcfa-f4dcbad8e7c0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:31.998807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-f7520283-a75a-4201-bcfa-f4dcbad8e7c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:31.998807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:31.998807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:31.998807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:31.998807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:31.998807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:31.998807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:31.998807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:31.998807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:31.998807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:31.998807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:31.998807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:31.998807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:31.998807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:31.998807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:31.999894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:31.999894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:31.999894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:31.999894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:31.999894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:31.999894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:31.999894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:31.999894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:31.999894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:31.999894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:31.999894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:31.999894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:31.999894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:31.999894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:31.999894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:31.999894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:31.999894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:32.000785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:32.000785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:32.000785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:32.000785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:32.000785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 240/463] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:32.001625 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62462be9-c43c-494b-8056-d5bd4a3b332a None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:32.001835 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62462be9-c43c-494b-8056-d5bd4a3b332a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:32.002217 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62462be9-c43c-494b-8056-d5bd4a3b332a None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:32.003611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 241/464] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:32.004163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62462be9-c43c-494b-8056-d5bd4a3b332a None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:32.017364 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811349d0-24fe-41f4-9f9d-eb158b33ab06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:32.018032 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811349d0-24fe-41f4-9f9d-eb158b33ab06 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:32.018599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811349d0-24fe-41f4-9f9d-eb158b33ab06 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:32.018599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811349d0-24fe-41f4-9f9d-eb158b33ab06 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:32.019297 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811349d0-24fe-41f4-9f9d-eb158b33ab06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:32.019603 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811349d0-24fe-41f4-9f9d-eb158b33ab06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:32.021005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811349d0-24fe-41f4-9f9d-eb158b33ab06 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:32.043650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 224/465] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:32.043650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc1635-1dcb-4147-8fc4-0c28f74c30ae None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:32.043650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc1635-1dcb-4147-8fc4-0c28f74c30ae None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:32.043650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc1635-1dcb-4147-8fc4-0c28f74c30ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:32.058693 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-65cc1635-1dcb-4147-8fc4-0c28f74c30ae None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:32.059922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-65cc1635-1dcb-4147-8fc4-0c28f74c30ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:32.109624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62462be9-c43c-494b-8056-d5bd4a3b332a None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:32.123484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 225/466] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:32.124736 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc1635-1dcb-4147-8fc4-0c28f74c30ae None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:32.154472 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9defcd5-aa32-40ef-9dc7-12134db3d92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:32.155259 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9defcd5-aa32-40ef-9dc7-12134db3d92a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:32.155538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9defcd5-aa32-40ef-9dc7-12134db3d92a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:32.155856 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9defcd5-aa32-40ef-9dc7-12134db3d92a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:32.166839 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9defcd5-aa32-40ef-9dc7-12134db3d92a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:32.168316 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9defcd5-aa32-40ef-9dc7-12134db3d92a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:32.185071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-a9defcd5-aa32-40ef-9dc7-12134db3d92a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:32.185071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:32.185071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:32.185071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:32.185071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:32.185071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:32.185071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:32.185071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:32.185071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:32.185071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:32.185071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:32.185071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:32.185071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:32.185071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:32.185071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:32.185947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:32.185947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:32.185947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:32.185947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:32.185947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:32.185947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:32.185947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:32.185947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:32.185947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:32.185947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:32.185947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:32.185947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:32.185947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:32.185947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:32.185947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:32.185947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:32.185947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:32.186838 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:32.186838 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:32.186838 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:32.186838 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:32.186838 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 242/467] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:32.187109 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9defcd5-aa32-40ef-9dc7-12134db3d92a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:32.226952 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc1635-1dcb-4147-8fc4-0c28f74c30ae None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:32.259824 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bb803-34b6-484f-b3cd-f1188a3216ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:32.260406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bb803-34b6-484f-b3cd-f1188a3216ff None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:32.260683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bb803-34b6-484f-b3cd-f1188a3216ff None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:32.260950 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bb803-34b6-484f-b3cd-f1188a3216ff None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:32.261669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bb803-34b6-484f-b3cd-f1188a3216ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:32.261965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bb803-34b6-484f-b3cd-f1188a3216ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:32.263329 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bb803-34b6-484f-b3cd-f1188a3216ff None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:32.278815 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 226/468] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:32.278815 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bb803-34b6-484f-b3cd-f1188a3216ff None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:32.287841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9defcd5-aa32-40ef-9dc7-12134db3d92a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:32.319920 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c1f39-8627-4963-9f83-7d1d140c6895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:32.320614 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c1f39-8627-4963-9f83-7d1d140c6895 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:32.320887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c1f39-8627-4963-9f83-7d1d140c6895 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:32.321172 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c1f39-8627-4963-9f83-7d1d140c6895 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:32.321886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c1f39-8627-4963-9f83-7d1d140c6895 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:32.323372 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c1f39-8627-4963-9f83-7d1d140c6895 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:32.380201 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bb803-34b6-484f-b3cd-f1188a3216ff None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:32.387930 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 243/469] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 12 06:31:32 2022] POST /identity/v3/users => generated 246 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:31:32.388883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c1f39-8627-4963-9f83-7d1d140c6895 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:32.426525 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d043f-06ca-4a8f-86b4-5d2db38de339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:32.427837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d043f-06ca-4a8f-86b4-5d2db38de339 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:32.428819 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d043f-06ca-4a8f-86b4-5d2db38de339 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:32.429308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d043f-06ca-4a8f-86b4-5d2db38de339 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:32.442217 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d043f-06ca-4a8f-86b4-5d2db38de339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:32.444281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d043f-06ca-4a8f-86b4-5d2db38de339 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:32.465304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-0e4d043f-06ca-4a8f-86b4-5d2db38de339 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:32.465304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:32.465304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:32.465304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:32.465304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:32.465304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:32.465304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:32.465304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:32.465304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:32.465304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:32.465304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:32.465304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:32.465304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:32.465304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:32.465304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:32.466233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:32.466233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:32.466233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:32.466233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:32.466233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:32.466233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:32.466233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:32.466233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:32.466233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:32.466233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:32.466233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:32.466233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:32.466233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:32.466233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:32.466233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:32.466233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:32.466233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:32.467092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:32.467092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:32.467092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:32.467092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:32.469577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 227/470] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:32.470743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d043f-06ca-4a8f-86b4-5d2db38de339 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:32.500296 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c1f39-8627-4963-9f83-7d1d140c6895 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:32.536373 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f453990-08c7-4a40-a7da-cb6d3f6ef00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:32.536973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f453990-08c7-4a40-a7da-cb6d3f6ef00c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:32.537247 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f453990-08c7-4a40-a7da-cb6d3f6ef00c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:32.537513 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f453990-08c7-4a40-a7da-cb6d3f6ef00c None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:32.538250 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f453990-08c7-4a40-a7da-cb6d3f6ef00c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:32.538551 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f453990-08c7-4a40-a7da-cb6d3f6ef00c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:32.540582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f453990-08c7-4a40-a7da-cb6d3f6ef00c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:32.553172 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 244/471] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:32.554196 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f453990-08c7-4a40-a7da-cb6d3f6ef00c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:32.580823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d043f-06ca-4a8f-86b4-5d2db38de339 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:32.618106 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990f3de-d098-4d8b-987b-32549b5c71a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:32.618838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990f3de-d098-4d8b-987b-32549b5c71a7 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:32.619126 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990f3de-d098-4d8b-987b-32549b5c71a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:32.619401 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990f3de-d098-4d8b-987b-32549b5c71a7 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:32.620422 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990f3de-d098-4d8b-987b-32549b5c71a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:32.621657 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990f3de-d098-4d8b-987b-32549b5c71a7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:32.658696 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f453990-08c7-4a40-a7da-cb6d3f6ef00c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:32.691663 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c6f1b-cbf7-456b-b81b-9e395872376b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:32.692369 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c6f1b-cbf7-456b-b81b-9e395872376b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:32.692650 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c6f1b-cbf7-456b-b81b-9e395872376b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:32.692922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c6f1b-cbf7-456b-b81b-9e395872376b None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:32.693644 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c6f1b-cbf7-456b-b81b-9e395872376b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:32.693952 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c6f1b-cbf7-456b-b81b-9e395872376b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:32.695328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c6f1b-cbf7-456b-b81b-9e395872376b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:32.706083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 245/472] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:32.715606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af21a47-1b6d-443e-ae25-2c97f1afd794 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:32.715606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af21a47-1b6d-443e-ae25-2c97f1afd794 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:32.715606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af21a47-1b6d-443e-ae25-2c97f1afd794 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:32.715606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 246/473] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:32.715606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af21a47-1b6d-443e-ae25-2c97f1afd794 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:32.721535 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 228/474] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 12 06:31:32 2022] POST /identity/v3/users => generated 248 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:31:32.721535 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990f3de-d098-4d8b-987b-32549b5c71a7 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:32.827183 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af21a47-1b6d-443e-ae25-2c97f1afd794 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:32.854370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990f3de-d098-4d8b-987b-32549b5c71a7 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:32.865716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a136c57-77a5-4019-8bca-1e03b618a053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:32.866398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a136c57-77a5-4019-8bca-1e03b618a053 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:32.866677 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a136c57-77a5-4019-8bca-1e03b618a053 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:32.867071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a136c57-77a5-4019-8bca-1e03b618a053 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:32.867872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a136c57-77a5-4019-8bca-1e03b618a053 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:32.869334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a136c57-77a5-4019-8bca-1e03b618a053 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:32.893952 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ac7bf-5ece-475d-a8d4-994531ee85c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:32.894733 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ac7bf-5ece-475d-a8d4-994531ee85c6 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:32.895013 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ac7bf-5ece-475d-a8d4-994531ee85c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:32.895341 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ac7bf-5ece-475d-a8d4-994531ee85c6 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:32.896095 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ac7bf-5ece-475d-a8d4-994531ee85c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:32.897713 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ac7bf-5ece-475d-a8d4-994531ee85c6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:32.959378 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 247/475] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 12 06:31:32 2022] POST /identity/v3/users => generated 248 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:31:32.961595 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddb819-2e9c-4bfc-b51d-e2165f7142eb None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:32.962081 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddb819-2e9c-4bfc-b51d-e2165f7142eb None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:32.962565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddb819-2e9c-4bfc-b51d-e2165f7142eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:32.981604 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-ccddb819-2e9c-4bfc-b51d-e2165f7142eb None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:32.982887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ccddb819-2e9c-4bfc-b51d-e2165f7142eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:32.990179 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 229/476] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 12 06:31:32 2022] POST /identity/v3/users => generated 249 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:31:33.067986 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 248/477] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:33.092472 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ac7bf-5ece-475d-a8d4-994531ee85c6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:33.216832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ac7bf-5ece-475d-a8d4-994531ee85c6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:33.254525 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86290b5d-9b66-447b-af1d-51d00e332540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:33.255206 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86290b5d-9b66-447b-af1d-51d00e332540 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:33.255486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86290b5d-9b66-447b-af1d-51d00e332540 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:33.255795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86290b5d-9b66-447b-af1d-51d00e332540 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:33.256552 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86290b5d-9b66-447b-af1d-51d00e332540 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:33.258098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86290b5d-9b66-447b-af1d-51d00e332540 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:33.295705 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.sql.core [None req-86290b5d-9b66-447b-af1d-51d00e332540 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 06:31:33.295705 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 12 06:31:33.295705 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [parameters: {'id': 'a13e816740fe414a863477826d8901b9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 12 06:31:33.295705 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80358) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 06:31:33.313243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-86290b5d-9b66-447b-af1d-51d00e332540 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 12 06:31:33.313243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:33.313243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 06:31:33.313243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 06:31:33.313243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 06:31:33.313243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 06:31:33.313243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 06:31:33.313243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application result = self._query(query) May 12 06:31:33.313243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 06:31:33.313243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application conn.query(q) May 12 06:31:33.313243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 06:31:33.313243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 06:31:33.313243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 06:31:33.313243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application result.read() May 12 06:31:33.313243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 06:31:33.314177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 06:31:33.314177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 06:31:33.314177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 06:31:33.314177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 06:31:33.314177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 06:31:33.314177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 06:31:33.314177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 06:31:33.314177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 06:31:33.314177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:33.314177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 06:31:33.314177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:33.314177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:33.314177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 06:31:33.314177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 06:31:33.314177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 12 06:31:33.314177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return ref.to_dict() May 12 06:31:33.314177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 06:31:33.314177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application next(self.gen) May 12 06:31:33.315092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 06:31:33.315092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application yield resource May 12 06:31:33.315092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 06:31:33.315092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application next(self.gen) May 12 06:31:33.315092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 06:31:33.315092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self.session.rollback() May 12 06:31:33.315092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 06:31:33.315092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self.force_reraise() May 12 06:31:33.315092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 06:31:33.315092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise self.value May 12 06:31:33.315092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 06:31:33.315092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 06:31:33.315092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 06:31:33.315092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application session.commit() May 12 06:31:33.315092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 06:31:33.315092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 06:31:33.315092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 06:31:33.316931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._prepare_impl() May 12 06:31:33.316931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 06:31:33.316931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self.session.flush() May 12 06:31:33.316931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 06:31:33.316931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._flush(objects) May 12 06:31:33.316931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 06:31:33.316931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 06:31:33.316931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 06:31:33.316931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application compat.raise_( May 12 06:31:33.316931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 06:31:33.316931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception May 12 06:31:33.316931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 06:31:33.316931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application flush_context.execute() May 12 06:31:33.316931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 06:31:33.316931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rec.execute(self) May 12 06:31:33.316931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 06:31:33.316931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 06:31:33.318986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 06:31:33.318986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 06:31:33.318986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 12 06:31:33.318986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application c = connection._execute_20( May 12 06:31:33.318986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 06:31:33.318986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 06:31:33.318986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 06:31:33.318986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 06:31:33.318986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 06:31:33.318986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 06:31:33.318986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 06:31:33.318986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 06:31:33.318986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 06:31:33.318986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 06:31:33.318986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 06:31:33.318986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception May 12 06:31:33.321049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 06:31:33.321049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 06:31:33.321049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 06:31:33.321049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 06:31:33.321049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 06:31:33.321049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application result = self._query(query) May 12 06:31:33.321049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 06:31:33.321049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application conn.query(q) May 12 06:31:33.321049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 06:31:33.321049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 06:31:33.321049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 06:31:33.321049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application result.read() May 12 06:31:33.321049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 06:31:33.321049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 06:31:33.321049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 06:31:33.321049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 06:31:33.323021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 06:31:33.323021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 06:31:33.323021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 06:31:33.323021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 06:31:33.323021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 06:31:33.323021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 12 06:31:33.323021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [parameters: {'id': 'a13e816740fe414a863477826d8901b9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 12 06:31:33.323021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 06:31:33.323021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:33.323021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:31:33.323021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:33.323021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:33.323021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:33.323021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:33.323021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:33.323021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:33.326486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:33.326486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:33.326486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:33.326486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:33.326486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:33.326486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:33.326486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 12 06:31:33.326486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 12 06:31:33.326486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:33.326486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:33.326486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 12 06:31:33.326486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 12 06:31:33.326486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 06:31:33.326486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 06:31:33.326486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 12 06:31:33.326486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:33.328653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 230/478] 10.222.0.25 () {60 vars in 1131 bytes} [Thu May 12 06:31:33 2022] POST /identity/v3/roles => generated 144 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:33.328797 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddb819-2e9c-4bfc-b51d-e2165f7142eb None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:33.436847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddb819-2e9c-4bfc-b51d-e2165f7142eb None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:33.475634 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf80c6-96ad-49cd-ba37-c5b8cc2a1de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:33.477011 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf80c6-96ad-49cd-ba37-c5b8cc2a1de0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:33.477286 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf80c6-96ad-49cd-ba37-c5b8cc2a1de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:33.477563 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf80c6-96ad-49cd-ba37-c5b8cc2a1de0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:33.487966 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf80c6-96ad-49cd-ba37-c5b8cc2a1de0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:33.496236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-f9cf80c6-96ad-49cd-ba37-c5b8cc2a1de0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:31:33.496236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:33.496236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:33.496236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:33.496236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:33.496236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:33.496236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:33.496236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:33.496236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:33.496236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:33.496236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:33.496236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:33.496236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:33.496236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:33.496236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:33.496236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:33.498231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:33.498231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:33.498231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:33.498231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:33.498231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:33.498231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:33.498231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:33.498231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:33.498231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:33.498231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:33.498231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:33.498231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:33.498231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:33.498231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:33.498231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:33.498231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:33.500132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:33.500132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:33.500132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:33.500132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:33.500132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:33.500132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:33.500132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:33.500132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:33.500132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:33.500132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:33.500132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 06:31:33.500132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:33.500132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 249/479] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:31:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:33.508997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86290b5d-9b66-447b-af1d-51d00e332540 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:33.653550 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86290b5d-9b66-447b-af1d-51d00e332540 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:33.705369 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31f299-bcec-4313-bd17-61aad8483d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:33.706397 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31f299-bcec-4313-bd17-61aad8483d0e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:33.706874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31f299-bcec-4313-bd17-61aad8483d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:33.707338 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31f299-bcec-4313-bd17-61aad8483d0e None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:33.708320 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31f299-bcec-4313-bd17-61aad8483d0e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:33.708819 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31f299-bcec-4313-bd17-61aad8483d0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:33.710409 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31f299-bcec-4313-bd17-61aad8483d0e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:33.722753 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 231/480] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:35.121796 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9d19d-617a-42ae-ac7c-1e81fd43354d None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:35.122300 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9d19d-617a-42ae-ac7c-1e81fd43354d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:35.122407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9d19d-617a-42ae-ac7c-1e81fd43354d None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:35.123732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 250/481] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:35.129388 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427a298-d144-435d-ace2-c025c10afe9c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:35.130182 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427a298-d144-435d-ace2-c025c10afe9c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:35.130649 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427a298-d144-435d-ace2-c025c10afe9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:35.156704 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c427a298-d144-435d-ace2-c025c10afe9c None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:35.158200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c427a298-d144-435d-ace2-c025c10afe9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:35.239894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 232/482] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:35.277259 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9d19d-617a-42ae-ac7c-1e81fd43354d None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:35.416435 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9d19d-617a-42ae-ac7c-1e81fd43354d None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:35.464429 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65962e-f8ec-4929-8733-11e9bd59a8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:35.465247 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65962e-f8ec-4929-8733-11e9bd59a8ec None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:35.465532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65962e-f8ec-4929-8733-11e9bd59a8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:35.465809 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65962e-f8ec-4929-8733-11e9bd59a8ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:35.480542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65962e-f8ec-4929-8733-11e9bd59a8ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:35.488473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-cf65962e-f8ec-4929-8733-11e9bd59a8ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:35.488473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:35.488473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:35.488473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:35.488473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:35.488473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:35.488473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:35.488473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:35.488473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:35.488473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:35.488473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:35.488473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:35.488473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:35.488473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:35.488473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:35.488473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:35.489354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:35.489354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:35.489354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:35.489354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:35.489354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:35.489354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:35.489354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:35.489354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:35.489354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:35.489354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:35.489354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:35.489354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:35.489354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:35.489354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:35.489354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:35.489354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:35.490169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:35.490169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:35.490169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:35.490169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:35.490169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:35.490169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:35.490169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:35.490169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:35.490169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:35.490169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:35.490169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:35.490169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:35.490169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 251/483] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:31:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:35.496220 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427a298-d144-435d-ace2-c025c10afe9c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:35.515712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe99aa-cdbb-4218-88cc-4a39d9c38ad2 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:35.515712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe99aa-cdbb-4218-88cc-4a39d9c38ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:35.515712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe99aa-cdbb-4218-88cc-4a39d9c38ad2 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:35.515712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 252/484] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:35.518200 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a101ef-2134-4ddf-8789-60337abcdaa1 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:35.518487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a101ef-2134-4ddf-8789-60337abcdaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:35.518771 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a101ef-2134-4ddf-8789-60337abcdaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:35.542046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-04a101ef-2134-4ddf-8789-60337abcdaa1 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:35.543159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-04a101ef-2134-4ddf-8789-60337abcdaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:35.641455 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 253/485] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:31:35.675246 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427a298-d144-435d-ace2-c025c10afe9c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:35.676978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a101ef-2134-4ddf-8789-60337abcdaa1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:35.718848 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb363e-605f-4ebf-b484-f0c03e731313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:35.719536 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb363e-605f-4ebf-b484-f0c03e731313 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:35.719845 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb363e-605f-4ebf-b484-f0c03e731313 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:35.720116 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb363e-605f-4ebf-b484-f0c03e731313 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:35.720891 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb363e-605f-4ebf-b484-f0c03e731313 None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:35.721197 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb363e-605f-4ebf-b484-f0c03e731313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:35.722599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb363e-605f-4ebf-b484-f0c03e731313 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:35.739071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 233/486] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 12 06:31:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:35.745542 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb363e-605f-4ebf-b484-f0c03e731313 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:35.846911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a101ef-2134-4ddf-8789-60337abcdaa1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:35.861283 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb363e-605f-4ebf-b484-f0c03e731313 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:35.901420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da72074-689c-4068-9127-cc4cb51b7c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:35.902234 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da72074-689c-4068-9127-cc4cb51b7c9d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:35.902519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da72074-689c-4068-9127-cc4cb51b7c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:35.902795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da72074-689c-4068-9127-cc4cb51b7c9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:35.904003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65aaed-d773-4335-a980-2cdfc1f0691b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:35.904803 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65aaed-d773-4335-a980-2cdfc1f0691b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:35.905081 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65aaed-d773-4335-a980-2cdfc1f0691b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:35.905352 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65aaed-d773-4335-a980-2cdfc1f0691b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:35.918954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65aaed-d773-4335-a980-2cdfc1f0691b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:35.923988 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da72074-689c-4068-9127-cc4cb51b7c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:35.925449 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da72074-689c-4068-9127-cc4cb51b7c9d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:35.927003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-5c65aaed-d773-4335-a980-2cdfc1f0691b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:35.927003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:35.927003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:35.927003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:35.927003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:35.927003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:35.927003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:35.927003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:35.927003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:35.927003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:35.927003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:35.927003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:35.927003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:35.927003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:35.927003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:35.927003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:35.935328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:35.935328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:35.935328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:35.935328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:35.935328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:35.935328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:35.935328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:35.935328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:35.935328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:35.935328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:35.935328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:35.935328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:35.935328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:35.935328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:35.935328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:35.935328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:35.936397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:35.936397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:35.936397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:35.936397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:35.936397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:35.936397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:35.936397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:35.936397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:35.936397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:35.936397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:35.936397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:35.936397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:35.936397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 254/487] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:31:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:31:35.936397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65aaed-d773-4335-a980-2cdfc1f0691b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:35.954925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-0da72074-689c-4068-9127-cc4cb51b7c9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:35.954925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:35.954925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:35.954925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:35.954925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:35.954925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:35.954925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:35.954925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:35.954925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:35.954925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:35.954925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:35.954925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:35.954925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:35.954925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:35.954925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:35.956026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:35.956026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:35.956026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:35.956026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:35.956026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:35.956026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:35.956026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:35.956026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:35.956026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:35.956026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:35.956026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:35.956026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:35.956026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:35.956026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:35.956026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:35.956026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:35.956026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:35.957167 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:35.957167 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:35.957167 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:35.957167 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:35.959337 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 234/488] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:35.962753 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4eebda-e411-493f-ac3c-a2ecc12cad64 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:35.963047 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4eebda-e411-493f-ac3c-a2ecc12cad64 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:35.963327 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4eebda-e411-493f-ac3c-a2ecc12cad64 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:35.965051 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 235/489] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:35.966213 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b3e7f-7144-4992-98d7-fba0aea626e6 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:35.966556 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b3e7f-7144-4992-98d7-fba0aea626e6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:35.966835 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b3e7f-7144-4992-98d7-fba0aea626e6 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:35.971805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 236/490] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:35.973366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b3e7f-7144-4992-98d7-fba0aea626e6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:36.047363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65aaed-d773-4335-a980-2cdfc1f0691b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:36.078575 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b3e7f-7144-4992-98d7-fba0aea626e6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:36.080354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c8b41-2328-4cbc-968e-8a34c7add9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:36.081016 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c8b41-2328-4cbc-968e-8a34c7add9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:36.081299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c8b41-2328-4cbc-968e-8a34c7add9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:36.081567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c8b41-2328-4cbc-968e-8a34c7add9d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:36.082314 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c8b41-2328-4cbc-968e-8a34c7add9d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:36.082615 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c8b41-2328-4cbc-968e-8a34c7add9d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:36.084011 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c8b41-2328-4cbc-968e-8a34c7add9d5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:36.092934 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 255/491] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 12 06:31:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:36.094620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed82f8-49e5-4680-b0c3-4e109ac213ed None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:36.094941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed82f8-49e5-4680-b0c3-4e109ac213ed None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:36.095187 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed82f8-49e5-4680-b0c3-4e109ac213ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:36.111414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4bed82f8-49e5-4680-b0c3-4e109ac213ed None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:36.112550 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4bed82f8-49e5-4680-b0c3-4e109ac213ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:36.118917 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96296b0a-cf4d-4b11-beb5-ffab41803fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:36.119580 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96296b0a-cf4d-4b11-beb5-ffab41803fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:36.119888 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96296b0a-cf4d-4b11-beb5-ffab41803fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:36.120158 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96296b0a-cf4d-4b11-beb5-ffab41803fe9 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:36.120879 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96296b0a-cf4d-4b11-beb5-ffab41803fe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:36.121184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96296b0a-cf4d-4b11-beb5-ffab41803fe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:36.122532 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96296b0a-cf4d-4b11-beb5-ffab41803fe9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:36.136158 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 237/492] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:36.137484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5dfed-fe3f-4208-b347-17b1df3b3dd0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:36.137772 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5dfed-fe3f-4208-b347-17b1df3b3dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:36.138050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5dfed-fe3f-4208-b347-17b1df3b3dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:36.155109 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e6d5dfed-fe3f-4208-b347-17b1df3b3dd0 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:36.156323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e6d5dfed-fe3f-4208-b347-17b1df3b3dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:36.183189 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 256/493] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:36.193004 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed82f8-49e5-4680-b0c3-4e109ac213ed None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:36.227760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 238/494] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:36.227760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5dfed-fe3f-4208-b347-17b1df3b3dd0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:36.300398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed82f8-49e5-4680-b0c3-4e109ac213ed None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:36.330179 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5dfed-fe3f-4208-b347-17b1df3b3dd0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:36.332431 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb049ad-869c-4574-8113-e43326c4ec5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:36.333235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb049ad-869c-4574-8113-e43326c4ec5d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:36.333516 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb049ad-869c-4574-8113-e43326c4ec5d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:36.333790 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb049ad-869c-4574-8113-e43326c4ec5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:36.344268 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb049ad-869c-4574-8113-e43326c4ec5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:36.345711 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb049ad-869c-4574-8113-e43326c4ec5d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:36.364334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-5cb049ad-869c-4574-8113-e43326c4ec5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:36.364334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:36.364334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:36.364334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:36.364334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:36.364334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:36.364334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:36.364334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:36.364334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:36.364334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:36.364334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:36.364334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:36.364334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:36.364334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:36.364334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:36.365254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:36.365254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:36.365254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:36.365254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:36.365254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:36.365254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:36.365254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:36.365254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:36.365254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:36.365254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:36.365254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:36.365254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:36.365254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:36.365254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:36.365254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:36.365254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:36.365254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:36.366125 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:36.366125 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:36.366125 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:36.366125 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:36.366125 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 257/495] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:36.366750 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb049ad-869c-4574-8113-e43326c4ec5d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:36.367567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb178b-8746-43db-af18-25c89c42b16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:36.368461 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb178b-8746-43db-af18-25c89c42b16b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:36.368738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb178b-8746-43db-af18-25c89c42b16b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:36.369006 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb178b-8746-43db-af18-25c89c42b16b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:36.378926 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb178b-8746-43db-af18-25c89c42b16b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:36.380509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb178b-8746-43db-af18-25c89c42b16b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:36.397354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-dfeb178b-8746-43db-af18-25c89c42b16b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 06:31:36.397354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:36.397354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:36.397354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:36.397354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:36.397354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:36.397354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:36.397354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:36.397354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:36.397354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:36.397354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:36.397354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:36.397354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:31:36.397354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:31:36.397354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:31:36.397354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:31:36.398948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:36.398948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:36.398948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:31:36.398948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:36.398948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:31:36.398948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:36.398948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:36.398948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:36.398948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:36.398948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:36.398948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:36.398948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:36.398948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:36.398948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:36.398948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:36.398948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:36.398948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:36.398948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:36.399921 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:36.399921 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:36.399921 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:31:36.399921 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:31:36.399921 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:31:36.399921 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:31:36.399921 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:31:36.399921 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:31:36.399921 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 06:31:36.399921 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:36.399921 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 239/496] 10.222.0.25 () {56 vars in 1093 bytes} [Thu May 12 06:31:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:36.404329 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb178b-8746-43db-af18-25c89c42b16b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:36.469479 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb049ad-869c-4574-8113-e43326c4ec5d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:36.499595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb178b-8746-43db-af18-25c89c42b16b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:36.501764 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111215c-1b36-4ab1-b8f1-fd152ff70232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:36.502565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111215c-1b36-4ab1-b8f1-fd152ff70232 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:36.502846 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111215c-1b36-4ab1-b8f1-fd152ff70232 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:36.503116 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111215c-1b36-4ab1-b8f1-fd152ff70232 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:36.513935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111215c-1b36-4ab1-b8f1-fd152ff70232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:36.521871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-0111215c-1b36-4ab1-b8f1-fd152ff70232 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:36.521871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:36.521871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:36.521871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:36.521871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:36.521871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:36.521871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:36.521871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:36.521871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:36.521871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:36.521871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:36.521871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:36.521871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:36.521871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:36.521871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:36.521871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:36.522755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:36.522755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:36.522755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:36.522755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:36.522755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:36.522755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:36.522755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:36.522755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:36.522755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:36.522755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:36.522755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:36.522755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:36.522755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:36.522755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:36.522755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:36.522755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:36.524216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:36.524216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:36.524216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:36.524216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:36.524216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:36.524216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:36.524216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:36.524216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:36.524216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:36.524216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:36.524216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:36.524216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:36.524216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 258/497] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:31:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:36.524891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111215c-1b36-4ab1-b8f1-fd152ff70232 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:36.541624 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09341cc9-5abf-45dd-8ccd-9b889d4b545f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:36.542426 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09341cc9-5abf-45dd-8ccd-9b889d4b545f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:36.542704 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09341cc9-5abf-45dd-8ccd-9b889d4b545f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:36.542972 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09341cc9-5abf-45dd-8ccd-9b889d4b545f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:36.552860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09341cc9-5abf-45dd-8ccd-9b889d4b545f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:36.561160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-09341cc9-5abf-45dd-8ccd-9b889d4b545f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:36.561160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:36.561160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:36.561160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:36.561160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:36.561160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:36.561160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:36.561160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:36.561160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:36.561160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:36.561160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:36.561160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:36.561160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:36.561160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:36.561160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:36.561160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:36.562221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:36.562221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:36.562221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:36.562221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:36.562221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:36.562221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:36.562221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:36.562221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:36.562221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:36.562221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:36.562221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:36.562221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:36.562221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:36.562221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:36.562221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:36.562221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:36.563076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:36.563076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:36.563076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:36.563076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:36.563076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:36.563076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:36.563076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:36.563076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:36.563076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:36.563076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:36.563076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:36.563076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:36.563076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 240/498] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:31:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:36.563811 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09341cc9-5abf-45dd-8ccd-9b889d4b545f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:36.622646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111215c-1b36-4ab1-b8f1-fd152ff70232 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:36.653380 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9c57d-8987-4ac0-85b6-23e1e71d4f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:36.654036 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9c57d-8987-4ac0-85b6-23e1e71d4f7f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:36.654317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9c57d-8987-4ac0-85b6-23e1e71d4f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:36.654587 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9c57d-8987-4ac0-85b6-23e1e71d4f7f None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:36.655305 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9c57d-8987-4ac0-85b6-23e1e71d4f7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:36.655610 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9c57d-8987-4ac0-85b6-23e1e71d4f7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:36.656986 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9c57d-8987-4ac0-85b6-23e1e71d4f7f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:36.661740 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09341cc9-5abf-45dd-8ccd-9b889d4b545f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:36.669012 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 259/499] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:36.669691 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9c57d-8987-4ac0-85b6-23e1e71d4f7f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:36.696371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39b69f-4a56-4902-a2b6-3c954b19a28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:36.697029 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39b69f-4a56-4902-a2b6-3c954b19a28f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:36.697308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39b69f-4a56-4902-a2b6-3c954b19a28f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:36.697579 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39b69f-4a56-4902-a2b6-3c954b19a28f None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:36.698419 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39b69f-4a56-4902-a2b6-3c954b19a28f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:36.698730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39b69f-4a56-4902-a2b6-3c954b19a28f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:36.700200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39b69f-4a56-4902-a2b6-3c954b19a28f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:36.735415 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 241/500] 10.222.0.25 () {56 vars in 1133 bytes} [Thu May 12 06:31:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:36.736909 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7719757-d453-4d56-af3f-1a5c7d5463bf None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:36.737203 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7719757-d453-4d56-af3f-1a5c7d5463bf None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:36.737478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7719757-d453-4d56-af3f-1a5c7d5463bf None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:36.738859 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 242/501] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:36.739442 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7719757-d453-4d56-af3f-1a5c7d5463bf None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:36.765077 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9c57d-8987-4ac0-85b6-23e1e71d4f7f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:36.796283 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dc3fa-4390-4e14-a7d0-a0a533938892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:36.796938 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dc3fa-4390-4e14-a7d0-a0a533938892 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:36.797217 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dc3fa-4390-4e14-a7d0-a0a533938892 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:36.797488 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dc3fa-4390-4e14-a7d0-a0a533938892 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:36.798233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dc3fa-4390-4e14-a7d0-a0a533938892 None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:36.798536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dc3fa-4390-4e14-a7d0-a0a533938892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:36.799944 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dc3fa-4390-4e14-a7d0-a0a533938892 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:36.807908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 260/502] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 12 06:31:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:36.808677 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dc3fa-4390-4e14-a7d0-a0a533938892 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:36.836849 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7719757-d453-4d56-af3f-1a5c7d5463bf None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:36.870686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fbd5c-3450-4f7d-87ae-f7fe5878b380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:36.871341 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fbd5c-3450-4f7d-87ae-f7fe5878b380 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:36.871619 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fbd5c-3450-4f7d-87ae-f7fe5878b380 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:36.871918 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fbd5c-3450-4f7d-87ae-f7fe5878b380 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:36.872712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fbd5c-3450-4f7d-87ae-f7fe5878b380 None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:36.872965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fbd5c-3450-4f7d-87ae-f7fe5878b380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:36.874329 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fbd5c-3450-4f7d-87ae-f7fe5878b380 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:36.887611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 243/503] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 12 06:31:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:36.887611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fbd5c-3450-4f7d-87ae-f7fe5878b380 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:36.903385 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dc3fa-4390-4e14-a7d0-a0a533938892 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:36.934925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a879db-61ce-4374-8e98-681d81030372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:36.935742 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a879db-61ce-4374-8e98-681d81030372 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:36.936027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a879db-61ce-4374-8e98-681d81030372 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:36.936299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a879db-61ce-4374-8e98-681d81030372 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:36.943394 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a879db-61ce-4374-8e98-681d81030372 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:36.945431 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a879db-61ce-4374-8e98-681d81030372 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:36.960609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-29a879db-61ce-4374-8e98-681d81030372 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 06:31:36.960609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:36.960609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:36.960609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:36.960609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:36.960609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:36.960609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:36.960609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:36.960609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:36.960609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:36.960609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:36.960609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:36.960609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:31:36.960609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:31:36.960609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:31:36.960609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:31:36.961557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:36.961557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:36.961557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:31:36.961557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:36.961557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:31:36.961557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:36.961557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:36.961557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:36.961557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:36.961557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:36.961557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:36.961557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:36.961557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:36.961557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:36.961557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:36.961557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:36.961557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:36.961557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:36.962484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:36.962484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:36.962484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:31:36.962484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:31:36.962484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:31:36.962484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:31:36.962484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:31:36.962484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:31:36.962484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 06:31:36.962484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:36.962484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 261/504] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:36.963330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588b7d8-4e8b-4a0d-8b8a-4da53ee9ae59 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:36.963612 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588b7d8-4e8b-4a0d-8b8a-4da53ee9ae59 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:36.963982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588b7d8-4e8b-4a0d-8b8a-4da53ee9ae59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:36.979928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-8588b7d8-4e8b-4a0d-8b8a-4da53ee9ae59 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:36.981104 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8588b7d8-4e8b-4a0d-8b8a-4da53ee9ae59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:36.982759 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fbd5c-3450-4f7d-87ae-f7fe5878b380 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:37.015587 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f1068-fbf8-44f2-b177-25223899f8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:37.016266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f1068-fbf8-44f2-b177-25223899f8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:37.016549 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f1068-fbf8-44f2-b177-25223899f8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:37.016821 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f1068-fbf8-44f2-b177-25223899f8d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:37.043997 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 262/505] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:37.044852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588b7d8-4e8b-4a0d-8b8a-4da53ee9ae59 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:37.080101 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f1068-fbf8-44f2-b177-25223899f8d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:37.081546 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f1068-fbf8-44f2-b177-25223899f8d4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:37.138158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588b7d8-4e8b-4a0d-8b8a-4da53ee9ae59 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:37.170136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a5f03-3e6b-41e3-8556-4db4e4582f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:37.170930 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a5f03-3e6b-41e3-8556-4db4e4582f33 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:37.171207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a5f03-3e6b-41e3-8556-4db4e4582f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:37.171484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a5f03-3e6b-41e3-8556-4db4e4582f33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:37.174438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 244/506] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:37.175322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f1068-fbf8-44f2-b177-25223899f8d4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:37.181384 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a5f03-3e6b-41e3-8556-4db4e4582f33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:37.182839 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a5f03-3e6b-41e3-8556-4db4e4582f33 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:37.200244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-3f7a5f03-3e6b-41e3-8556-4db4e4582f33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:37.200244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:37.200244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:37.200244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:37.200244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:37.200244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:37.200244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:37.200244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:37.200244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:37.200244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:37.200244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:37.200244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:37.200244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:37.200244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:37.200244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:37.201632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:37.201632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:37.201632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:37.201632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:37.201632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:37.201632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:37.201632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:37.201632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:37.201632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:37.201632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:37.201632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:37.201632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:37.201632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:37.201632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:37.201632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:37.201632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:37.201632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:37.202492 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:37.202492 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:37.202492 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:37.202492 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:37.202492 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 263/507] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:37.202492 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a5f03-3e6b-41e3-8556-4db4e4582f33 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:37.271447 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f1068-fbf8-44f2-b177-25223899f8d4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:37.294383 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a5f03-3e6b-41e3-8556-4db4e4582f33 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:37.303526 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1002ba9-3bf0-4438-9eb1-ca54ddcaa2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:37.304397 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1002ba9-3bf0-4438-9eb1-ca54ddcaa2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:37.304676 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1002ba9-3bf0-4438-9eb1-ca54ddcaa2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:37.304946 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1002ba9-3bf0-4438-9eb1-ca54ddcaa2d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:37.314482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1002ba9-3bf0-4438-9eb1-ca54ddcaa2d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:37.315969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1002ba9-3bf0-4438-9eb1-ca54ddcaa2d6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:37.326172 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51a68f-25e5-496d-b928-95cf5050fac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:37.326821 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51a68f-25e5-496d-b928-95cf5050fac6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:37.327098 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51a68f-25e5-496d-b928-95cf5050fac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:37.327363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51a68f-25e5-496d-b928-95cf5050fac6 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:37.328232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51a68f-25e5-496d-b928-95cf5050fac6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:37.328536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51a68f-25e5-496d-b928-95cf5050fac6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:37.329914 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51a68f-25e5-496d-b928-95cf5050fac6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:37.333271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-e1002ba9-3bf0-4438-9eb1-ca54ddcaa2d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:37.333271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:37.333271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:37.333271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:37.333271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:37.333271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:37.333271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:37.333271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:37.333271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:37.333271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:37.333271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:37.333271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:37.333271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:37.333271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:37.333271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:37.334260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:37.334260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:37.334260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:37.334260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:37.334260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:37.334260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:37.334260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:37.334260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:37.334260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:37.334260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:37.334260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:37.334260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:37.334260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:37.334260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:37.334260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:37.334260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:37.334260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:37.335206 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:37.335206 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:37.335206 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:37.335206 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:37.335206 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 245/508] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:37.335206 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1002ba9-3bf0-4438-9eb1-ca54ddcaa2d6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:37.367118 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 264/509] 10.222.0.25 () {56 vars in 1137 bytes} [Thu May 12 06:31:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:37.368119 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51a68f-25e5-496d-b928-95cf5050fac6 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:37.435701 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1002ba9-3bf0-4438-9eb1-ca54ddcaa2d6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:37.459889 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51a68f-25e5-496d-b928-95cf5050fac6 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:37.467537 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa039ce-7887-4588-b3cd-c1256ade6ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:37.468344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa039ce-7887-4588-b3cd-c1256ade6ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:37.468629 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa039ce-7887-4588-b3cd-c1256ade6ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:37.468902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa039ce-7887-4588-b3cd-c1256ade6ef0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:37.478882 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa039ce-7887-4588-b3cd-c1256ade6ef0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:37.480377 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa039ce-7887-4588-b3cd-c1256ade6ef0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:37.491532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66eab8a-ccf5-4a4e-a766-a46219bf5ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:37.492859 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eab8a-ccf5-4a4e-a766-a46219bf5ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:37.493142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eab8a-ccf5-4a4e-a766-a46219bf5ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:37.493414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eab8a-ccf5-4a4e-a766-a46219bf5ba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:37.497357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-caa039ce-7887-4588-b3cd-c1256ade6ef0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:37.497357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:37.497357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:37.497357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:37.497357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:37.497357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:37.497357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:37.497357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:37.497357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:37.497357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:37.497357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:37.497357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:37.497357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:37.497357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:37.497357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:37.498196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:37.498196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:37.498196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:37.498196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:37.498196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:37.498196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:37.498196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:37.498196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:37.498196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:37.498196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:37.498196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:37.498196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:37.498196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:37.498196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:37.498196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:37.498196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:37.498196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:37.499067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:37.499067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:37.499067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:37.499067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:37.499067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 246/510] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:37.499351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa039ce-7887-4588-b3cd-c1256ade6ef0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:37.506736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66eab8a-ccf5-4a4e-a766-a46219bf5ba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:37.508784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66eab8a-ccf5-4a4e-a766-a46219bf5ba1 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:37.525785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-f66eab8a-ccf5-4a4e-a766-a46219bf5ba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:37.525785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:37.525785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:37.525785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:37.525785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:37.525785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:37.525785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:37.525785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:37.525785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:37.525785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:37.525785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:37.525785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:37.525785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:37.525785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:37.525785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:37.526674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:37.526674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:37.526674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:37.526674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:37.526674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:37.526674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:37.526674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:37.526674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:37.526674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:37.526674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:37.526674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:37.526674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:37.526674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:37.526674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:37.526674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:37.526674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:37.526674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:37.527539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:37.527539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:37.527539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:37.527539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:37.527539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 265/511] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:37.528064 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66eab8a-ccf5-4a4e-a766-a46219bf5ba1 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:37.599538 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa039ce-7887-4588-b3cd-c1256ade6ef0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:37.619788 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66eab8a-ccf5-4a4e-a766-a46219bf5ba1 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:37.630835 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f2db1-885e-42d1-b748-f1c4e50e680f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:37.631530 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f2db1-885e-42d1-b748-f1c4e50e680f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:37.631841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f2db1-885e-42d1-b748-f1c4e50e680f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:37.632123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f2db1-885e-42d1-b748-f1c4e50e680f None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:37.633400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f2db1-885e-42d1-b748-f1c4e50e680f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:37.633706 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f2db1-885e-42d1-b748-f1c4e50e680f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:37.635061 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f2db1-885e-42d1-b748-f1c4e50e680f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:37.646550 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 247/512] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:37.647271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f2db1-885e-42d1-b748-f1c4e50e680f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:37.655278 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba32315-cbf2-46a9-9a3e-2d036a0a1386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:37.655965 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba32315-cbf2-46a9-9a3e-2d036a0a1386 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:37.656244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba32315-cbf2-46a9-9a3e-2d036a0a1386 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:37.656511 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba32315-cbf2-46a9-9a3e-2d036a0a1386 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:37.657230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba32315-cbf2-46a9-9a3e-2d036a0a1386 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:37.657527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba32315-cbf2-46a9-9a3e-2d036a0a1386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:37.658875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba32315-cbf2-46a9-9a3e-2d036a0a1386 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:37.671876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 266/513] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:37.672509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba32315-cbf2-46a9-9a3e-2d036a0a1386 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:37.740161 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f2db1-885e-42d1-b748-f1c4e50e680f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:37.763914 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba32315-cbf2-46a9-9a3e-2d036a0a1386 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:37.772182 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54943833-feda-40a6-92a3-74f72330ed83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:37.773365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54943833-feda-40a6-92a3-74f72330ed83 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:37.773650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54943833-feda-40a6-92a3-74f72330ed83 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:37.773924 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54943833-feda-40a6-92a3-74f72330ed83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:37.795908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf23eed-3832-41d4-8611-a5d3683b4e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:37.796553 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf23eed-3832-41d4-8611-a5d3683b4e53 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:37.796832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf23eed-3832-41d4-8611-a5d3683b4e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:37.797103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf23eed-3832-41d4-8611-a5d3683b4e53 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:37.797809 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf23eed-3832-41d4-8611-a5d3683b4e53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:37.798107 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf23eed-3832-41d4-8611-a5d3683b4e53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:37.799444 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf23eed-3832-41d4-8611-a5d3683b4e53 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:37.810510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 267/514] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:37.811279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf23eed-3832-41d4-8611-a5d3683b4e53 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:37.839003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54943833-feda-40a6-92a3-74f72330ed83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:37.840491 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54943833-feda-40a6-92a3-74f72330ed83 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:37.903553 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf23eed-3832-41d4-8611-a5d3683b4e53 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:37.932923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 248/515] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:37.933747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54943833-feda-40a6-92a3-74f72330ed83 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:37.935130 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e113e24-9ad5-4078-88d7-a97dee017c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:37.935827 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e113e24-9ad5-4078-88d7-a97dee017c7d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:37.936112 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e113e24-9ad5-4078-88d7-a97dee017c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:37.936386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e113e24-9ad5-4078-88d7-a97dee017c7d None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:37.937105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e113e24-9ad5-4078-88d7-a97dee017c7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:37.937410 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e113e24-9ad5-4078-88d7-a97dee017c7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:37.939029 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e113e24-9ad5-4078-88d7-a97dee017c7d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:37.951005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 268/516] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:37.951818 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e113e24-9ad5-4078-88d7-a97dee017c7d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:38.032493 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54943833-feda-40a6-92a3-74f72330ed83 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:38.045570 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e113e24-9ad5-4078-88d7-a97dee017c7d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:38.064407 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f8dbc-7fa8-4889-a80a-b62616d130fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:38.065192 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f8dbc-7fa8-4889-a80a-b62616d130fd None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:38.065472 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f8dbc-7fa8-4889-a80a-b62616d130fd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:38.065742 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f8dbc-7fa8-4889-a80a-b62616d130fd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:38.073067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f8dbc-7fa8-4889-a80a-b62616d130fd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:38.074507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f8dbc-7fa8-4889-a80a-b62616d130fd None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:38.077052 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b90186-4976-4bfa-b526-c4a6172c1e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:38.077830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b90186-4976-4bfa-b526-c4a6172c1e9c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:38.078104 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b90186-4976-4bfa-b526-c4a6172c1e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:38.078367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b90186-4976-4bfa-b526-c4a6172c1e9c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:38.085064 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b90186-4976-4bfa-b526-c4a6172c1e9c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:38.087069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b90186-4976-4bfa-b526-c4a6172c1e9c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:38.089244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-658f8dbc-7fa8-4889-a80a-b62616d130fd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 06:31:38.089244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:38.089244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:38.089244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:38.089244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:38.089244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:38.089244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:38.089244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:38.089244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:38.089244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:38.089244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:38.089244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:38.089244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:31:38.089244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:31:38.089244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:31:38.089244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:31:38.090359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:38.090359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:38.090359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:31:38.090359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:38.090359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:31:38.090359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:38.090359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:38.090359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:38.090359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:38.090359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:38.090359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:38.090359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:38.090359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:38.090359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:38.090359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:38.090359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:38.090359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:38.090359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:38.091340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:38.091340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:38.091340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:31:38.091340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:31:38.091340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:31:38.091340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:31:38.091340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:31:38.091340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:31:38.091340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 06:31:38.091340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:38.091340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 249/517] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:31:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:38.091340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f8dbc-7fa8-4889-a80a-b62616d130fd None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:38.101484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-26b90186-4976-4bfa-b526-c4a6172c1e9c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 06:31:38.101484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:38.101484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:38.101484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:38.101484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:38.101484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:38.101484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:38.101484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:38.101484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:38.101484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:38.101484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:38.101484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:38.101484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:31:38.101484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:31:38.101484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:31:38.101484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:31:38.102397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:38.102397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:38.102397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:31:38.102397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:38.102397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:31:38.102397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:38.102397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:38.102397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:38.102397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:38.102397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:38.102397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:38.102397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:38.102397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:38.102397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:38.102397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:38.102397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:38.102397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:38.102397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:38.103302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:38.103302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:38.103302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:31:38.103302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:31:38.103302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:31:38.103302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:31:38.103302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:31:38.103302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:31:38.103302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 06:31:38.103302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:38.103302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 269/518] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:38.103898 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b90186-4976-4bfa-b526-c4a6172c1e9c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:38.188227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f8dbc-7fa8-4889-a80a-b62616d130fd None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:38.195591 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b90186-4976-4bfa-b526-c4a6172c1e9c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:38.221023 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edabc2d-f68f-45b4-bde7-1dc539453ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:38.221682 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edabc2d-f68f-45b4-bde7-1dc539453ab7 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:38.221962 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edabc2d-f68f-45b4-bde7-1dc539453ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:38.222242 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edabc2d-f68f-45b4-bde7-1dc539453ab7 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:38.222949 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edabc2d-f68f-45b4-bde7-1dc539453ab7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:38.224424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edabc2d-f68f-45b4-bde7-1dc539453ab7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:38.227439 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea389120-1e70-4d29-967d-957342c6f2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:38.228249 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea389120-1e70-4d29-967d-957342c6f2da None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:38.228530 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea389120-1e70-4d29-967d-957342c6f2da None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:38.228801 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea389120-1e70-4d29-967d-957342c6f2da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:38.238476 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea389120-1e70-4d29-967d-957342c6f2da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:38.239944 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea389120-1e70-4d29-967d-957342c6f2da None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:38.258097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-ea389120-1e70-4d29-967d-957342c6f2da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:38.258097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:38.258097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:38.258097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:38.258097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:38.258097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:38.258097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:38.258097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:38.258097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:38.258097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:38.258097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:38.258097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:38.258097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:38.258097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:38.258097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:38.259099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:38.259099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:38.259099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:38.259099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:38.259099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:38.259099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:38.259099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:38.259099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:38.259099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:38.259099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:38.259099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:38.259099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:38.259099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:38.259099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:38.259099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:38.259099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:38.259099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:38.260134 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:38.260134 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:38.260134 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:38.260134 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:38.260134 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 270/519] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:38.260134 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea389120-1e70-4d29-967d-957342c6f2da None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:38.319717 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 250/520] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 12 06:31:38 2022] POST /identity/v3/users => generated 247 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:31:38.319717 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edabc2d-f68f-45b4-bde7-1dc539453ab7 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:38.360203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea389120-1e70-4d29-967d-957342c6f2da None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:38.396107 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa2ad5-6ff4-4715-8734-95e95a6a48db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:38.396919 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa2ad5-6ff4-4715-8734-95e95a6a48db None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:38.397202 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa2ad5-6ff4-4715-8734-95e95a6a48db None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:38.397479 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa2ad5-6ff4-4715-8734-95e95a6a48db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:38.405574 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa2ad5-6ff4-4715-8734-95e95a6a48db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:38.407132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa2ad5-6ff4-4715-8734-95e95a6a48db None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:38.411870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edabc2d-f68f-45b4-bde7-1dc539453ab7 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:38.422928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-86aa2ad5-6ff4-4715-8734-95e95a6a48db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:38.422928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:38.422928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:38.422928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:38.422928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:38.422928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:38.422928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:38.422928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:38.422928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:38.422928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:38.422928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:38.422928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:38.422928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:31:38.422928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:31:38.422928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:31:38.424102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:31:38.424102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:38.424102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:38.424102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:38.424102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:38.424102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:38.424102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:38.424102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:38.424102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:38.424102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:38.424102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:38.424102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:38.424102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:38.424102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:38.424102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:38.424102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:38.424102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:38.424957 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:31:38.424957 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:31:38.424957 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:31:38.424957 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:31:38.424957 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:31:38.424957 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:31:38.424957 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:38.424957 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:38.428075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 271/521] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:38.429719 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa2ad5-6ff4-4715-8734-95e95a6a48db None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:38.448235 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf8b1d-73a7-499a-a8a7-08dbf449b4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:38.448907 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf8b1d-73a7-499a-a8a7-08dbf449b4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:38.449183 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf8b1d-73a7-499a-a8a7-08dbf449b4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:38.449460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf8b1d-73a7-499a-a8a7-08dbf449b4b4 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:38.450320 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf8b1d-73a7-499a-a8a7-08dbf449b4b4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:38.450628 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf8b1d-73a7-499a-a8a7-08dbf449b4b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:38.452135 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf8b1d-73a7-499a-a8a7-08dbf449b4b4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:38.470981 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 251/522] 10.222.0.25 () {56 vars in 1139 bytes} [Thu May 12 06:31:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:38.472010 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf8b1d-73a7-499a-a8a7-08dbf449b4b4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:38.533260 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa2ad5-6ff4-4715-8734-95e95a6a48db None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:38.566752 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43663f96-ae24-4d4c-8dfc-c047f5397c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:38.567430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43663f96-ae24-4d4c-8dfc-c047f5397c19 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:38.567734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43663f96-ae24-4d4c-8dfc-c047f5397c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:38.568013 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43663f96-ae24-4d4c-8dfc-c047f5397c19 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:38.568856 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43663f96-ae24-4d4c-8dfc-c047f5397c19 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:38.569161 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43663f96-ae24-4d4c-8dfc-c047f5397c19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:38.571143 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43663f96-ae24-4d4c-8dfc-c047f5397c19 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:38.577124 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf8b1d-73a7-499a-a8a7-08dbf449b4b4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:38.588032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 272/523] 10.222.0.25 () {56 vars in 1137 bytes} [Thu May 12 06:31:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:38.589166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43663f96-ae24-4d4c-8dfc-c047f5397c19 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:38.611509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fec01-cd2d-401f-8091-e0fac0d31428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:38.612198 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fec01-cd2d-401f-8091-e0fac0d31428 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:38.612485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fec01-cd2d-401f-8091-e0fac0d31428 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:38.612761 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fec01-cd2d-401f-8091-e0fac0d31428 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:38.613493 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fec01-cd2d-401f-8091-e0fac0d31428 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:38.613801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fec01-cd2d-401f-8091-e0fac0d31428 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:38.615166 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fec01-cd2d-401f-8091-e0fac0d31428 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:38.626990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 252/524] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:38.628084 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fec01-cd2d-401f-8091-e0fac0d31428 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:38.688158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43663f96-ae24-4d4c-8dfc-c047f5397c19 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:38.720774 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eea292-7f1c-49a2-b913-0e016a5de5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:38.721444 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eea292-7f1c-49a2-b913-0e016a5de5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:38.721728 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eea292-7f1c-49a2-b913-0e016a5de5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:38.722002 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eea292-7f1c-49a2-b913-0e016a5de5d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:38.722792 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eea292-7f1c-49a2-b913-0e016a5de5d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:38.723099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eea292-7f1c-49a2-b913-0e016a5de5d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:38.724547 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eea292-7f1c-49a2-b913-0e016a5de5d5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:38.731283 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fec01-cd2d-401f-8091-e0fac0d31428 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:38.747861 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 273/525] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:31:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:38.747861 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eea292-7f1c-49a2-b913-0e016a5de5d5 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:38.765887 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ecf52-17f9-4a98-ae1d-3063ce6d2307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:38.766540 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ecf52-17f9-4a98-ae1d-3063ce6d2307 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:38.766824 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ecf52-17f9-4a98-ae1d-3063ce6d2307 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:38.767101 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ecf52-17f9-4a98-ae1d-3063ce6d2307 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:38.834667 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ecf52-17f9-4a98-ae1d-3063ce6d2307 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:38.836296 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ecf52-17f9-4a98-ae1d-3063ce6d2307 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:38.843484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eea292-7f1c-49a2-b913-0e016a5de5d5 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:38.877835 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cee8c-a903-4d29-aa26-2743c2d563af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:38.878491 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cee8c-a903-4d29-aa26-2743c2d563af None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:38.878774 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cee8c-a903-4d29-aa26-2743c2d563af None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:38.879049 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cee8c-a903-4d29-aa26-2743c2d563af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:38.934011 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 253/526] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:38.937278 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ecf52-17f9-4a98-ae1d-3063ce6d2307 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:38.945938 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cee8c-a903-4d29-aa26-2743c2d563af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:38.948655 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cee8c-a903-4d29-aa26-2743c2d563af None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:39.033415 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ecf52-17f9-4a98-ae1d-3063ce6d2307 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:39.051349 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 274/527] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:39.052242 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cee8c-a903-4d29-aa26-2743c2d563af None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:39.068287 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7328e-da7a-4295-bffe-a8f8a91e49e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:39.069132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7328e-da7a-4295-bffe-a8f8a91e49e8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:39.069415 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7328e-da7a-4295-bffe-a8f8a91e49e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:39.069745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7328e-da7a-4295-bffe-a8f8a91e49e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:39.076426 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7328e-da7a-4295-bffe-a8f8a91e49e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:39.077971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7328e-da7a-4295-bffe-a8f8a91e49e8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:39.092756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-c2e7328e-da7a-4295-bffe-a8f8a91e49e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:39.092756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:39.092756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:39.092756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:39.092756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:39.092756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:39.092756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:39.092756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:39.092756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:39.092756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:39.092756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:39.092756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:39.092756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:31:39.092756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:31:39.092756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:31:39.093796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:31:39.093796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:39.093796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:39.093796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:39.093796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:39.093796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:39.093796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:39.093796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:39.093796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:39.093796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:39.093796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:39.093796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:39.093796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:39.093796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:39.093796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:39.093796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:39.093796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:39.094684 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:31:39.094684 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:31:39.094684 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:31:39.094684 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:31:39.094684 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:31:39.094684 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:31:39.094684 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:39.094684 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:39.094684 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 254/528] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:39.094684 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7328e-da7a-4295-bffe-a8f8a91e49e8 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:39.150841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cee8c-a903-4d29-aa26-2743c2d563af None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:39.183917 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e9b0d-7303-4c3f-af2c-e1879ad9e8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:39.184675 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e9b0d-7303-4c3f-af2c-e1879ad9e8cf None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:39.184960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e9b0d-7303-4c3f-af2c-e1879ad9e8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:39.185234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e9b0d-7303-4c3f-af2c-e1879ad9e8cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:39.186083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e9b0d-7303-4c3f-af2c-e1879ad9e8cf None admin] RBAC: Adding query filter params (role.id=ed3e6c61b2d14364a605282f0f1488ba, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=bbcd54a927bf46f183b50fbda677868d) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:39.186398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e9b0d-7303-4c3f-af2c-e1879ad9e8cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:39.187862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e9b0d-7303-4c3f-af2c-e1879ad9e8cf None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:39.200010 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 275/529] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:31:39 2022] GET /identity/v3/role_assignments?user.id=bbcd54a927bf46f183b50fbda677868d&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=ed3e6c61b2d14364a605282f0f1488ba => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:39.200010 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e9b0d-7303-4c3f-af2c-e1879ad9e8cf None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:39.200260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7328e-da7a-4295-bffe-a8f8a91e49e8 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:39.236626 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc73165-baa1-4298-9b6f-8360613b4acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:39.237475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc73165-baa1-4298-9b6f-8360613b4acf None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:39.237759 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc73165-baa1-4298-9b6f-8360613b4acf None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:39.238032 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc73165-baa1-4298-9b6f-8360613b4acf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:39.250576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc73165-baa1-4298-9b6f-8360613b4acf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:39.252236 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc73165-baa1-4298-9b6f-8360613b4acf None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:39.271897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-efc73165-baa1-4298-9b6f-8360613b4acf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:39.271897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:39.271897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:39.271897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:39.271897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:39.271897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:39.271897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:39.271897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:39.271897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:39.271897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:39.271897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:39.271897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:39.271897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:39.271897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:39.271897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:39.273005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:39.273005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:39.273005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:39.273005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:39.273005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:39.273005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:39.273005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:39.273005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:39.273005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:39.273005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:39.273005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:39.273005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:39.273005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:39.273005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:39.273005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:39.273005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:39.273005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:39.274284 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:39.274284 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:39.274284 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:39.274284 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:39.274284 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 255/530] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:39.274284 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc73165-baa1-4298-9b6f-8360613b4acf None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:39.301072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e9b0d-7303-4c3f-af2c-e1879ad9e8cf None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:39.340462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e900a1a-0bfd-4479-842c-2d22220ffebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:39.341277 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e900a1a-0bfd-4479-842c-2d22220ffebb None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:39.341676 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e900a1a-0bfd-4479-842c-2d22220ffebb None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:39.341962 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e900a1a-0bfd-4479-842c-2d22220ffebb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:39.353768 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e900a1a-0bfd-4479-842c-2d22220ffebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:39.355244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e900a1a-0bfd-4479-842c-2d22220ffebb None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:39.374427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-0e900a1a-0bfd-4479-842c-2d22220ffebb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:39.374427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:39.374427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:39.374427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:39.374427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:39.374427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:39.374427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:39.374427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:39.374427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:39.374427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:39.374427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:39.374427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:39.374427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:39.374427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:39.374427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:39.376642 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:39.376642 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:39.376642 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:39.376642 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:39.376642 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:39.376642 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:39.376642 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:39.376642 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:39.376642 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:39.376642 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:39.376642 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:39.376642 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:39.376642 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:39.376642 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:39.376642 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:39.376642 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:39.376642 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:39.378561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:39.378561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:39.378561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:39.378561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:39.378561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 276/531] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:39.378561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e900a1a-0bfd-4479-842c-2d22220ffebb None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:39.386901 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc73165-baa1-4298-9b6f-8360613b4acf None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:39.434594 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217b85c-a54b-41d0-9128-5e41583ab3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:39.435673 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217b85c-a54b-41d0-9128-5e41583ab3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:39.436194 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217b85c-a54b-41d0-9128-5e41583ab3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:39.436684 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217b85c-a54b-41d0-9128-5e41583ab3b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:39.437684 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217b85c-a54b-41d0-9128-5e41583ab3b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:39.438199 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217b85c-a54b-41d0-9128-5e41583ab3b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:39.439884 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217b85c-a54b-41d0-9128-5e41583ab3b6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:39.459185 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 256/532] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:31:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:39.460873 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217b85c-a54b-41d0-9128-5e41583ab3b6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:39.489143 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e900a1a-0bfd-4479-842c-2d22220ffebb None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:39.530609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a858c0-e9ed-4678-a504-500b7fd7c58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:39.531635 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a858c0-e9ed-4678-a504-500b7fd7c58a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:39.532161 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a858c0-e9ed-4678-a504-500b7fd7c58a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:39.532648 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a858c0-e9ed-4678-a504-500b7fd7c58a None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:39.533574 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a858c0-e9ed-4678-a504-500b7fd7c58a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:39.534095 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a858c0-e9ed-4678-a504-500b7fd7c58a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:39.535676 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a858c0-e9ed-4678-a504-500b7fd7c58a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:39.554176 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 277/533] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:39.555453 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a858c0-e9ed-4678-a504-500b7fd7c58a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:39.579830 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217b85c-a54b-41d0-9128-5e41583ab3b6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:39.617607 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c95353-e6fc-4f4f-b7e6-6b66c8dc89bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:39.618217 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c95353-e6fc-4f4f-b7e6-6b66c8dc89bf None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:39.618760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c95353-e6fc-4f4f-b7e6-6b66c8dc89bf None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:39.619045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c95353-e6fc-4f4f-b7e6-6b66c8dc89bf None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:39.619813 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c95353-e6fc-4f4f-b7e6-6b66c8dc89bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:39.620124 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c95353-e6fc-4f4f-b7e6-6b66c8dc89bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:39.621522 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c95353-e6fc-4f4f-b7e6-6b66c8dc89bf None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:39.641283 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 257/534] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:39.641283 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c95353-e6fc-4f4f-b7e6-6b66c8dc89bf None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:39.674898 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a858c0-e9ed-4678-a504-500b7fd7c58a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:39.708594 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275d054-8d58-45e8-87c7-a1657cb1771c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:39.709640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275d054-8d58-45e8-87c7-a1657cb1771c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:39.710152 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275d054-8d58-45e8-87c7-a1657cb1771c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:39.710726 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275d054-8d58-45e8-87c7-a1657cb1771c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:39.711808 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275d054-8d58-45e8-87c7-a1657cb1771c None admin] RBAC: Adding query filter params (role.id=ed3e6c61b2d14364a605282f0f1488ba, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=4a08d8e39f6f42bc9b93dd6d2311bcbe) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:39.712335 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275d054-8d58-45e8-87c7-a1657cb1771c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:39.713964 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275d054-8d58-45e8-87c7-a1657cb1771c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:39.720017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 278/535] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:31:39 2022] GET /identity/v3/role_assignments?user.id=4a08d8e39f6f42bc9b93dd6d2311bcbe&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=ed3e6c61b2d14364a605282f0f1488ba => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:39.721138 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275d054-8d58-45e8-87c7-a1657cb1771c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:39.791653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c95353-e6fc-4f4f-b7e6-6b66c8dc89bf None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:39.861209 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cd9e4-edd3-477d-9682-a41ed792b9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:39.862423 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cd9e4-edd3-477d-9682-a41ed792b9ff None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:39.862920 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cd9e4-edd3-477d-9682-a41ed792b9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:39.863397 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cd9e4-edd3-477d-9682-a41ed792b9ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:39.875666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22cd9e4-edd3-477d-9682-a41ed792b9ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:39.878410 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22cd9e4-edd3-477d-9682-a41ed792b9ff None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:39.901954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-f22cd9e4-edd3-477d-9682-a41ed792b9ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:39.901954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:39.901954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:39.901954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:39.901954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:39.901954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:39.901954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:39.901954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:39.901954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:39.901954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:39.901954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:39.901954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:39.901954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:31:39.901954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:31:39.901954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:31:39.902895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:31:39.902895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:39.902895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:39.902895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:39.902895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:39.902895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:39.902895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:39.902895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:39.902895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:39.902895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:39.902895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:39.902895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:39.902895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:39.902895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:39.902895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:39.902895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:39.902895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:39.903817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:31:39.903817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:31:39.903817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:31:39.903817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:31:39.903817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:31:39.903817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:31:39.903817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:39.903817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:39.915260 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275d054-8d58-45e8-87c7-a1657cb1771c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:39.922955 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 258/536] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:39.929810 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cd9e4-edd3-477d-9682-a41ed792b9ff None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:39.974485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83541b-7eb8-46f9-91d2-84c54c4482a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:39.975312 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83541b-7eb8-46f9-91d2-84c54c4482a7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:39.975586 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83541b-7eb8-46f9-91d2-84c54c4482a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:39.976089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83541b-7eb8-46f9-91d2-84c54c4482a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:39.983227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83541b-7eb8-46f9-91d2-84c54c4482a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:39.988780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83541b-7eb8-46f9-91d2-84c54c4482a7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:40.000875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-bd83541b-7eb8-46f9-91d2-84c54c4482a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:40.000875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:40.000875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:40.000875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:40.000875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:40.000875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:40.000875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:40.000875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:40.000875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:40.000875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:40.000875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:40.000875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:40.000875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:31:40.000875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:31:40.000875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:31:40.001896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:31:40.001896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:40.001896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:40.001896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:40.001896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:40.001896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:40.001896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:40.001896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:40.001896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:40.001896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:40.001896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:40.001896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:40.001896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:40.001896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:40.001896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:40.001896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:40.001896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:40.002886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:31:40.002886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:31:40.002886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:31:40.002886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:31:40.002886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:31:40.002886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:31:40.002886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:40.002886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:40.002886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 279/537] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:40.007618 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83541b-7eb8-46f9-91d2-84c54c4482a7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:40.058213 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cd9e4-edd3-477d-9682-a41ed792b9ff None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:40.093295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ab16f-8582-4a6f-a9cf-adf3ab7ad54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:40.094110 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ab16f-8582-4a6f-a9cf-adf3ab7ad54a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:40.094494 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ab16f-8582-4a6f-a9cf-adf3ab7ad54a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:40.094884 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ab16f-8582-4a6f-a9cf-adf3ab7ad54a None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:40.095811 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ab16f-8582-4a6f-a9cf-adf3ab7ad54a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:40.096223 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ab16f-8582-4a6f-a9cf-adf3ab7ad54a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:40.097756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ab16f-8582-4a6f-a9cf-adf3ab7ad54a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:40.107750 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83541b-7eb8-46f9-91d2-84c54c4482a7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:40.114676 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 259/538] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:31:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:40.115964 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ab16f-8582-4a6f-a9cf-adf3ab7ad54a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:40.142616 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39d1a7-3da8-4cfa-aace-179a30a2bcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:40.143206 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39d1a7-3da8-4cfa-aace-179a30a2bcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:40.143489 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39d1a7-3da8-4cfa-aace-179a30a2bcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:40.143792 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39d1a7-3da8-4cfa-aace-179a30a2bcb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:40.144585 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39d1a7-3da8-4cfa-aace-179a30a2bcb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:40.144893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39d1a7-3da8-4cfa-aace-179a30a2bcb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:40.146324 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39d1a7-3da8-4cfa-aace-179a30a2bcb6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:40.158255 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 280/539] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:31:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:40.164433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39d1a7-3da8-4cfa-aace-179a30a2bcb6 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:40.217313 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ab16f-8582-4a6f-a9cf-adf3ab7ad54a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:40.251089 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645a56c-e3c3-4c42-82e5-7e81b73badad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:40.251784 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645a56c-e3c3-4c42-82e5-7e81b73badad None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:40.252069 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645a56c-e3c3-4c42-82e5-7e81b73badad None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:40.252341 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645a56c-e3c3-4c42-82e5-7e81b73badad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:40.253183 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645a56c-e3c3-4c42-82e5-7e81b73badad None admin] RBAC: Adding query filter params (role.id=ed3e6c61b2d14364a605282f0f1488ba, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=5a9cbec1af6545fcb34425dce87d0ef2) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:40.253496 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645a56c-e3c3-4c42-82e5-7e81b73badad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:40.254926 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645a56c-e3c3-4c42-82e5-7e81b73badad None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:40.263232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39d1a7-3da8-4cfa-aace-179a30a2bcb6 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:40.267981 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 260/540] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:31:40 2022] GET /identity/v3/role_assignments?user.id=5a9cbec1af6545fcb34425dce87d0ef2&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=ed3e6c61b2d14364a605282f0f1488ba => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:40.301420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f6ec6-fcc2-4c76-82e5-2d354722589b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:40.302108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f6ec6-fcc2-4c76-82e5-2d354722589b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:40.302373 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f6ec6-fcc2-4c76-82e5-2d354722589b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:40.302647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f6ec6-fcc2-4c76-82e5-2d354722589b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:40.303519 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f6ec6-fcc2-4c76-82e5-2d354722589b None admin] RBAC: Adding query filter params (role.id=ed3e6c61b2d14364a605282f0f1488ba, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=4b5006e095ba41d994dca0bf581417e5) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:40.303866 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f6ec6-fcc2-4c76-82e5-2d354722589b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:40.305428 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f6ec6-fcc2-4c76-82e5-2d354722589b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:40.312061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 281/541] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:31:40 2022] GET /identity/v3/role_assignments?user.id=4b5006e095ba41d994dca0bf581417e5&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=ed3e6c61b2d14364a605282f0f1488ba => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:40.719605 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88347539-3751-4e8d-9b0d-31224c29ddb0 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:40.719605 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88347539-3751-4e8d-9b0d-31224c29ddb0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:40.719605 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88347539-3751-4e8d-9b0d-31224c29ddb0 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:40.719605 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 261/542] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:40.726701 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0373cd-87ae-4538-a066-3d7e6f4e519f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:40.726701 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0373cd-87ae-4538-a066-3d7e6f4e519f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:40.726701 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0373cd-87ae-4538-a066-3d7e6f4e519f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:40.744474 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-8a0373cd-87ae-4538-a066-3d7e6f4e519f None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:40.745962 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8a0373cd-87ae-4538-a066-3d7e6f4e519f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:40.813928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 282/543] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:31:40.837353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88347539-3751-4e8d-9b0d-31224c29ddb0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:40.972423 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88347539-3751-4e8d-9b0d-31224c29ddb0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:41.017275 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a0c4f-7c9a-4dfb-bcff-b7e05eff42f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:41.018075 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a0c4f-7c9a-4dfb-bcff-b7e05eff42f4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:41.018352 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a0c4f-7c9a-4dfb-bcff-b7e05eff42f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:41.018625 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a0c4f-7c9a-4dfb-bcff-b7e05eff42f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:41.036544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a0c4f-7c9a-4dfb-bcff-b7e05eff42f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:41.045273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5b1a0c4f-7c9a-4dfb-bcff-b7e05eff42f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:41.045273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:41.045273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:41.045273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:41.045273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:41.045273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:41.045273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:41.045273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:41.045273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:41.045273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:41.045273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:41.045273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:41.045273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:41.045273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:41.045273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:41.045273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:41.046193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:41.046193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:41.046193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:41.046193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:41.046193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:41.046193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:41.046193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:41.046193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:41.046193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:41.046193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:41.046193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:41.046193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:41.046193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:41.046193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:41.046193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:41.046193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:41.047039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:41.047039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:41.047039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:41.047039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:41.047039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:41.047039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:41.047039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:41.047039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:41.047039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:41.047039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:41.047039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:41.047039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:41.049166 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 262/544] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:31:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:41.054392 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0373cd-87ae-4538-a066-3d7e6f4e519f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:41.178236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0373cd-87ae-4538-a066-3d7e6f4e519f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:41.215466 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cbb1f-b141-4008-9a5c-d3d9701befdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:41.216562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cbb1f-b141-4008-9a5c-d3d9701befdc None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:41.217057 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cbb1f-b141-4008-9a5c-d3d9701befdc None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:41.217539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cbb1f-b141-4008-9a5c-d3d9701befdc None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:41.218486 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cbb1f-b141-4008-9a5c-d3d9701befdc None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:41.218992 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cbb1f-b141-4008-9a5c-d3d9701befdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:41.220589 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cbb1f-b141-4008-9a5c-d3d9701befdc None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:41.229454 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 283/545] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 12 06:31:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:41.240789 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a0c4f-7c9a-4dfb-bcff-b7e05eff42f4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:41.349074 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a0c4f-7c9a-4dfb-bcff-b7e05eff42f4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:41.393036 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c90d7e-02af-4fc0-ace7-f281991d7304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:41.393844 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c90d7e-02af-4fc0-ace7-f281991d7304 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:41.394128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c90d7e-02af-4fc0-ace7-f281991d7304 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:41.394405 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c90d7e-02af-4fc0-ace7-f281991d7304 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:41.411808 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c90d7e-02af-4fc0-ace7-f281991d7304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:41.413355 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c90d7e-02af-4fc0-ace7-f281991d7304 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:41.434971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-38c90d7e-02af-4fc0-ace7-f281991d7304 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:41.434971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:41.434971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:41.434971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:41.434971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:41.434971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:41.434971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:41.434971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:41.434971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:41.434971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:41.434971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:41.434971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:41.434971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:41.434971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:41.434971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:41.435996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:41.435996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:41.435996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:41.435996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:41.435996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:41.435996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:41.435996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:41.435996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:41.435996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:41.435996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:41.435996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:41.435996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:41.435996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:41.435996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:41.435996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:41.435996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:41.435996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:41.436846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:41.436846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:41.436846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:41.436846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:41.436846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 263/546] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:41.443099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cbb1f-b141-4008-9a5c-d3d9701befdc None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:41.572402 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cbb1f-b141-4008-9a5c-d3d9701befdc None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:41.613700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8388feb-d36c-4a67-9942-ef882d42619b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:41.614736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8388feb-d36c-4a67-9942-ef882d42619b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:41.615230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8388feb-d36c-4a67-9942-ef882d42619b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:41.615712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8388feb-d36c-4a67-9942-ef882d42619b None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:41.616666 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8388feb-d36c-4a67-9942-ef882d42619b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:41.617183 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8388feb-d36c-4a67-9942-ef882d42619b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:41.618753 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8388feb-d36c-4a67-9942-ef882d42619b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:41.636265 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 284/547] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:41.642199 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c90d7e-02af-4fc0-ace7-f281991d7304 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:41.780592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c90d7e-02af-4fc0-ace7-f281991d7304 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:41.821657 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00558960-0ad4-4252-8085-29fffb5b612f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:41.822538 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00558960-0ad4-4252-8085-29fffb5b612f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:41.822769 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00558960-0ad4-4252-8085-29fffb5b612f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:41.823044 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00558960-0ad4-4252-8085-29fffb5b612f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:41.833411 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00558960-0ad4-4252-8085-29fffb5b612f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:41.834898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00558960-0ad4-4252-8085-29fffb5b612f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:41.855589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-00558960-0ad4-4252-8085-29fffb5b612f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 06:31:41.855589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:41.855589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:41.855589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:41.855589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:41.855589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:41.855589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:41.855589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:41.855589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:41.855589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:41.855589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:41.855589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:41.855589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:31:41.855589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:31:41.855589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:31:41.855589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:31:41.856599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:41.856599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:41.856599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:31:41.856599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:41.856599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:31:41.856599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:41.856599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:41.856599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:41.856599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:41.856599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:41.856599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:41.856599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:41.856599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:41.856599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:41.856599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:41.856599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:41.856599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:41.856599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:41.857518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:41.857518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:41.857518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:31:41.857518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:31:41.857518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:31:41.857518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:31:41.857518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:31:41.857518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:31:41.857518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 06:31:41.857518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:41.860953 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 264/548] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:31:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:41.866842 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8388feb-d36c-4a67-9942-ef882d42619b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:42.014572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8388feb-d36c-4a67-9942-ef882d42619b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:42.065876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1733953-d763-45bf-87bb-1e825b7a666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:42.066567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1733953-d763-45bf-87bb-1e825b7a666a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:42.066854 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1733953-d763-45bf-87bb-1e825b7a666a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:42.067125 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1733953-d763-45bf-87bb-1e825b7a666a None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:42.068074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1733953-d763-45bf-87bb-1e825b7a666a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:42.068387 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1733953-d763-45bf-87bb-1e825b7a666a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:42.069884 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1733953-d763-45bf-87bb-1e825b7a666a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:42.095464 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 285/549] 10.222.0.25 () {56 vars in 1135 bytes} [Thu May 12 06:31:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:42.100989 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00558960-0ad4-4252-8085-29fffb5b612f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:42.202797 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8f3a1-3393-4a0b-856a-3559a35ff646 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:42.203117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8f3a1-3393-4a0b-856a-3559a35ff646 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:42.203371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8f3a1-3393-4a0b-856a-3559a35ff646 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:42.204930 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 286/550] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:31:42.214215 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40701c-7b50-41c0-b16a-c0f9e173861c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:42.214215 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40701c-7b50-41c0-b16a-c0f9e173861c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:42.214215 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40701c-7b50-41c0-b16a-c0f9e173861c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:42.229844 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00558960-0ad4-4252-8085-29fffb5b612f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:42.255396 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-8e40701c-7b50-41c0-b16a-c0f9e173861c None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:42.257014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8e40701c-7b50-41c0-b16a-c0f9e173861c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:42.270259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883d7e4-30b1-4616-9614-2b643cb5f757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:42.270918 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883d7e4-30b1-4616-9614-2b643cb5f757 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:42.271200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883d7e4-30b1-4616-9614-2b643cb5f757 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:42.271474 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883d7e4-30b1-4616-9614-2b643cb5f757 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:42.359656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 287/551] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:31:42.381138 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883d7e4-30b1-4616-9614-2b643cb5f757 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:42.383041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40701c-7b50-41c0-b16a-c0f9e173861c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:42.383154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883d7e4-30b1-4616-9614-2b643cb5f757 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:42.483320 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40701c-7b50-41c0-b16a-c0f9e173861c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:42.531122 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c400f7-d2c9-423e-a684-efbc747f5752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:42.532425 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c400f7-d2c9-423e-a684-efbc747f5752 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:42.532916 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c400f7-d2c9-423e-a684-efbc747f5752 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:42.533392 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c400f7-d2c9-423e-a684-efbc747f5752 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:42.540054 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 265/552] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:42.551011 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883d7e4-30b1-4616-9614-2b643cb5f757 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:42.555430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c400f7-d2c9-423e-a684-efbc747f5752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:42.563654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-01c400f7-d2c9-423e-a684-efbc747f5752 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:42.563654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:42.563654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:42.563654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:42.563654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:42.563654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:42.563654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:42.563654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:42.563654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:42.563654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:42.563654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:42.563654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:42.563654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:42.563654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:42.563654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:42.563654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:42.564561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:42.564561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:42.564561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:42.564561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:42.564561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:42.564561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:42.564561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:42.564561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:42.564561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:42.564561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:42.564561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:42.564561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:42.564561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:42.564561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:42.564561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:42.564561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:42.565368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:42.565368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:42.565368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:42.565368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:42.565368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:42.565368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:42.565368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:42.565368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:42.565368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:42.565368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:42.565368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:42.565368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:42.568032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 288/553] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:31:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:31:42.574258 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c400f7-d2c9-423e-a684-efbc747f5752 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:42.677363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c400f7-d2c9-423e-a684-efbc747f5752 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:42.707788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883d7e4-30b1-4616-9614-2b643cb5f757 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:42.710833 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d12cf-1d9d-405e-bf89-625ad7394355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:42.711515 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d12cf-1d9d-405e-bf89-625ad7394355 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:42.711845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d12cf-1d9d-405e-bf89-625ad7394355 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:42.712125 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d12cf-1d9d-405e-bf89-625ad7394355 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:42.712879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d12cf-1d9d-405e-bf89-625ad7394355 None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:42.713188 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d12cf-1d9d-405e-bf89-625ad7394355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:42.714561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d12cf-1d9d-405e-bf89-625ad7394355 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:42.723829 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 289/554] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 12 06:31:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:42.724084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429181d7-49ba-4d95-8f85-a98784aff867 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:42.724376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429181d7-49ba-4d95-8f85-a98784aff867 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:42.724656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429181d7-49ba-4d95-8f85-a98784aff867 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:42.727829 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 290/555] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:42.729170 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d4f62-cd1c-4517-bb52-a386b4778861 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:42.729556 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d4f62-cd1c-4517-bb52-a386b4778861 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:42.730300 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d4f62-cd1c-4517-bb52-a386b4778861 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:42.731332 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 291/556] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:42.732068 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d4f62-cd1c-4517-bb52-a386b4778861 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:42.744477 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7935b-8b3e-4751-8a7b-89bdaad7627b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:42.745497 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7935b-8b3e-4751-8a7b-89bdaad7627b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:42.745929 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7935b-8b3e-4751-8a7b-89bdaad7627b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:42.746345 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7935b-8b3e-4751-8a7b-89bdaad7627b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:42.756418 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7935b-8b3e-4751-8a7b-89bdaad7627b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:42.758473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7935b-8b3e-4751-8a7b-89bdaad7627b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:42.775979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-f8c7935b-8b3e-4751-8a7b-89bdaad7627b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:42.775979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:42.775979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:42.775979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:42.775979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:42.775979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:42.775979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:42.775979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:42.775979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:42.775979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:42.775979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:42.775979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:42.775979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:42.775979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:42.775979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:42.776870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:42.776870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:42.776870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:42.776870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:42.776870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:42.776870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:42.776870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:42.776870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:42.776870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:42.776870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:42.776870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:42.776870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:42.776870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:42.776870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:42.776870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:42.776870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:42.776870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:42.782354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:42.782354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:42.782354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:42.782354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:42.782354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 266/557] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:31:42.782354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a509c-b99d-45b1-8a76-481918b009da None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:42.782354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a509c-b99d-45b1-8a76-481918b009da None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:42.782354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a509c-b99d-45b1-8a76-481918b009da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:42.796050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d72a509c-b99d-45b1-8a76-481918b009da None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:42.797244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d72a509c-b99d-45b1-8a76-481918b009da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:42.843295 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d4f62-cd1c-4517-bb52-a386b4778861 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:42.862267 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 267/558] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:42.863916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8536f5a-e972-4df3-a6fb-3f3b05d9ddee None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:42.864428 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8536f5a-e972-4df3-a6fb-3f3b05d9ddee None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:42.864903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8536f5a-e972-4df3-a6fb-3f3b05d9ddee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:42.883409 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a8536f5a-e972-4df3-a6fb-3f3b05d9ddee None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:42.884923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a8536f5a-e972-4df3-a6fb-3f3b05d9ddee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:42.889584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141175fd-6b37-42c3-b934-2bffffb7d7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:42.890390 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141175fd-6b37-42c3-b934-2bffffb7d7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:42.890668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141175fd-6b37-42c3-b934-2bffffb7d7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:42.890930 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141175fd-6b37-42c3-b934-2bffffb7d7b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:42.903968 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141175fd-6b37-42c3-b934-2bffffb7d7b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:42.905800 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141175fd-6b37-42c3-b934-2bffffb7d7b2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:42.926793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-141175fd-6b37-42c3-b934-2bffffb7d7b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:42.926793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:42.926793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:42.926793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:42.926793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:42.926793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:42.926793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:42.926793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:42.926793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:42.926793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:42.926793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:42.926793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:42.926793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:42.926793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:42.926793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:42.936522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:42.936522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:42.936522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:42.936522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:42.936522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:42.936522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:42.936522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:42.936522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:42.936522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:42.936522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:42.936522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:42.936522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:42.936522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:42.936522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:42.936522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:42.936522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:42.936522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:42.937632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:42.937632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:42.937632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:42.937632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:42.937632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 292/559] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:42.937632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141175fd-6b37-42c3-b934-2bffffb7d7b2 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:42.958683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 268/560] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:42.965569 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8536f5a-e972-4df3-a6fb-3f3b05d9ddee None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:43.047334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141175fd-6b37-42c3-b934-2bffffb7d7b2 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:43.081180 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b460e7-6564-412b-9dc1-b75c514524ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:43.081854 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b460e7-6564-412b-9dc1-b75c514524ab None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:43.081971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8536f5a-e972-4df3-a6fb-3f3b05d9ddee None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:43.082148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b460e7-6564-412b-9dc1-b75c514524ab None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:43.082405 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b460e7-6564-412b-9dc1-b75c514524ab None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:43.083129 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b460e7-6564-412b-9dc1-b75c514524ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:43.083440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b460e7-6564-412b-9dc1-b75c514524ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:43.084847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b460e7-6564-412b-9dc1-b75c514524ab None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:43.098856 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 293/561] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:43.098856 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b460e7-6564-412b-9dc1-b75c514524ab None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:43.122004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ab7da-7aed-42ae-888b-3e35ab58b186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:43.122795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ab7da-7aed-42ae-888b-3e35ab58b186 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:43.123077 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ab7da-7aed-42ae-888b-3e35ab58b186 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:43.123350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ab7da-7aed-42ae-888b-3e35ab58b186 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:43.134587 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ab7da-7aed-42ae-888b-3e35ab58b186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:43.142372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-422ab7da-7aed-42ae-888b-3e35ab58b186 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:43.142372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:43.142372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:43.142372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:43.142372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:43.142372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:43.142372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:43.142372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:43.142372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:43.142372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:43.142372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:43.142372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:43.142372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:43.142372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:43.142372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:43.142372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:43.143546 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:43.143546 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:43.143546 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:43.143546 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:43.143546 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:43.143546 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:43.143546 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:43.143546 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:43.143546 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:43.143546 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:43.143546 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:43.143546 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:43.143546 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:43.143546 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:43.143546 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:43.143546 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:43.144406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:43.144406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:43.144406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:43.144406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:43.144406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:43.144406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:43.144406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:43.144406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:43.144406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:43.144406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:43.144406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:43.144406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:43.144406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 269/562] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:31:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:43.144406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ab7da-7aed-42ae-888b-3e35ab58b186 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:43.202010 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b460e7-6564-412b-9dc1-b75c514524ab None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:43.235147 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b25a14-6184-4df9-8545-18b1b70a7672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:43.235847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b25a14-6184-4df9-8545-18b1b70a7672 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:43.236132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b25a14-6184-4df9-8545-18b1b70a7672 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:43.236406 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b25a14-6184-4df9-8545-18b1b70a7672 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:43.237137 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b25a14-6184-4df9-8545-18b1b70a7672 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:43.237444 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b25a14-6184-4df9-8545-18b1b70a7672 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:43.238798 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b25a14-6184-4df9-8545-18b1b70a7672 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:43.243702 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ab7da-7aed-42ae-888b-3e35ab58b186 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:43.249469 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 294/563] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:43.250254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b25a14-6184-4df9-8545-18b1b70a7672 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:43.276375 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62fd9c-d3df-4b11-807d-29f35a3b1233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:43.277159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62fd9c-d3df-4b11-807d-29f35a3b1233 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:43.277445 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62fd9c-d3df-4b11-807d-29f35a3b1233 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:43.277722 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62fd9c-d3df-4b11-807d-29f35a3b1233 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:43.287299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62fd9c-d3df-4b11-807d-29f35a3b1233 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:43.295424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-6d62fd9c-d3df-4b11-807d-29f35a3b1233 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:43.295424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:43.295424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:43.295424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:43.295424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:43.295424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:43.295424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:43.295424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:43.295424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:43.295424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:43.295424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:43.295424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:43.295424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:43.295424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:43.295424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:43.295424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:43.296559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:43.296559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:43.296559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:43.296559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:43.296559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:43.296559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:43.296559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:43.296559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:43.296559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:43.296559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:43.296559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:43.296559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:43.296559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:43.296559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:43.296559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:43.296559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:43.297406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:43.297406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:43.297406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:43.297406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:43.297406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:43.297406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:43.297406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:43.297406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:43.297406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:43.297406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:43.297406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:43.297406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:43.297406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 270/564] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:31:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:43.297406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62fd9c-d3df-4b11-807d-29f35a3b1233 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:43.348527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b25a14-6184-4df9-8545-18b1b70a7672 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:43.379317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09112fb9-24df-412b-9449-cf8d5d132b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:43.380140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09112fb9-24df-412b-9449-cf8d5d132b0d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:43.380451 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09112fb9-24df-412b-9449-cf8d5d132b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:43.380728 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09112fb9-24df-412b-9449-cf8d5d132b0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:43.387700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09112fb9-24df-412b-9449-cf8d5d132b0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:43.389139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09112fb9-24df-412b-9449-cf8d5d132b0d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:43.390142 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62fd9c-d3df-4b11-807d-29f35a3b1233 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:43.403702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-09112fb9-24df-412b-9449-cf8d5d132b0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:43.403702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:43.403702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:43.403702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:43.403702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:43.403702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:43.403702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:43.403702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:43.403702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:43.403702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:43.403702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:43.403702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:43.403702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:31:43.403702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:31:43.403702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:31:43.404734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:31:43.404734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:43.404734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:43.404734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:43.404734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:43.404734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:43.404734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:43.404734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:43.404734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:43.404734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:43.404734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:43.404734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:43.404734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:43.404734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:43.404734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:43.404734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:43.404734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:43.405653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:31:43.405653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:31:43.405653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:31:43.405653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:31:43.405653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:31:43.405653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:31:43.405653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:43.405653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:43.405653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 295/565] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:43.406483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eafb04-5e6c-4a14-9467-6811db06eb4f None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:43.406774 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eafb04-5e6c-4a14-9467-6811db06eb4f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:43.407051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eafb04-5e6c-4a14-9467-6811db06eb4f None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:43.408458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 296/566] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:43.409075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eafb04-5e6c-4a14-9467-6811db06eb4f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:43.425954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fc50c-3c9f-4877-a0ba-2b8bed34721e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:43.426615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fc50c-3c9f-4877-a0ba-2b8bed34721e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:43.426897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fc50c-3c9f-4877-a0ba-2b8bed34721e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:43.427176 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fc50c-3c9f-4877-a0ba-2b8bed34721e None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:43.427956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fc50c-3c9f-4877-a0ba-2b8bed34721e None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:43.428267 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fc50c-3c9f-4877-a0ba-2b8bed34721e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:43.429649 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fc50c-3c9f-4877-a0ba-2b8bed34721e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:43.437306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 271/567] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 12 06:31:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:43.438080 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fc50c-3c9f-4877-a0ba-2b8bed34721e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:43.509800 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eafb04-5e6c-4a14-9467-6811db06eb4f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:43.531474 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fc50c-3c9f-4877-a0ba-2b8bed34721e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:43.541283 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abb969-9392-43e5-b648-8f6ee29b902f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:43.542071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abb969-9392-43e5-b648-8f6ee29b902f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:43.542357 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abb969-9392-43e5-b648-8f6ee29b902f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:43.542633 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abb969-9392-43e5-b648-8f6ee29b902f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:43.549391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abb969-9392-43e5-b648-8f6ee29b902f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:43.550840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abb969-9392-43e5-b648-8f6ee29b902f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:43.563290 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934f95c-029f-477c-88fd-7cd7e73e24a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:43.563965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934f95c-029f-477c-88fd-7cd7e73e24a9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:43.564250 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934f95c-029f-477c-88fd-7cd7e73e24a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:43.564526 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934f95c-029f-477c-88fd-7cd7e73e24a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:43.565278 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934f95c-029f-477c-88fd-7cd7e73e24a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:43.565581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-09abb969-9392-43e5-b648-8f6ee29b902f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 06:31:43.565581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:43.565581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:43.565581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:43.565581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:43.565581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:43.565581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:43.565581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:43.565581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:43.565581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:43.565581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:43.565581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:43.565581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:31:43.565581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:31:43.565581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:31:43.565581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:31:43.566531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:43.566531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:43.566531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:31:43.566531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:43.566531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:31:43.566531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:43.566531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:43.566531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:43.566531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:43.566531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:43.566531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:43.566531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:43.566531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:43.566531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:43.566531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:43.566531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:43.566531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:43.566531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:43.567468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:43.567468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:43.567468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:31:43.567468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:31:43.567468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:31:43.567468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:31:43.567468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:31:43.567468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:31:43.567468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 06:31:43.567468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:43.568378 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934f95c-029f-477c-88fd-7cd7e73e24a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:43.568450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 297/568] 10.222.0.25 () {56 vars in 1093 bytes} [Thu May 12 06:31:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:43.568518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934f95c-029f-477c-88fd-7cd7e73e24a9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:43.568586 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abb969-9392-43e5-b648-8f6ee29b902f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:43.575035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 272/569] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 12 06:31:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:43.576336 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8cc69-0f7b-451c-a6fa-27e170203ba1 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:43.576703 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8cc69-0f7b-451c-a6fa-27e170203ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:43.577055 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8cc69-0f7b-451c-a6fa-27e170203ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:43.593081 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-23d8cc69-0f7b-451c-a6fa-27e170203ba1 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:43.594268 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-23d8cc69-0f7b-451c-a6fa-27e170203ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:43.656338 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 273/570] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:43.657349 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8cc69-0f7b-451c-a6fa-27e170203ba1 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:43.663915 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abb969-9392-43e5-b648-8f6ee29b902f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:43.697182 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db05a3-b123-4788-95e5-3d68b4c9d450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:43.697844 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db05a3-b123-4788-95e5-3d68b4c9d450 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:43.698125 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db05a3-b123-4788-95e5-3d68b4c9d450 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:43.698403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db05a3-b123-4788-95e5-3d68b4c9d450 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:43.699187 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db05a3-b123-4788-95e5-3d68b4c9d450 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:43.699492 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db05a3-b123-4788-95e5-3d68b4c9d450 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:43.700953 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db05a3-b123-4788-95e5-3d68b4c9d450 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:43.712612 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 298/571] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:31:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:43.713242 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db05a3-b123-4788-95e5-3d68b4c9d450 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:43.751279 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8cc69-0f7b-451c-a6fa-27e170203ba1 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:43.783403 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a411e-6bf2-4168-96ca-2477e17fe74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:43.784158 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a411e-6bf2-4168-96ca-2477e17fe74c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:43.784437 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a411e-6bf2-4168-96ca-2477e17fe74c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:43.784710 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a411e-6bf2-4168-96ca-2477e17fe74c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:43.794624 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a411e-6bf2-4168-96ca-2477e17fe74c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:43.796093 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a411e-6bf2-4168-96ca-2477e17fe74c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:43.805503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db05a3-b123-4788-95e5-3d68b4c9d450 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:43.814115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-0f7a411e-6bf2-4168-96ca-2477e17fe74c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:43.814115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:43.814115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:43.814115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:43.814115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:43.814115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:43.814115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:43.814115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:43.814115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:43.814115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:43.814115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:43.814115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:43.814115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:43.814115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:43.814115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:43.815159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:43.815159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:43.815159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:43.815159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:43.815159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:43.815159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:43.815159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:43.815159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:43.815159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:43.815159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:43.815159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:43.815159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:43.815159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:43.815159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:43.815159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:43.815159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:43.815159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:43.816703 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:43.816703 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:43.816703 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:43.816703 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:43.816703 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 274/572] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:43.816703 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a411e-6bf2-4168-96ca-2477e17fe74c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:43.837796 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4b298-6824-4617-80bd-78431e5890cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:43.838469 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4b298-6824-4617-80bd-78431e5890cc None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:43.838750 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4b298-6824-4617-80bd-78431e5890cc None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:43.839024 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4b298-6824-4617-80bd-78431e5890cc None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:43.839890 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4b298-6824-4617-80bd-78431e5890cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:43.840207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4b298-6824-4617-80bd-78431e5890cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:43.841609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4b298-6824-4617-80bd-78431e5890cc None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:43.859865 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 299/573] 10.222.0.25 () {56 vars in 1133 bytes} [Thu May 12 06:31:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:43.860656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4b298-6824-4617-80bd-78431e5890cc None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:43.911103 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a411e-6bf2-4168-96ca-2477e17fe74c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:43.943732 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20054832-935e-46b0-980d-cabc9edea4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:43.945040 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20054832-935e-46b0-980d-cabc9edea4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:43.945324 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20054832-935e-46b0-980d-cabc9edea4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:43.945594 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20054832-935e-46b0-980d-cabc9edea4d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:43.953200 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4b298-6824-4617-80bd-78431e5890cc None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:43.955202 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20054832-935e-46b0-980d-cabc9edea4d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:43.956684 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20054832-935e-46b0-980d-cabc9edea4d4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:43.974071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-20054832-935e-46b0-980d-cabc9edea4d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:43.974071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:43.974071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:43.974071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:43.974071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:43.974071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:43.974071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:43.974071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:43.974071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:43.974071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:43.974071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:43.974071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:43.974071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:43.974071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:43.974071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:43.975189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:43.975189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:43.975189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:43.975189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:43.975189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:43.975189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:43.975189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:43.975189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:43.975189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:43.975189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:43.975189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:43.975189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:43.975189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:43.975189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:43.975189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:43.975189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:43.975189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:43.977719 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:43.977719 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:43.977719 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:43.977719 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:43.977719 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 275/574] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:43.977719 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20054832-935e-46b0-980d-cabc9edea4d4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:43.994014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364b22b-6521-4550-889e-f829118afb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:43.994825 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364b22b-6521-4550-889e-f829118afb89 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:43.995106 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364b22b-6521-4550-889e-f829118afb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:43.995377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364b22b-6521-4550-889e-f829118afb89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:44.005468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364b22b-6521-4550-889e-f829118afb89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:44.013858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-6364b22b-6521-4550-889e-f829118afb89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:44.013858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:44.013858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:44.013858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:44.013858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:44.013858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:44.013858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:44.013858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:44.013858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:44.013858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:44.013858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:44.013858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:44.013858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:44.013858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:44.013858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:44.013858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:44.015009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:44.015009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:44.015009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:44.015009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:44.015009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:44.015009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:44.015009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:44.015009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:44.015009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:44.015009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:44.015009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:44.015009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:44.015009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:44.015009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:44.015009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:44.015009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:44.016027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:44.016027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:44.016027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:44.016027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:44.016027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:44.016027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:44.016027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:44.016027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:44.016027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:44.016027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:44.016027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:44.016027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:44.016027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 300/575] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:31:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:44.016027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364b22b-6521-4550-889e-f829118afb89 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:44.075778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20054832-935e-46b0-980d-cabc9edea4d4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:44.107215 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6422d-c0ad-4070-97f7-68c8e0cf8773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:44.107881 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6422d-c0ad-4070-97f7-68c8e0cf8773 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:44.108159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6422d-c0ad-4070-97f7-68c8e0cf8773 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:44.108425 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6422d-c0ad-4070-97f7-68c8e0cf8773 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:44.109257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6422d-c0ad-4070-97f7-68c8e0cf8773 None admin] RBAC: Adding query filter params (role.id=ed3e6c61b2d14364a605282f0f1488ba, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=a9882820f88349cb8fa2e3d457b19959) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:44.109563 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6422d-c0ad-4070-97f7-68c8e0cf8773 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:44.110115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364b22b-6521-4550-889e-f829118afb89 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:44.110969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6422d-c0ad-4070-97f7-68c8e0cf8773 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:44.116833 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 276/576] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:31:43 2022] GET /identity/v3/role_assignments?user.id=a9882820f88349cb8fa2e3d457b19959&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=ed3e6c61b2d14364a605282f0f1488ba => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:44.117578 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6422d-c0ad-4070-97f7-68c8e0cf8773 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:44.144558 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b956a-f489-44d1-855a-6284eef58083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:44.145239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b956a-f489-44d1-855a-6284eef58083 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:44.145517 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b956a-f489-44d1-855a-6284eef58083 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:44.145786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b956a-f489-44d1-855a-6284eef58083 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:44.146533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b956a-f489-44d1-855a-6284eef58083 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:44.146834 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b956a-f489-44d1-855a-6284eef58083 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:44.148323 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b956a-f489-44d1-855a-6284eef58083 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:44.160776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 301/577] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:44.161608 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b956a-f489-44d1-855a-6284eef58083 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:44.226916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6422d-c0ad-4070-97f7-68c8e0cf8773 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:44.262536 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723daeb9-6ed5-46fb-8d18-9f65acbe2043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:44.263336 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723daeb9-6ed5-46fb-8d18-9f65acbe2043 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:44.263619 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723daeb9-6ed5-46fb-8d18-9f65acbe2043 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:44.263925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723daeb9-6ed5-46fb-8d18-9f65acbe2043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:44.274962 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723daeb9-6ed5-46fb-8d18-9f65acbe2043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:44.275207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b956a-f489-44d1-855a-6284eef58083 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:44.276471 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723daeb9-6ed5-46fb-8d18-9f65acbe2043 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:44.295160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-723daeb9-6ed5-46fb-8d18-9f65acbe2043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:44.295160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:44.295160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:44.295160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:44.295160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:44.295160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:44.295160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:44.295160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:44.295160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:44.295160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:44.295160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:44.295160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:44.295160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:44.295160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:44.295160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:44.296366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:44.296366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:44.296366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:44.296366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:44.296366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:44.296366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:44.296366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:44.296366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:44.296366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:44.296366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:44.296366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:44.296366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:44.296366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:44.296366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:44.296366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:44.296366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:44.296366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:44.298153 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:44.298153 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:44.298153 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:44.298153 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:44.298675 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 277/578] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:44.299811 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723daeb9-6ed5-46fb-8d18-9f65acbe2043 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:44.310866 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b984b3-76a0-45a1-9bba-8d726bd341b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:44.311539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b984b3-76a0-45a1-9bba-8d726bd341b5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:44.311868 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b984b3-76a0-45a1-9bba-8d726bd341b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:44.312143 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b984b3-76a0-45a1-9bba-8d726bd341b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:44.312877 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b984b3-76a0-45a1-9bba-8d726bd341b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:44.313177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b984b3-76a0-45a1-9bba-8d726bd341b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:44.314533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b984b3-76a0-45a1-9bba-8d726bd341b5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:44.331139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 302/579] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:44.331139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b984b3-76a0-45a1-9bba-8d726bd341b5 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:44.398999 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723daeb9-6ed5-46fb-8d18-9f65acbe2043 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:44.422552 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b984b3-76a0-45a1-9bba-8d726bd341b5 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:44.433260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f180b17-708a-4cf8-8095-e7d0c55fcd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:44.433922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f180b17-708a-4cf8-8095-e7d0c55fcd0a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:44.434199 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f180b17-708a-4cf8-8095-e7d0c55fcd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:44.434458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f180b17-708a-4cf8-8095-e7d0c55fcd0a None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:44.435214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f180b17-708a-4cf8-8095-e7d0c55fcd0a None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:44.435515 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f180b17-708a-4cf8-8095-e7d0c55fcd0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:44.436915 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f180b17-708a-4cf8-8095-e7d0c55fcd0a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:44.445230 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 278/580] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 12 06:31:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:44.446083 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f180b17-708a-4cf8-8095-e7d0c55fcd0a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:44.456944 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be51707-b5ea-4ac8-acb1-5e2bb184130f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:44.457976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be51707-b5ea-4ac8-acb1-5e2bb184130f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:44.458404 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be51707-b5ea-4ac8-acb1-5e2bb184130f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:44.458842 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be51707-b5ea-4ac8-acb1-5e2bb184130f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:44.467347 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be51707-b5ea-4ac8-acb1-5e2bb184130f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:44.468823 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be51707-b5ea-4ac8-acb1-5e2bb184130f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:44.483238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-3be51707-b5ea-4ac8-acb1-5e2bb184130f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 06:31:44.483238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:44.483238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:44.483238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:44.483238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:44.483238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:44.483238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:44.483238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:44.483238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:44.483238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:44.483238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:44.483238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:44.483238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:31:44.483238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:31:44.483238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:31:44.483238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:31:44.484477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:44.484477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:44.484477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:31:44.484477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:44.484477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:31:44.484477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:44.484477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:44.484477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:44.484477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:44.484477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:44.484477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:44.484477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:44.484477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:44.484477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:44.484477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:44.484477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:44.484477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:44.484477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:44.485677 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:44.485677 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:44.485677 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:31:44.485677 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:31:44.485677 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:31:44.485677 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:31:44.485677 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:31:44.485677 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:31:44.485677 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 06:31:44.485677 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:44.491905 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 303/581] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:44.491905 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be51707-b5ea-4ac8-acb1-5e2bb184130f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:44.544591 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f180b17-708a-4cf8-8095-e7d0c55fcd0a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:44.577076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a6c9e-b87c-448b-85b4-20c2447d44af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:44.577877 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a6c9e-b87c-448b-85b4-20c2447d44af None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:44.578159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a6c9e-b87c-448b-85b4-20c2447d44af None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:44.578429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a6c9e-b87c-448b-85b4-20c2447d44af None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:44.579152 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a6c9e-b87c-448b-85b4-20c2447d44af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:44.579453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a6c9e-b87c-448b-85b4-20c2447d44af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:44.580848 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a6c9e-b87c-448b-85b4-20c2447d44af None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:44.584076 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be51707-b5ea-4ac8-acb1-5e2bb184130f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:44.597638 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 279/582] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:44.597638 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a6c9e-b87c-448b-85b4-20c2447d44af None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:44.618041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12662f-fd68-41cd-bca6-4bcd5a4c20c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:44.618847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12662f-fd68-41cd-bca6-4bcd5a4c20c9 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:44.619120 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12662f-fd68-41cd-bca6-4bcd5a4c20c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:44.619396 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12662f-fd68-41cd-bca6-4bcd5a4c20c9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:44.626808 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12662f-fd68-41cd-bca6-4bcd5a4c20c9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:44.628441 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12662f-fd68-41cd-bca6-4bcd5a4c20c9 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:44.642891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-3f12662f-fd68-41cd-bca6-4bcd5a4c20c9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 06:31:44.642891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:44.642891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:44.642891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:44.642891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:44.642891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:44.642891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:44.642891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:44.642891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:44.642891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:44.642891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:44.642891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:44.642891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:31:44.642891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:31:44.642891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:31:44.642891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:31:44.644074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:44.644074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:44.644074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:31:44.644074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:44.644074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:31:44.644074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:44.644074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:44.644074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:44.644074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:44.644074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:44.644074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:44.644074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:44.644074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:44.644074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:44.644074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:44.644074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:44.644074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:44.644074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:44.645108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:44.645108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:44.645108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:31:44.645108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:31:44.645108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:31:44.645108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:31:44.645108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:31:44.645108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:31:44.645108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 06:31:44.645108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:44.645108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 304/583] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:31:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:44.645108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12662f-fd68-41cd-bca6-4bcd5a4c20c9 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:44.699174 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a6c9e-b87c-448b-85b4-20c2447d44af None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:44.732317 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec398adc-2537-49a0-9d60-b75c301a4ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:44.733251 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec398adc-2537-49a0-9d60-b75c301a4ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:44.733638 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec398adc-2537-49a0-9d60-b75c301a4ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:44.734010 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec398adc-2537-49a0-9d60-b75c301a4ed4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:44.743867 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec398adc-2537-49a0-9d60-b75c301a4ed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:44.745059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12662f-fd68-41cd-bca6-4bcd5a4c20c9 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:44.745296 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec398adc-2537-49a0-9d60-b75c301a4ed4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:44.763136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-ec398adc-2537-49a0-9d60-b75c301a4ed4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:44.763136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:44.763136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:44.763136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:44.763136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:44.763136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:44.763136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:44.763136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:44.763136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:44.763136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:44.763136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:44.763136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:44.763136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:44.763136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:44.763136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:44.764266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:44.764266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:44.764266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:44.764266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:44.764266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:44.764266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:44.764266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:44.764266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:44.764266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:44.764266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:44.764266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:44.764266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:44.764266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:44.764266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:44.764266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:44.764266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:44.764266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:44.765516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:44.765516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:44.765516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:44.765516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:44.765516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 280/584] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:44.765516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec398adc-2537-49a0-9d60-b75c301a4ed4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:44.782895 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e47ad-f282-4fc7-89c8-a5ac2f18bb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:44.783884 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e47ad-f282-4fc7-89c8-a5ac2f18bb2a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:44.784324 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e47ad-f282-4fc7-89c8-a5ac2f18bb2a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:44.784600 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e47ad-f282-4fc7-89c8-a5ac2f18bb2a None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:44.785445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e47ad-f282-4fc7-89c8-a5ac2f18bb2a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:44.785750 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e47ad-f282-4fc7-89c8-a5ac2f18bb2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:44.787159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e47ad-f282-4fc7-89c8-a5ac2f18bb2a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:44.808486 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 305/585] 10.222.0.25 () {56 vars in 1137 bytes} [Thu May 12 06:31:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:44.808486 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e47ad-f282-4fc7-89c8-a5ac2f18bb2a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:44.862209 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec398adc-2537-49a0-9d60-b75c301a4ed4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:44.895766 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97741ec-3c55-44c1-be9b-5e67d3595ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:44.896566 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97741ec-3c55-44c1-be9b-5e67d3595ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:44.896851 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97741ec-3c55-44c1-be9b-5e67d3595ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:44.897126 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97741ec-3c55-44c1-be9b-5e67d3595ba2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:44.903810 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97741ec-3c55-44c1-be9b-5e67d3595ba2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:44.904554 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e47ad-f282-4fc7-89c8-a5ac2f18bb2a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:44.905236 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97741ec-3c55-44c1-be9b-5e67d3595ba2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:44.919521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-a97741ec-3c55-44c1-be9b-5e67d3595ba2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:44.919521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:44.919521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:44.919521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:44.919521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:44.919521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:44.919521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:44.919521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:44.919521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:44.919521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:44.919521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:44.919521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:44.919521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:31:44.919521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:31:44.919521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:31:44.920683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:31:44.920683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:44.920683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:44.920683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:44.920683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:44.920683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:44.920683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:44.920683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:44.920683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:44.920683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:44.920683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:44.920683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:44.920683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:44.920683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:44.920683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:44.920683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:44.920683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:44.921801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:31:44.921801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:31:44.921801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:31:44.921801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:31:44.921801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:31:44.921801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:31:44.921801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:44.921801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:44.925259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 281/586] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:44.925953 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97741ec-3c55-44c1-be9b-5e67d3595ba2 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:44.941890 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1439b0a-c787-4c8a-8bd8-99ea223c3928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:44.942719 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1439b0a-c787-4c8a-8bd8-99ea223c3928 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:44.943101 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1439b0a-c787-4c8a-8bd8-99ea223c3928 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:44.943472 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1439b0a-c787-4c8a-8bd8-99ea223c3928 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:44.944981 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1439b0a-c787-4c8a-8bd8-99ea223c3928 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:44.945432 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1439b0a-c787-4c8a-8bd8-99ea223c3928 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:44.946907 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1439b0a-c787-4c8a-8bd8-99ea223c3928 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:44.968521 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 306/587] 10.222.0.25 () {56 vars in 1139 bytes} [Thu May 12 06:31:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:44.968521 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1439b0a-c787-4c8a-8bd8-99ea223c3928 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:45.025080 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97741ec-3c55-44c1-be9b-5e67d3595ba2 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:45.057814 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e30a2-4452-4324-87a6-bbac9d623868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:45.058551 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e30a2-4452-4324-87a6-bbac9d623868 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:45.058934 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e30a2-4452-4324-87a6-bbac9d623868 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:45.059310 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e30a2-4452-4324-87a6-bbac9d623868 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:45.060277 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e30a2-4452-4324-87a6-bbac9d623868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:45.060701 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e30a2-4452-4324-87a6-bbac9d623868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:45.062158 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e30a2-4452-4324-87a6-bbac9d623868 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:45.063062 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1439b0a-c787-4c8a-8bd8-99ea223c3928 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:45.079758 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 282/588] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:45.079758 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e30a2-4452-4324-87a6-bbac9d623868 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:45.096873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458d37b-6780-49a8-ac99-5009dc3843f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:45.097667 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458d37b-6780-49a8-ac99-5009dc3843f9 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:45.097944 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458d37b-6780-49a8-ac99-5009dc3843f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:45.098213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458d37b-6780-49a8-ac99-5009dc3843f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:45.108050 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458d37b-6780-49a8-ac99-5009dc3843f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:45.109434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458d37b-6780-49a8-ac99-5009dc3843f9 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:45.127074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-0458d37b-6780-49a8-ac99-5009dc3843f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:45.127074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:45.127074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:45.127074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:45.127074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:45.127074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:45.127074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:45.127074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:45.127074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:45.127074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:45.127074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:45.127074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:45.127074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:45.127074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:45.127074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:45.128174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:45.128174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:45.128174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:45.128174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:45.128174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:45.128174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:45.128174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:45.128174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:45.128174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:45.128174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:45.128174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:45.128174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:45.128174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:45.128174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:45.128174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:45.128174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:45.128174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:45.129365 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:45.129365 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:45.129365 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:45.129365 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:45.132371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 307/589] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:45.133494 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458d37b-6780-49a8-ac99-5009dc3843f9 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:45.180338 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e30a2-4452-4324-87a6-bbac9d623868 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:45.213653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7642e7-6933-4952-adfc-f31f324148a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:45.214328 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7642e7-6933-4952-adfc-f31f324148a0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:45.214612 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7642e7-6933-4952-adfc-f31f324148a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:45.214884 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7642e7-6933-4952-adfc-f31f324148a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:45.215714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7642e7-6933-4952-adfc-f31f324148a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:45.216037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7642e7-6933-4952-adfc-f31f324148a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:45.217512 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7642e7-6933-4952-adfc-f31f324148a0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:45.228687 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458d37b-6780-49a8-ac99-5009dc3843f9 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:45.234869 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 283/590] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:31:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:45.234869 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7642e7-6933-4952-adfc-f31f324148a0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:45.265339 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fe0ee-8dd0-4196-9c17-396093a59f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:45.266133 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fe0ee-8dd0-4196-9c17-396093a59f43 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:45.266416 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fe0ee-8dd0-4196-9c17-396093a59f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:45.266687 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fe0ee-8dd0-4196-9c17-396093a59f43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:45.277468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fe0ee-8dd0-4196-9c17-396093a59f43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:45.278913 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fe0ee-8dd0-4196-9c17-396093a59f43 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:45.296948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-a54fe0ee-8dd0-4196-9c17-396093a59f43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:45.296948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:45.296948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:45.296948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:45.296948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:45.296948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:45.296948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:45.296948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:45.296948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:45.296948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:45.296948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:45.296948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:45.296948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:45.296948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:45.296948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:45.297911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:45.297911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:45.297911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:45.297911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:45.297911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:45.297911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:45.297911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:45.297911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:45.297911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:45.297911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:45.297911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:45.297911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:45.297911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:45.297911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:45.297911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:45.297911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:45.297911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:45.303834 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:45.303834 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:45.303834 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:45.303834 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:45.303834 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 308/591] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:45.303834 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fe0ee-8dd0-4196-9c17-396093a59f43 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:45.332085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7642e7-6933-4952-adfc-f31f324148a0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:45.365186 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4913e5f-7dd4-4bac-a2c1-0ec5e4c2053f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:45.365969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4913e5f-7dd4-4bac-a2c1-0ec5e4c2053f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:45.366274 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4913e5f-7dd4-4bac-a2c1-0ec5e4c2053f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:45.366547 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4913e5f-7dd4-4bac-a2c1-0ec5e4c2053f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:45.373960 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4913e5f-7dd4-4bac-a2c1-0ec5e4c2053f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:45.375394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4913e5f-7dd4-4bac-a2c1-0ec5e4c2053f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:45.389925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-b4913e5f-7dd4-4bac-a2c1-0ec5e4c2053f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 06:31:45.389925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:45.389925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:45.389925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:45.389925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:45.389925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:45.389925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:45.389925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:45.389925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:45.389925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:45.389925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:45.389925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:45.389925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:31:45.389925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:31:45.389925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:31:45.389925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:31:45.390874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:45.390874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:45.390874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:31:45.390874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:45.390874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:31:45.390874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:45.390874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:45.390874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:45.390874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:45.390874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:45.390874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:45.390874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:45.390874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:45.390874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:45.390874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:45.390874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:45.390874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:45.390874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:45.391882 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:45.391882 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:45.391882 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:31:45.391882 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:31:45.391882 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:31:45.391882 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:31:45.391882 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:31:45.391882 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:31:45.391882 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 06:31:45.391882 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:45.391882 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 284/592] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:45.392593 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4913e5f-7dd4-4bac-a2c1-0ec5e4c2053f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:45.400034 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fe0ee-8dd0-4196-9c17-396093a59f43 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:45.432429 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6af15-4f17-4fc7-924f-1b255ed7884a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:45.433098 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6af15-4f17-4fc7-924f-1b255ed7884a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:45.433375 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6af15-4f17-4fc7-924f-1b255ed7884a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:45.433644 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6af15-4f17-4fc7-924f-1b255ed7884a None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:45.434359 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6af15-4f17-4fc7-924f-1b255ed7884a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:45.434662 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6af15-4f17-4fc7-924f-1b255ed7884a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:45.436040 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6af15-4f17-4fc7-924f-1b255ed7884a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:45.451397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 309/593] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:45.451397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6af15-4f17-4fc7-924f-1b255ed7884a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:45.491468 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4913e5f-7dd4-4bac-a2c1-0ec5e4c2053f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:45.523417 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e86d43-f624-4479-8a3c-094e9b7a8073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:45.524324 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e86d43-f624-4479-8a3c-094e9b7a8073 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:45.524609 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e86d43-f624-4479-8a3c-094e9b7a8073 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:45.524885 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e86d43-f624-4479-8a3c-094e9b7a8073 None admin] PATH_INFO: `/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/bbcd54a927bf46f183b50fbda677868d/roles/ed3e6c61b2d14364a605282f0f1488ba` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:45.539514 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e86d43-f624-4479-8a3c-094e9b7a8073 None admin] RBAC: Authorizing `identity:create_grant(project_id=57e1a8b143974111b0ba09d041b331d5, user_id=bbcd54a927bf46f183b50fbda677868d, role_id=ed3e6c61b2d14364a605282f0f1488ba)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:45.541246 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e86d43-f624-4479-8a3c-094e9b7a8073 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:45.543908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6af15-4f17-4fc7-924f-1b255ed7884a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:45.575563 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0ba2b-ee19-4438-9d07-85e0f0924a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:45.576257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0ba2b-ee19-4438-9d07-85e0f0924a4d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:45.576539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0ba2b-ee19-4438-9d07-85e0f0924a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:45.576813 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0ba2b-ee19-4438-9d07-85e0f0924a4d None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:45.577537 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0ba2b-ee19-4438-9d07-85e0f0924a4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:45.577845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0ba2b-ee19-4438-9d07-85e0f0924a4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:45.579194 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0ba2b-ee19-4438-9d07-85e0f0924a4d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:45.591246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 310/594] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:45.591888 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0ba2b-ee19-4438-9d07-85e0f0924a4d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:45.614067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 285/595] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:31:45 2022] PUT /identity/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/bbcd54a927bf46f183b50fbda677868d/roles/ed3e6c61b2d14364a605282f0f1488ba => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:31:45.614067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e86d43-f624-4479-8a3c-094e9b7a8073 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:45.698432 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0ba2b-ee19-4438-9d07-85e0f0924a4d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:45.717345 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e86d43-f624-4479-8a3c-094e9b7a8073 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:45.734640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06717399-a5f4-4b13-9b57-136343982c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:45.735494 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06717399-a5f4-4b13-9b57-136343982c5f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:45.736096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06717399-a5f4-4b13-9b57-136343982c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:45.736229 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06717399-a5f4-4b13-9b57-136343982c5f None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:45.737196 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06717399-a5f4-4b13-9b57-136343982c5f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:45.737604 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06717399-a5f4-4b13-9b57-136343982c5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:45.739154 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06717399-a5f4-4b13-9b57-136343982c5f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:45.753633 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d6053-e325-4b99-b4d4-276d13c9a601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:45.754392 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d6053-e325-4b99-b4d4-276d13c9a601 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:45.754687 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d6053-e325-4b99-b4d4-276d13c9a601 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:45.754946 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d6053-e325-4b99-b4d4-276d13c9a601 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:45.761206 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 311/596] 10.222.0.25 () {56 vars in 1137 bytes} [Thu May 12 06:31:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:45.762302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06717399-a5f4-4b13-9b57-136343982c5f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:45.767899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d6053-e325-4b99-b4d4-276d13c9a601 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:45.769388 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d6053-e325-4b99-b4d4-276d13c9a601 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:45.784630 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-434d6053-e325-4b99-b4d4-276d13c9a601 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:45.784630 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:45.784630 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:45.784630 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:45.784630 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:45.784630 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:45.784630 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:45.784630 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:45.784630 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:45.784630 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:45.784630 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:45.784630 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:45.784630 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:31:45.784630 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:31:45.784630 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:31:45.785658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:31:45.785658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:45.785658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:45.785658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:45.785658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:45.785658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:45.785658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:45.785658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:45.785658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:45.785658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:45.785658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:45.785658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:45.785658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:45.785658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:45.785658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:45.785658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:45.785658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:45.786775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:31:45.786775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:31:45.786775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:31:45.786775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:31:45.786775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:31:45.786775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:31:45.786775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:45.786775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:45.786775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 286/597] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:45.787372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d6053-e325-4b99-b4d4-276d13c9a601 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:45.872567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06717399-a5f4-4b13-9b57-136343982c5f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:45.895242 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d6053-e325-4b99-b4d4-276d13c9a601 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:45.920048 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d36c9c-486d-404c-b773-bd73bde58875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:45.920986 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d36c9c-486d-404c-b773-bd73bde58875 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:45.921363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d36c9c-486d-404c-b773-bd73bde58875 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:45.921758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d36c9c-486d-404c-b773-bd73bde58875 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:45.929368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d36c9c-486d-404c-b773-bd73bde58875 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:45.931187 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d36c9c-486d-404c-b773-bd73bde58875 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:45.931432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b4469-9f9f-4126-81b1-e8761db487d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:45.932465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b4469-9f9f-4126-81b1-e8761db487d2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:45.933015 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b4469-9f9f-4126-81b1-e8761db487d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:45.938937 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b4469-9f9f-4126-81b1-e8761db487d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:45.944706 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b4469-9f9f-4126-81b1-e8761db487d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:45.946237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-22d36c9c-486d-404c-b773-bd73bde58875 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:45.946237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:45.946237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:45.946237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:45.946237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:45.946237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:45.946237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:45.946237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:45.946237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:45.946237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:45.946237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:45.946237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:45.946237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:31:45.946237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:31:45.946237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:31:45.947262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:31:45.947262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:45.947262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:45.947262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:45.947262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:45.947262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:45.947262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:45.947262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:45.947262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:45.947262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:45.947262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:45.947262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:45.947262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:45.947262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:45.947262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:45.947262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:45.947262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:45.948398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:31:45.948398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:31:45.948398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:31:45.948398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:31:45.948398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:31:45.948398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:31:45.948398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:45.948398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:45.949347 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b4469-9f9f-4126-81b1-e8761db487d2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:45.954524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 312/598] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:45.955514 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d36c9c-486d-404c-b773-bd73bde58875 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:45.971492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-680b4469-9f9f-4126-81b1-e8761db487d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:45.971492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:45.971492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:45.971492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:45.971492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:45.971492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:45.971492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:45.971492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:45.971492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:45.971492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:45.971492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:45.971492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:45.971492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:45.971492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:45.971492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:45.972757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:45.972757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:45.972757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:45.972757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:45.972757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:45.972757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:45.972757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:45.972757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:45.972757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:45.972757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:45.972757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:45.972757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:45.972757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:45.972757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:45.972757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:45.972757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:45.972757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:45.973858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:45.973858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:45.973858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:45.973858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:45.975798 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 287/599] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:45.976801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b4469-9f9f-4126-81b1-e8761db487d2 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:46.064194 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d36c9c-486d-404c-b773-bd73bde58875 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:46.091169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b4469-9f9f-4126-81b1-e8761db487d2 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:46.097769 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5c0c7-bdcc-4500-9970-2058689d92f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:46.098594 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5c0c7-bdcc-4500-9970-2058689d92f5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:46.099213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5c0c7-bdcc-4500-9970-2058689d92f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:46.099213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5c0c7-bdcc-4500-9970-2058689d92f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:46.100205 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5c0c7-bdcc-4500-9970-2058689d92f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:46.100827 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5c0c7-bdcc-4500-9970-2058689d92f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:46.102331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5c0c7-bdcc-4500-9970-2058689d92f5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:46.119450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 313/600] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:31:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:46.119450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5c0c7-bdcc-4500-9970-2058689d92f5 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:46.133708 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61a53e-86ba-4f5b-af0a-20203dc546a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:46.134994 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61a53e-86ba-4f5b-af0a-20203dc546a8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:46.135276 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61a53e-86ba-4f5b-af0a-20203dc546a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:46.135548 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61a53e-86ba-4f5b-af0a-20203dc546a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:46.136696 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61a53e-86ba-4f5b-af0a-20203dc546a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:46.137004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61a53e-86ba-4f5b-af0a-20203dc546a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:46.138643 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61a53e-86ba-4f5b-af0a-20203dc546a8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:46.159712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 288/601] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:31:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:46.159712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61a53e-86ba-4f5b-af0a-20203dc546a8 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:46.245564 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5c0c7-bdcc-4500-9970-2058689d92f5 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:46.281415 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7981f5f-4fd6-474b-a7c6-7995e2de782f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:46.282380 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7981f5f-4fd6-474b-a7c6-7995e2de782f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:46.282584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7981f5f-4fd6-474b-a7c6-7995e2de782f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:46.282861 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7981f5f-4fd6-474b-a7c6-7995e2de782f None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:46.283946 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7981f5f-4fd6-474b-a7c6-7995e2de782f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:46.284252 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7981f5f-4fd6-474b-a7c6-7995e2de782f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:46.285604 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7981f5f-4fd6-474b-a7c6-7995e2de782f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:46.286644 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61a53e-86ba-4f5b-af0a-20203dc546a8 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:46.298424 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 314/602] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:46.299273 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7981f5f-4fd6-474b-a7c6-7995e2de782f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:46.322746 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb5878-b7e5-48fc-8964-c6cb814fcdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:46.324099 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb5878-b7e5-48fc-8964-c6cb814fcdf1 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:46.324578 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb5878-b7e5-48fc-8964-c6cb814fcdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:46.325108 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb5878-b7e5-48fc-8964-c6cb814fcdf1 None admin] PATH_INFO: `/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/4a08d8e39f6f42bc9b93dd6d2311bcbe/roles/ed3e6c61b2d14364a605282f0f1488ba` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:46.340295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb5878-b7e5-48fc-8964-c6cb814fcdf1 None admin] RBAC: Authorizing `identity:create_grant(project_id=57e1a8b143974111b0ba09d041b331d5, user_id=4a08d8e39f6f42bc9b93dd6d2311bcbe, role_id=ed3e6c61b2d14364a605282f0f1488ba)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:46.342808 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb5878-b7e5-48fc-8964-c6cb814fcdf1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:46.396910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7981f5f-4fd6-474b-a7c6-7995e2de782f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:46.419937 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 289/603] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:31:46 2022] PUT /identity/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/4a08d8e39f6f42bc9b93dd6d2311bcbe/roles/ed3e6c61b2d14364a605282f0f1488ba => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:31:46.419937 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb5878-b7e5-48fc-8964-c6cb814fcdf1 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:46.451728 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb2858-5c98-4799-acbf-5bfa9d280ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:46.452805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb2858-5c98-4799-acbf-5bfa9d280ccb None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:46.453164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb2858-5c98-4799-acbf-5bfa9d280ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:46.453601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb2858-5c98-4799-acbf-5bfa9d280ccb None admin] PATH_INFO: `/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/5a9cbec1af6545fcb34425dce87d0ef2/roles/ed3e6c61b2d14364a605282f0f1488ba` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:46.477031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb2858-5c98-4799-acbf-5bfa9d280ccb None admin] RBAC: Authorizing `identity:create_grant(project_id=57e1a8b143974111b0ba09d041b331d5, user_id=5a9cbec1af6545fcb34425dce87d0ef2, role_id=ed3e6c61b2d14364a605282f0f1488ba)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:46.479311 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb2858-5c98-4799-acbf-5bfa9d280ccb None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:46.525493 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb5878-b7e5-48fc-8964-c6cb814fcdf1 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:46.562675 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 315/604] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:31:46 2022] PUT /identity/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/5a9cbec1af6545fcb34425dce87d0ef2/roles/ed3e6c61b2d14364a605282f0f1488ba => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:31:46.566718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1b7eb-ce5e-41a9-bade-ec0482f536cc None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:46.568080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1b7eb-ce5e-41a9-bade-ec0482f536cc None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:46.569021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1b7eb-ce5e-41a9-bade-ec0482f536cc None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:46.573405 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 316/605] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:46 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:46.577806 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc2a71-b94d-474d-82a7-878af90333aa None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:46.578455 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc2a71-b94d-474d-82a7-878af90333aa None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:46.578939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc2a71-b94d-474d-82a7-878af90333aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:46.580762 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde013c-1ec6-45f7-a15c-617818f0c384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:46.584012 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde013c-1ec6-45f7-a15c-617818f0c384 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:46.585656 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde013c-1ec6-45f7-a15c-617818f0c384 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:46.586211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde013c-1ec6-45f7-a15c-617818f0c384 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:46.602722 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde013c-1ec6-45f7-a15c-617818f0c384 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:46.604060 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde013c-1ec6-45f7-a15c-617818f0c384 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:46.613013 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-69fc2a71-b94d-474d-82a7-878af90333aa None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:46.615247 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-69fc2a71-b94d-474d-82a7-878af90333aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:46.621787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-3cde013c-1ec6-45f7-a15c-617818f0c384 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:46.621787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:46.621787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:46.621787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:46.621787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:46.621787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:46.621787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:46.621787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:46.621787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:46.621787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:46.621787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:46.621787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:46.621787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:31:46.621787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:31:46.621787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:31:46.622743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:31:46.622743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:46.622743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:46.622743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:46.622743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:46.622743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:46.622743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:46.622743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:46.622743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:46.622743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:46.622743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:46.622743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:46.622743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:46.622743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:46.622743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:46.622743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:46.622743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:46.623860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:31:46.623860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:31:46.623860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:31:46.623860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:31:46.623860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:31:46.623860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:31:46.623860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:46.623860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:46.626204 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 290/606] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:46.633245 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde013c-1ec6-45f7-a15c-617818f0c384 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:46.741282 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 317/607] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:46.758510 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde013c-1ec6-45f7-a15c-617818f0c384 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:46.775319 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc2a71-b94d-474d-82a7-878af90333aa None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:46.799997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5932d1b-f3dd-4346-974f-7e2d72af8073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:46.800597 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5932d1b-f3dd-4346-974f-7e2d72af8073 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:46.800880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5932d1b-f3dd-4346-974f-7e2d72af8073 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:46.801154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5932d1b-f3dd-4346-974f-7e2d72af8073 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:46.801961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5932d1b-f3dd-4346-974f-7e2d72af8073 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:46.802278 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5932d1b-f3dd-4346-974f-7e2d72af8073 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:46.803773 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5932d1b-f3dd-4346-974f-7e2d72af8073 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:46.822939 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 291/608] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:31:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:46.828883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5932d1b-f3dd-4346-974f-7e2d72af8073 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:46.909987 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc2a71-b94d-474d-82a7-878af90333aa None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:46.934685 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5932d1b-f3dd-4346-974f-7e2d72af8073 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:46.962666 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772507c-8373-4455-8573-95d114966bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:46.963475 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772507c-8373-4455-8573-95d114966bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:46.963788 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772507c-8373-4455-8573-95d114966bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:46.964064 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772507c-8373-4455-8573-95d114966bb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:46.983837 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772507c-8373-4455-8573-95d114966bb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:46.994818 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072dc1c-9e7b-46f4-8f01-550c0212a788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:46.995722 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072dc1c-9e7b-46f4-8f01-550c0212a788 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:46.996016 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072dc1c-9e7b-46f4-8f01-550c0212a788 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:46.996312 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072dc1c-9e7b-46f4-8f01-550c0212a788 None admin] PATH_INFO: `/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/4b5006e095ba41d994dca0bf581417e5/roles/ed3e6c61b2d14364a605282f0f1488ba` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:46.999086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-5772507c-8373-4455-8573-95d114966bb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:46.999086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:46.999086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:46.999086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:46.999086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:46.999086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:46.999086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:46.999086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:46.999086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:46.999086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:46.999086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:46.999086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:46.999086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:46.999086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:46.999086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:46.999086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:47.000038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:47.000038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:47.000038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:47.000038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:47.000038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:47.000038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:47.000038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:47.000038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:47.000038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:47.000038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:47.000038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:47.000038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:47.000038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:47.000038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:47.000038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:47.000038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:47.001434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:47.001434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:47.001434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:47.001434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:47.001434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:47.001434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:47.001434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:47.001434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:47.001434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:47.001434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:47.001434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:47.001434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:47.001434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 318/609] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:31:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:31:47.012762 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772507c-8373-4455-8573-95d114966bb3 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:47.020213 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072dc1c-9e7b-46f4-8f01-550c0212a788 None admin] RBAC: Authorizing `identity:create_grant(project_id=57e1a8b143974111b0ba09d041b331d5, user_id=4b5006e095ba41d994dca0bf581417e5, role_id=ed3e6c61b2d14364a605282f0f1488ba)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:47.021902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072dc1c-9e7b-46f4-8f01-550c0212a788 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:47.089392 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 292/610] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:31:46 2022] PUT /identity/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/4b5006e095ba41d994dca0bf581417e5/roles/ed3e6c61b2d14364a605282f0f1488ba => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:31:47.128259 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772507c-8373-4455-8573-95d114966bb3 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:47.170955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0686d-53ea-48d6-a7cb-a92c9d54fab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:47.172078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0686d-53ea-48d6-a7cb-a92c9d54fab4 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:47.172562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0686d-53ea-48d6-a7cb-a92c9d54fab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:47.173057 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0686d-53ea-48d6-a7cb-a92c9d54fab4 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:47.174027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0686d-53ea-48d6-a7cb-a92c9d54fab4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:47.174548 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0686d-53ea-48d6-a7cb-a92c9d54fab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:47.176193 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0686d-53ea-48d6-a7cb-a92c9d54fab4 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:47.190596 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 319/611] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 12 06:31:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:47.196566 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072dc1c-9e7b-46f4-8f01-550c0212a788 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:47.302327 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072dc1c-9e7b-46f4-8f01-550c0212a788 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:47.340633 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df587486-8f1a-4f60-b1d1-52db5ed7d906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:47.342224 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df587486-8f1a-4f60-b1d1-52db5ed7d906 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:47.342704 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df587486-8f1a-4f60-b1d1-52db5ed7d906 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:47.343185 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df587486-8f1a-4f60-b1d1-52db5ed7d906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:47.354664 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df587486-8f1a-4f60-b1d1-52db5ed7d906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:47.356432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df587486-8f1a-4f60-b1d1-52db5ed7d906 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:47.374211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-df587486-8f1a-4f60-b1d1-52db5ed7d906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:47.374211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:47.374211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:47.374211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:47.374211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:47.374211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:47.374211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:47.374211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:47.374211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:47.374211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:47.374211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:47.374211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:47.374211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:47.374211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:47.374211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:47.375154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:47.375154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:47.375154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:47.375154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:47.375154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:47.375154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:47.375154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:47.375154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:47.375154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:47.375154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:47.375154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:47.375154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:47.375154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:47.375154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:47.375154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:47.375154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:47.375154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:47.376068 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:47.376068 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:47.376068 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:47.376068 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:47.378348 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 293/612] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:47.383672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0686d-53ea-48d6-a7cb-a92c9d54fab4 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:47.483449 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0686d-53ea-48d6-a7cb-a92c9d54fab4 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:47.523194 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46122639-017d-4d0b-9003-e7be97d60bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:47.524270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46122639-017d-4d0b-9003-e7be97d60bab None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:47.524760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46122639-017d-4d0b-9003-e7be97d60bab None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:47.525257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46122639-017d-4d0b-9003-e7be97d60bab None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:47.526203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46122639-017d-4d0b-9003-e7be97d60bab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:47.526711 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46122639-017d-4d0b-9003-e7be97d60bab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:47.528309 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46122639-017d-4d0b-9003-e7be97d60bab None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:47.545426 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 320/613] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:47.550476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df587486-8f1a-4f60-b1d1-52db5ed7d906 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:47.654235 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df587486-8f1a-4f60-b1d1-52db5ed7d906 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:47.695540 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796168a-ae12-489d-82e7-655c18458f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:47.696710 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796168a-ae12-489d-82e7-655c18458f97 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:47.697226 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796168a-ae12-489d-82e7-655c18458f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:47.697699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796168a-ae12-489d-82e7-655c18458f97 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:47.705196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796168a-ae12-489d-82e7-655c18458f97 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:47.706886 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796168a-ae12-489d-82e7-655c18458f97 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:47.721595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-4796168a-ae12-489d-82e7-655c18458f97 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 06:31:47.721595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:47.721595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:47.721595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:47.721595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:47.721595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:47.721595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:47.721595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:47.721595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:47.721595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:47.721595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:47.721595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:47.721595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:31:47.721595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:31:47.721595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:31:47.721595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:31:47.722558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:47.722558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:47.722558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:31:47.722558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:47.722558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:31:47.722558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:47.722558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:47.722558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:47.722558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:47.722558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:47.722558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:47.722558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:47.722558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:47.722558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:47.722558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:47.722558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:47.722558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:47.722558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:47.723504 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:47.723504 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:47.723504 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:31:47.723504 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:31:47.723504 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:31:47.723504 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:31:47.723504 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:31:47.723504 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:31:47.723504 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 06:31:47.723504 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:47.727558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 294/614] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:31:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:47.736749 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46122639-017d-4d0b-9003-e7be97d60bab None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:47.853829 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46122639-017d-4d0b-9003-e7be97d60bab None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:47.905141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf71b7-f322-4cd0-96d1-f8251e773b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:47.905756 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf71b7-f322-4cd0-96d1-f8251e773b79 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:47.906035 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf71b7-f322-4cd0-96d1-f8251e773b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:47.906305 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf71b7-f322-4cd0-96d1-f8251e773b79 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:47.907176 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf71b7-f322-4cd0-96d1-f8251e773b79 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:47.907486 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf71b7-f322-4cd0-96d1-f8251e773b79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:47.908989 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf71b7-f322-4cd0-96d1-f8251e773b79 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:47.936179 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 321/615] 10.222.0.25 () {56 vars in 1135 bytes} [Thu May 12 06:31:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:47.947000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796168a-ae12-489d-82e7-655c18458f97 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:48.045926 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796168a-ae12-489d-82e7-655c18458f97 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:48.087581 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ff3a4-bded-4549-bf70-16c797c2f112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:48.088404 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ff3a4-bded-4549-bf70-16c797c2f112 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:48.088683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ff3a4-bded-4549-bf70-16c797c2f112 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:48.088955 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ff3a4-bded-4549-bf70-16c797c2f112 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:48.099204 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ff3a4-bded-4549-bf70-16c797c2f112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:48.100769 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ff3a4-bded-4549-bf70-16c797c2f112 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:48.118482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-0a1ff3a4-bded-4549-bf70-16c797c2f112 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:48.118482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:48.118482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:48.118482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:48.118482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:48.118482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:48.118482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:48.118482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:48.118482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:48.118482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:48.118482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:48.118482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:48.118482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:48.118482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:48.118482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:48.119431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:48.119431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:48.119431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:48.119431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:48.119431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:48.119431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:48.119431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:48.119431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:48.119431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:48.119431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:48.119431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:48.119431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:48.119431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:48.119431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:48.119431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:48.119431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:48.119431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:48.120364 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:48.120364 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:48.120364 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:48.120364 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:48.120364 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 295/616] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:48.125222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf71b7-f322-4cd0-96d1-f8251e773b79 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:48.266411 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf71b7-f322-4cd0-96d1-f8251e773b79 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:48.320419 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a1a2b-8ea2-4508-8f7e-4be23361636c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:48.321105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a1a2b-8ea2-4508-8f7e-4be23361636c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:48.321391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a1a2b-8ea2-4508-8f7e-4be23361636c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:48.321667 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a1a2b-8ea2-4508-8f7e-4be23361636c None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:48.322413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a1a2b-8ea2-4508-8f7e-4be23361636c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:48.322720 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a1a2b-8ea2-4508-8f7e-4be23361636c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:48.324201 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a1a2b-8ea2-4508-8f7e-4be23361636c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:48.336526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 322/617] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:48.341963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ff3a4-bded-4549-bf70-16c797c2f112 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:48.455626 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546e0f0-e45e-444f-a864-67d1372d00b8 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:48.455972 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546e0f0-e45e-444f-a864-67d1372d00b8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:48.456220 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546e0f0-e45e-444f-a864-67d1372d00b8 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:48.457828 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 323/618] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:48.462935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3685d84-4a96-425b-856b-c593c3b878f5 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:48.463221 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3685d84-4a96-425b-856b-c593c3b878f5 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:48.463496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3685d84-4a96-425b-856b-c593c3b878f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:48.484844 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d3685d84-4a96-425b-856b-c593c3b878f5 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:48.486347 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d3685d84-4a96-425b-856b-c593c3b878f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:48.507810 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ff3a4-bded-4549-bf70-16c797c2f112 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:48.571615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc290a-3851-4997-9a12-874414af4d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:48.573660 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc290a-3851-4997-9a12-874414af4d19 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:48.576192 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc290a-3851-4997-9a12-874414af4d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:48.576692 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc290a-3851-4997-9a12-874414af4d19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:48.581630 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 324/619] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:31:48.592854 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc290a-3851-4997-9a12-874414af4d19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:48.594587 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc290a-3851-4997-9a12-874414af4d19 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:48.605337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3685d84-4a96-425b-856b-c593c3b878f5 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:48.613616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-3fcc290a-3851-4997-9a12-874414af4d19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:48.613616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:48.613616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:48.613616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:48.613616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:48.613616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:48.613616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:48.613616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:48.613616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:48.613616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:48.613616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:48.613616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:48.613616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:31:48.613616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:31:48.613616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:31:48.614567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:31:48.614567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:48.614567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:48.614567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:48.614567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:48.614567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:48.614567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:48.614567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:48.614567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:48.614567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:48.614567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:48.614567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:48.614567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:48.614567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:48.614567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:48.614567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:48.614567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:48.615457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:31:48.615457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:31:48.615457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:31:48.615457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:31:48.615457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:31:48.615457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:31:48.615457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:48.615457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:48.618892 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 296/620] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:48.628729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc290a-3851-4997-9a12-874414af4d19 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:48.721107 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3685d84-4a96-425b-856b-c593c3b878f5 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:48.762416 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde25c3-65bf-4078-8b90-f16c8f6a2042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:48.763282 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde25c3-65bf-4078-8b90-f16c8f6a2042 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:48.763565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde25c3-65bf-4078-8b90-f16c8f6a2042 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:48.763860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde25c3-65bf-4078-8b90-f16c8f6a2042 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:48.789964 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde25c3-65bf-4078-8b90-f16c8f6a2042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:48.807213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-dbde25c3-65bf-4078-8b90-f16c8f6a2042 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:48.807213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:48.807213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:48.807213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:48.807213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:48.807213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:48.807213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:48.807213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:48.807213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:48.807213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:48.807213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:48.807213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:48.807213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:48.807213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:48.807213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:48.807213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:48.808253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:48.808253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:48.808253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:48.808253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:48.808253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:48.808253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:48.808253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:48.808253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:48.808253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:48.808253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:48.808253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:48.808253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:48.808253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:48.808253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:48.808253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:48.808253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:48.809536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:48.809536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:48.809536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:48.809536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:48.809536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:48.809536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:48.809536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:48.809536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:48.809536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:48.809536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:48.809536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:48.809536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:48.809536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 325/621] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:31:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:31:48.814314 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde25c3-65bf-4078-8b90-f16c8f6a2042 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:48.844573 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc290a-3851-4997-9a12-874414af4d19 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:48.929396 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90a785-d048-4459-a323-7ad9a397cdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:48.930066 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90a785-d048-4459-a323-7ad9a397cdce None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:48.946112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90a785-d048-4459-a323-7ad9a397cdce None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:48.946112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90a785-d048-4459-a323-7ad9a397cdce None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:48.946112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90a785-d048-4459-a323-7ad9a397cdce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:48.946112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90a785-d048-4459-a323-7ad9a397cdce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:48.946112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90a785-d048-4459-a323-7ad9a397cdce None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:48.946932 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde25c3-65bf-4078-8b90-f16c8f6a2042 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:48.959054 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 297/622] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:31:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:48.968673 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90a785-d048-4459-a323-7ad9a397cdce None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:48.996169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693dd80-a81b-4417-a753-cc7f18b59315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:48.997770 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693dd80-a81b-4417-a753-cc7f18b59315 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:48.998425 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693dd80-a81b-4417-a753-cc7f18b59315 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:48.998922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693dd80-a81b-4417-a753-cc7f18b59315 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:49.000067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693dd80-a81b-4417-a753-cc7f18b59315 None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:49.000789 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693dd80-a81b-4417-a753-cc7f18b59315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:49.002910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693dd80-a81b-4417-a753-cc7f18b59315 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:49.014374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 326/623] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 12 06:31:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:49.019829 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693dd80-a81b-4417-a753-cc7f18b59315 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:49.126604 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693dd80-a81b-4417-a753-cc7f18b59315 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:49.160770 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4977e9-8427-4a5e-921d-19d785c200a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:49.161569 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4977e9-8427-4a5e-921d-19d785c200a0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:49.161851 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4977e9-8427-4a5e-921d-19d785c200a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:49.162127 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4977e9-8427-4a5e-921d-19d785c200a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:49.173937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4977e9-8427-4a5e-921d-19d785c200a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:49.175398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4977e9-8427-4a5e-921d-19d785c200a0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:49.193497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-6a4977e9-8427-4a5e-921d-19d785c200a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:49.193497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:49.193497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:49.193497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:49.193497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:49.193497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:49.193497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:49.193497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:49.193497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:49.193497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:49.193497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:49.193497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:49.193497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:49.193497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:49.193497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:49.195165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:49.195165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:49.195165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:49.195165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:49.195165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:49.195165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:49.195165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:49.195165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:49.195165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:49.195165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:49.195165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:49.195165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:49.195165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:49.195165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:49.195165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:49.195165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:49.195165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:49.196276 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:49.196276 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:49.196276 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:49.196276 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:49.196276 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 327/624] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:49.200973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c09ad-baf8-4c74-a28c-5cfdafa3863d None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:49.200973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c09ad-baf8-4c74-a28c-5cfdafa3863d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:49.200973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c09ad-baf8-4c74-a28c-5cfdafa3863d None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:49.200973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 328/625] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:49.201341 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90a785-d048-4459-a323-7ad9a397cdce None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:49.206496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c09ad-baf8-4c74-a28c-5cfdafa3863d None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:49.244674 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11467dcc-0679-4eea-a277-1ccb742f1195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:49.245759 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11467dcc-0679-4eea-a277-1ccb742f1195 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:49.246143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11467dcc-0679-4eea-a277-1ccb742f1195 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:49.246570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11467dcc-0679-4eea-a277-1ccb742f1195 None admin] PATH_INFO: `/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/a9882820f88349cb8fa2e3d457b19959/roles/ed3e6c61b2d14364a605282f0f1488ba` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:49.265106 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11467dcc-0679-4eea-a277-1ccb742f1195 None admin] RBAC: Authorizing `identity:create_grant(project_id=57e1a8b143974111b0ba09d041b331d5, user_id=a9882820f88349cb8fa2e3d457b19959, role_id=ed3e6c61b2d14364a605282f0f1488ba)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:49.267420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11467dcc-0679-4eea-a277-1ccb742f1195 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:49.309077 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c09ad-baf8-4c74-a28c-5cfdafa3863d None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:49.323293 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 298/626] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:31:48 2022] PUT /identity/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/a9882820f88349cb8fa2e3d457b19959/roles/ed3e6c61b2d14364a605282f0f1488ba => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:31:49.324879 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07b8e9-f33c-48fc-9fff-574fe38abd1f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:49.325221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07b8e9-f33c-48fc-9fff-574fe38abd1f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:49.325505 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07b8e9-f33c-48fc-9fff-574fe38abd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:49.344763 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7b07b8e9-f33c-48fc-9fff-574fe38abd1f None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:49.346094 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7b07b8e9-f33c-48fc-9fff-574fe38abd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:49.359510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586d1d6-fae6-49c1-9613-49205b3f8d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:49.360577 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586d1d6-fae6-49c1-9613-49205b3f8d81 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:49.361158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586d1d6-fae6-49c1-9613-49205b3f8d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:49.361664 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586d1d6-fae6-49c1-9613-49205b3f8d81 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:49.362605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586d1d6-fae6-49c1-9613-49205b3f8d81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:49.363194 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586d1d6-fae6-49c1-9613-49205b3f8d81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:49.364920 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586d1d6-fae6-49c1-9613-49205b3f8d81 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:49.380690 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 329/627] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:49.382467 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d4051-6df3-4cc8-89c2-df5edc410f03 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:49.382933 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d4051-6df3-4cc8-89c2-df5edc410f03 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:49.383509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d4051-6df3-4cc8-89c2-df5edc410f03 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:49.385683 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 330/628] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:49.386866 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d4051-6df3-4cc8-89c2-df5edc410f03 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:49.427723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 299/629] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:49.429199 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d1892-00b4-4ad9-b508-6fea480e4414 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:49.429486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d1892-00b4-4ad9-b508-6fea480e4414 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:49.429840 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d1892-00b4-4ad9-b508-6fea480e4414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:49.447359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c92d1892-00b4-4ad9-b508-6fea480e4414 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:49.448704 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c92d1892-00b4-4ad9-b508-6fea480e4414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:49.509470 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d4051-6df3-4cc8-89c2-df5edc410f03 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:49.525037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 300/630] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:49.526037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d1892-00b4-4ad9-b508-6fea480e4414 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:49.547944 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe353c-fd5b-4862-bcaa-b8ae6109d913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:49.549122 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe353c-fd5b-4862-bcaa-b8ae6109d913 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:49.549550 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe353c-fd5b-4862-bcaa-b8ae6109d913 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:49.549721 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe353c-fd5b-4862-bcaa-b8ae6109d913 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:49.558668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe353c-fd5b-4862-bcaa-b8ae6109d913 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:49.560140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe353c-fd5b-4862-bcaa-b8ae6109d913 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:49.581533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-fafe353c-fd5b-4862-bcaa-b8ae6109d913 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 06:31:49.581533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:49.581533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:49.581533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:49.581533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:49.581533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:49.581533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:49.581533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:49.581533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:49.581533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:49.581533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:49.581533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:49.581533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:31:49.581533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:31:49.581533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:31:49.581533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:31:49.582874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:49.582874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:49.582874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:31:49.582874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:49.582874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:31:49.582874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:49.582874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:49.582874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:49.582874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:49.582874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:49.582874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:49.582874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:49.582874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:49.582874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:49.582874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:49.582874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:49.582874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:49.582874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:49.583942 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:49.583942 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:49.583942 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:31:49.583942 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:31:49.583942 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:31:49.583942 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:31:49.583942 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:31:49.583942 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:31:49.583942 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 06:31:49.583942 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:49.583942 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 331/631] 10.222.0.25 () {56 vars in 1093 bytes} [Thu May 12 06:31:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:49.583942 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe353c-fd5b-4862-bcaa-b8ae6109d913 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:49.665143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d1892-00b4-4ad9-b508-6fea480e4414 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:49.685507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe353c-fd5b-4862-bcaa-b8ae6109d913 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:49.715435 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f70b9-1966-4cf6-9a91-dcc5c6726730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:49.716813 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f70b9-1966-4cf6-9a91-dcc5c6726730 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:49.717301 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f70b9-1966-4cf6-9a91-dcc5c6726730 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:49.717809 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f70b9-1966-4cf6-9a91-dcc5c6726730 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:49.724270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725c552-5db5-4f32-a29e-6ce3b83160c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:49.725070 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725c552-5db5-4f32-a29e-6ce3b83160c0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:49.725552 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725c552-5db5-4f32-a29e-6ce3b83160c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:49.725931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725c552-5db5-4f32-a29e-6ce3b83160c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:49.730238 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f70b9-1966-4cf6-9a91-dcc5c6726730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:49.737920 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725c552-5db5-4f32-a29e-6ce3b83160c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:49.738774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-846f70b9-1966-4cf6-9a91-dcc5c6726730 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:49.738774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:49.738774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:49.738774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:49.738774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:49.738774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:49.738774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:49.738774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:49.738774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:49.738774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:49.738774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:49.738774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:49.738774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:49.738774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:49.738774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:49.738774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:49.739698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:49.739698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:49.739698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:49.739698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:49.739698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:49.739698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:49.739698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:49.739698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:49.739698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:49.739698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:49.739698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:49.739698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:49.739698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:49.739698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:49.739698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:49.739698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:49.740561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:49.740561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:49.740561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:49.740561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:49.740561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:49.740561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:49.740561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:49.740561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:49.740561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:49.740561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:49.740561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:49.740561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:49.744827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 301/632] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:31:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:49.745829 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f70b9-1966-4cf6-9a91-dcc5c6726730 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:49.746565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-a725c552-5db5-4f32-a29e-6ce3b83160c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:49.746565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:49.746565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:49.746565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:49.746565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:49.746565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:49.746565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:49.746565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:49.746565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:49.746565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:49.746565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:49.746565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:49.746565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:49.746565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:49.746565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:49.746565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:49.747465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:49.747465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:49.747465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:49.747465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:49.747465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:49.747465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:49.747465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:49.747465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:49.747465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:49.747465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:49.747465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:49.747465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:49.747465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:49.747465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:49.747465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:49.747465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:49.748377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:49.748377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:49.748377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:49.748377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:49.748377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:49.748377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:49.748377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:49.748377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:49.748377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:49.748377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:49.748377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:49.748377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:49.748377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 332/633] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:31:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:49.754443 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725c552-5db5-4f32-a29e-6ce3b83160c0 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:49.853125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f70b9-1966-4cf6-9a91-dcc5c6726730 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:49.876554 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725c552-5db5-4f32-a29e-6ce3b83160c0 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:49.890188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db48dca-964a-4205-8ca7-cb8e3a884daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:49.890868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db48dca-964a-4205-8ca7-cb8e3a884daf None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:49.891152 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db48dca-964a-4205-8ca7-cb8e3a884daf None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:49.891424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db48dca-964a-4205-8ca7-cb8e3a884daf None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:49.892332 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db48dca-964a-4205-8ca7-cb8e3a884daf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:49.892637 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db48dca-964a-4205-8ca7-cb8e3a884daf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:49.894609 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db48dca-964a-4205-8ca7-cb8e3a884daf None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:49.911569 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 302/634] 10.222.0.25 () {56 vars in 1133 bytes} [Thu May 12 06:31:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:49.912436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db48dca-964a-4205-8ca7-cb8e3a884daf None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:49.916113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d114f18-9635-45e2-a953-631f5c6ea8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:49.917753 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d114f18-9635-45e2-a953-631f5c6ea8ae None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:49.918039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d114f18-9635-45e2-a953-631f5c6ea8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:49.918317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d114f18-9635-45e2-a953-631f5c6ea8ae None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:49.919089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d114f18-9635-45e2-a953-631f5c6ea8ae None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:49.919401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d114f18-9635-45e2-a953-631f5c6ea8ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:49.920817 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d114f18-9635-45e2-a953-631f5c6ea8ae None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:49.934233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 333/635] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 12 06:31:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:49.934233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9bc3f-8e73-4676-9a76-f528e61cd06a None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:49.934233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9bc3f-8e73-4676-9a76-f528e61cd06a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:49.934233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9bc3f-8e73-4676-9a76-f528e61cd06a None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:49.934233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 334/636] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:49.934233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9bc3f-8e73-4676-9a76-f528e61cd06a None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:50.022263 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db48dca-964a-4205-8ca7-cb8e3a884daf None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:50.041658 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9bc3f-8e73-4676-9a76-f528e61cd06a None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:50.060263 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa1d63-d6c5-4185-a652-16c583d5c620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:50.060941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa1d63-d6c5-4185-a652-16c583d5c620 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:50.061225 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa1d63-d6c5-4185-a652-16c583d5c620 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:50.061533 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa1d63-d6c5-4185-a652-16c583d5c620 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:50.062294 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa1d63-d6c5-4185-a652-16c583d5c620 None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:50.062602 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa1d63-d6c5-4185-a652-16c583d5c620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:50.063992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa1d63-d6c5-4185-a652-16c583d5c620 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:50.072410 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 303/637] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 12 06:31:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:50.073197 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa1d63-d6c5-4185-a652-16c583d5c620 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:50.079767 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b3feb-94ca-44c0-8623-fdcb512621ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:50.080429 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b3feb-94ca-44c0-8623-fdcb512621ab None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:50.080716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b3feb-94ca-44c0-8623-fdcb512621ab None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:50.080988 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b3feb-94ca-44c0-8623-fdcb512621ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:50.146937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b3feb-94ca-44c0-8623-fdcb512621ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:50.148551 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b3feb-94ca-44c0-8623-fdcb512621ab None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:50.172458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa1d63-d6c5-4185-a652-16c583d5c620 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:50.205613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320af458-32de-4565-abe9-f37b7567308c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:50.206399 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320af458-32de-4565-abe9-f37b7567308c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:50.206681 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320af458-32de-4565-abe9-f37b7567308c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:50.206953 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320af458-32de-4565-abe9-f37b7567308c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:50.217403 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320af458-32de-4565-abe9-f37b7567308c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:50.218853 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320af458-32de-4565-abe9-f37b7567308c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:50.235823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-320af458-32de-4565-abe9-f37b7567308c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:50.235823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:50.235823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:50.235823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:50.235823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:50.235823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:50.235823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:50.235823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:50.235823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:50.235823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:50.235823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:50.235823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:50.235823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:50.235823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:50.235823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:50.236787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:50.236787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:50.236787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:50.236787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:50.236787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:50.236787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:50.236787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:50.236787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:50.236787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:50.236787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:50.236787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:50.236787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:50.236787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:50.236787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:50.236787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:50.236787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:50.236787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:50.237806 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:50.237806 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:50.237806 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:50.237806 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:50.242055 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 304/638] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:50.243256 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4561384-b1d7-4014-b7a4-fd3e61b738f7 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:50.243548 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4561384-b1d7-4014-b7a4-fd3e61b738f7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:50.243856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4561384-b1d7-4014-b7a4-fd3e61b738f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:50.252689 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 335/639] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:50.253676 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b3feb-94ca-44c0-8623-fdcb512621ab None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:50.262415 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b4561384-b1d7-4014-b7a4-fd3e61b738f7 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:50.263607 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b4561384-b1d7-4014-b7a4-fd3e61b738f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:50.330868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 305/640] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:50.331713 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4561384-b1d7-4014-b7a4-fd3e61b738f7 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:50.358682 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b3feb-94ca-44c0-8623-fdcb512621ab None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:50.395155 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2dc9ec-3f5a-45b2-941f-93c93c88681d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:50.395719 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dc9ec-3f5a-45b2-941f-93c93c88681d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:50.395997 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dc9ec-3f5a-45b2-941f-93c93c88681d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:50.396270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dc9ec-3f5a-45b2-941f-93c93c88681d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:50.406969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2dc9ec-3f5a-45b2-941f-93c93c88681d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:50.408469 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2dc9ec-3f5a-45b2-941f-93c93c88681d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:50.425847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-6f2dc9ec-3f5a-45b2-941f-93c93c88681d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:50.425847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:50.425847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:50.425847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:50.425847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:50.425847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:50.425847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:50.425847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:50.425847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:50.425847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:50.425847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:50.425847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:50.425847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:50.425847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:50.425847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:50.426714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:50.426714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:50.426714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:50.426714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:50.426714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:50.426714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:50.426714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:50.426714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:50.426714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:50.426714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:50.426714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:50.426714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:50.426714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:50.426714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:50.426714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:50.426714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:50.426714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:50.432834 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:50.432834 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:50.432834 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:50.432834 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:50.433058 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4561384-b1d7-4014-b7a4-fd3e61b738f7 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:50.433466 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 336/641] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:50.433466 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2dc9ec-3f5a-45b2-941f-93c93c88681d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:50.466851 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5705d0-f37b-4399-b10c-03a1e9160706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:50.467520 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5705d0-f37b-4399-b10c-03a1e9160706 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:50.467839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5705d0-f37b-4399-b10c-03a1e9160706 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:50.468114 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5705d0-f37b-4399-b10c-03a1e9160706 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:50.468839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5705d0-f37b-4399-b10c-03a1e9160706 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:50.469146 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5705d0-f37b-4399-b10c-03a1e9160706 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:50.470515 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5705d0-f37b-4399-b10c-03a1e9160706 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:50.486437 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 306/642] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:50.486437 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5705d0-f37b-4399-b10c-03a1e9160706 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:50.530636 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2dc9ec-3f5a-45b2-941f-93c93c88681d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:50.564472 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1b860-f29a-4afb-b467-a6052db11aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:50.565271 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1b860-f29a-4afb-b467-a6052db11aec None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:50.565554 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1b860-f29a-4afb-b467-a6052db11aec None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:50.565832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1b860-f29a-4afb-b467-a6052db11aec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:50.575798 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1b860-f29a-4afb-b467-a6052db11aec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:50.577236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1b860-f29a-4afb-b467-a6052db11aec None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:50.586505 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5705d0-f37b-4399-b10c-03a1e9160706 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:50.595083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-8aa1b860-f29a-4afb-b467-a6052db11aec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:50.595083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:50.595083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:50.595083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:50.595083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:50.595083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:50.595083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:50.595083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:50.595083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:50.595083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:50.595083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:50.595083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:50.595083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:50.595083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:50.595083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:50.596270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:50.596270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:50.596270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:50.596270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:50.596270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:50.596270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:50.596270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:50.596270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:50.596270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:50.596270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:50.596270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:50.596270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:50.596270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:50.596270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:50.596270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:50.596270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:50.596270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:50.597280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:50.597280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:50.597280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:50.597280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:50.597280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 337/643] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:50.597570 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1b860-f29a-4afb-b467-a6052db11aec None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:50.624412 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9af04e-171e-489b-8a66-51f40424d88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:50.625207 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9af04e-171e-489b-8a66-51f40424d88b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:50.625493 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9af04e-171e-489b-8a66-51f40424d88b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:50.625766 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9af04e-171e-489b-8a66-51f40424d88b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:50.636122 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9af04e-171e-489b-8a66-51f40424d88b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:50.643961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-cb9af04e-171e-489b-8a66-51f40424d88b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:50.643961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:50.643961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:50.643961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:50.643961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:50.643961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:50.643961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:50.643961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:50.643961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:50.643961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:50.643961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:50.643961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:50.643961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:50.643961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:50.643961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:50.643961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:50.644916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:50.644916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:50.644916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:50.644916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:50.644916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:50.644916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:50.644916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:50.644916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:50.644916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:50.644916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:50.644916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:50.644916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:50.644916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:50.644916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:50.644916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:50.644916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:50.651534 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:50.651534 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:50.651534 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:50.651534 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:50.651534 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:50.651534 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:50.651534 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:50.651534 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:50.651534 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:50.651534 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:50.651534 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:50.651534 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:50.651534 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 307/644] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:31:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:50.651534 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9af04e-171e-489b-8a66-51f40424d88b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:50.695219 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1b860-f29a-4afb-b467-a6052db11aec None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:50.727282 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e03816-bc96-46c6-acd1-24a8ab563ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:50.727975 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e03816-bc96-46c6-acd1-24a8ab563ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:50.728252 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e03816-bc96-46c6-acd1-24a8ab563ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:50.728517 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e03816-bc96-46c6-acd1-24a8ab563ec0 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:50.729234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e03816-bc96-46c6-acd1-24a8ab563ec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:50.729535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e03816-bc96-46c6-acd1-24a8ab563ec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:50.730884 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e03816-bc96-46c6-acd1-24a8ab563ec0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:50.741832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 338/645] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:50.742604 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e03816-bc96-46c6-acd1-24a8ab563ec0 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:50.751292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9af04e-171e-489b-8a66-51f40424d88b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:50.784618 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061dcb1-be6c-4d5c-b4dd-83b538e1d2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:50.785406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061dcb1-be6c-4d5c-b4dd-83b538e1d2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:50.785692 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061dcb1-be6c-4d5c-b4dd-83b538e1d2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:50.785964 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061dcb1-be6c-4d5c-b4dd-83b538e1d2a3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:50.793531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061dcb1-be6c-4d5c-b4dd-83b538e1d2a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:50.794971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061dcb1-be6c-4d5c-b4dd-83b538e1d2a3 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:50.808778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5061dcb1-be6c-4d5c-b4dd-83b538e1d2a3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 06:31:50.808778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:50.808778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:50.808778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:50.808778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:50.808778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:50.808778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:50.808778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:50.808778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:50.808778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:50.808778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:50.808778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:50.808778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:31:50.808778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:31:50.808778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:31:50.808778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:31:50.809760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:50.809760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:50.809760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:31:50.809760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:50.809760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:31:50.809760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:50.809760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:50.809760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:50.809760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:50.809760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:50.809760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:50.809760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:50.809760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:50.809760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:50.809760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:50.809760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:50.809760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:50.809760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:50.810727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:50.810727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:50.810727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:31:50.810727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:31:50.810727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:31:50.810727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:31:50.810727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:31:50.810727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:31:50.810727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 06:31:50.810727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:50.814545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 308/646] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:50.815376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061dcb1-be6c-4d5c-b4dd-83b538e1d2a3 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:50.836672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e03816-bc96-46c6-acd1-24a8ab563ec0 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:50.870947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31be4af-48db-4d87-9809-c056828ef693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:50.871648 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31be4af-48db-4d87-9809-c056828ef693 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:50.871964 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31be4af-48db-4d87-9809-c056828ef693 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:50.872240 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31be4af-48db-4d87-9809-c056828ef693 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:50.872970 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31be4af-48db-4d87-9809-c056828ef693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:50.873278 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31be4af-48db-4d87-9809-c056828ef693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:50.874643 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31be4af-48db-4d87-9809-c056828ef693 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:50.890603 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 339/647] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:50.891467 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31be4af-48db-4d87-9809-c056828ef693 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:50.913235 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061dcb1-be6c-4d5c-b4dd-83b538e1d2a3 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:50.946397 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9749b-de79-40cc-9e25-c934cafa8155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:50.947321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9749b-de79-40cc-9e25-c934cafa8155 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:50.947902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9749b-de79-40cc-9e25-c934cafa8155 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:50.948365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9749b-de79-40cc-9e25-c934cafa8155 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:50.949183 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9749b-de79-40cc-9e25-c934cafa8155 None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:50.949487 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9749b-de79-40cc-9e25-c934cafa8155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:50.950847 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9749b-de79-40cc-9e25-c934cafa8155 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:50.960668 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 309/648] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 12 06:31:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:50.961015 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9749b-de79-40cc-9e25-c934cafa8155 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:51.000217 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31be4af-48db-4d87-9809-c056828ef693 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:51.036382 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8c27a-339a-4d22-9377-e5fa95b5499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:51.037391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8c27a-339a-4d22-9377-e5fa95b5499d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:51.037506 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8c27a-339a-4d22-9377-e5fa95b5499d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:51.037726 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8c27a-339a-4d22-9377-e5fa95b5499d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:51.045038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8c27a-339a-4d22-9377-e5fa95b5499d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:51.046487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8c27a-339a-4d22-9377-e5fa95b5499d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:51.061292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-27f8c27a-339a-4d22-9377-e5fa95b5499d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 06:31:51.061292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:51.061292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:51.061292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:51.061292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:51.061292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:51.061292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:51.061292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:51.061292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:51.061292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:51.061292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:51.061292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:51.061292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:31:51.061292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:31:51.061292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:31:51.061292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:31:51.062235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:51.062235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:51.062235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:31:51.062235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:51.062235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:31:51.062235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:51.062235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:51.062235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:51.062235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:51.062235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:51.062235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:51.062235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:51.062235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:51.062235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:51.062235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:51.062235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:51.062235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:51.062235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:51.063281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:51.063281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:51.063281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:31:51.063281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:31:51.063281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:31:51.063281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:31:51.063281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:31:51.063281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:31:51.063281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 06:31:51.063281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:51.063281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 340/649] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:31:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:51.063281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8c27a-339a-4d22-9377-e5fa95b5499d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:51.071160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9749b-de79-40cc-9e25-c934cafa8155 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:51.107012 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bec00c-1222-4790-96d3-3baca5b213bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:51.107998 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bec00c-1222-4790-96d3-3baca5b213bf None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:51.108288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bec00c-1222-4790-96d3-3baca5b213bf None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:51.108562 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bec00c-1222-4790-96d3-3baca5b213bf None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:51.109574 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bec00c-1222-4790-96d3-3baca5b213bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:51.110251 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bec00c-1222-4790-96d3-3baca5b213bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:51.111969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bec00c-1222-4790-96d3-3baca5b213bf None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:51.130108 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 310/650] 10.222.0.25 () {56 vars in 1137 bytes} [Thu May 12 06:31:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:51.130949 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bec00c-1222-4790-96d3-3baca5b213bf None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:51.161746 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8c27a-339a-4d22-9377-e5fa95b5499d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:51.194797 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd241c-d70c-4a5e-b321-055c96231995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:51.195854 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd241c-d70c-4a5e-b321-055c96231995 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:51.196277 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd241c-d70c-4a5e-b321-055c96231995 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:51.196746 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd241c-d70c-4a5e-b321-055c96231995 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:51.203403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd241c-d70c-4a5e-b321-055c96231995 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:51.205034 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd241c-d70c-4a5e-b321-055c96231995 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:51.219700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-87cd241c-d70c-4a5e-b321-055c96231995 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:51.219700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:51.219700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:51.219700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:51.219700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:51.219700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:51.219700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:51.219700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:51.219700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:51.219700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:51.219700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:51.219700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:51.219700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:31:51.219700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:31:51.219700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:31:51.220661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:31:51.220661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:51.220661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:51.220661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:51.220661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:51.220661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:51.220661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:51.220661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:51.220661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:51.220661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:51.220661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:51.220661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:51.220661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:51.220661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:51.220661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:51.220661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:51.220661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:51.221566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:31:51.221566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:31:51.221566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:31:51.221566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:31:51.221566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:31:51.221566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:31:51.221566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:51.221566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:51.221566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 341/651] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:51.222065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd241c-d70c-4a5e-b321-055c96231995 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:51.234911 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bec00c-1222-4790-96d3-3baca5b213bf None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:51.267771 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fc292-3353-4e63-980c-4e706a1831ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:51.268567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fc292-3353-4e63-980c-4e706a1831ec None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:51.268851 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fc292-3353-4e63-980c-4e706a1831ec None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:51.269125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fc292-3353-4e63-980c-4e706a1831ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:51.279666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fc292-3353-4e63-980c-4e706a1831ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:51.281131 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fc292-3353-4e63-980c-4e706a1831ec None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:51.299544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-687fc292-3353-4e63-980c-4e706a1831ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:51.299544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:51.299544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:51.299544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:51.299544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:51.299544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:51.299544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:51.299544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:51.299544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:51.299544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:51.299544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:51.299544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:51.299544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:51.299544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:51.299544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:51.300469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:51.300469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:51.300469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:51.300469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:51.300469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:51.300469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:51.300469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:51.300469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:51.300469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:51.300469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:51.300469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:51.300469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:51.300469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:51.300469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:51.300469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:51.300469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:51.300469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:51.302025 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:51.302025 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:51.302025 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:51.302025 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:51.302025 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 311/652] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:51.302025 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fc292-3353-4e63-980c-4e706a1831ec None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:51.332239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd241c-d70c-4a5e-b321-055c96231995 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:51.365177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1aa7a2-b6a0-40a6-923f-25b54c59ed1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:51.365883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1aa7a2-b6a0-40a6-923f-25b54c59ed1b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:51.366165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1aa7a2-b6a0-40a6-923f-25b54c59ed1b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:51.366440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1aa7a2-b6a0-40a6-923f-25b54c59ed1b None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:51.367291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1aa7a2-b6a0-40a6-923f-25b54c59ed1b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:51.367602 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1aa7a2-b6a0-40a6-923f-25b54c59ed1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:51.369061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1aa7a2-b6a0-40a6-923f-25b54c59ed1b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:51.390347 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 342/653] 10.222.0.25 () {56 vars in 1139 bytes} [Thu May 12 06:31:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:51.390347 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1aa7a2-b6a0-40a6-923f-25b54c59ed1b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:51.396860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fc292-3353-4e63-980c-4e706a1831ec None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:51.436133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419fb9b-7441-4965-9374-d16dedecb3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:51.437635 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419fb9b-7441-4965-9374-d16dedecb3db None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:51.437919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419fb9b-7441-4965-9374-d16dedecb3db None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:51.438190 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419fb9b-7441-4965-9374-d16dedecb3db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:51.494285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1aa7a2-b6a0-40a6-923f-25b54c59ed1b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:51.511936 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419fb9b-7441-4965-9374-d16dedecb3db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:51.513391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419fb9b-7441-4965-9374-d16dedecb3db None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:51.529052 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7331bc-c30a-467d-8830-14e38e9347a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:51.529728 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7331bc-c30a-467d-8830-14e38e9347a8 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:51.530015 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7331bc-c30a-467d-8830-14e38e9347a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:51.530289 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7331bc-c30a-467d-8830-14e38e9347a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:51.531083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7331bc-c30a-467d-8830-14e38e9347a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:51.531391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7331bc-c30a-467d-8830-14e38e9347a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:51.532839 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7331bc-c30a-467d-8830-14e38e9347a8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:51.549474 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 343/654] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:31:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:51.549474 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7331bc-c30a-467d-8830-14e38e9347a8 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:51.618297 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 312/655] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:51.618297 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419fb9b-7441-4965-9374-d16dedecb3db None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:51.641734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7331bc-c30a-467d-8830-14e38e9347a8 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:51.672953 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2c59b-beea-4e5d-9d8d-2829d09e7c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:51.673636 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2c59b-beea-4e5d-9d8d-2829d09e7c35 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:51.673913 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2c59b-beea-4e5d-9d8d-2829d09e7c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:51.674181 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2c59b-beea-4e5d-9d8d-2829d09e7c35 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:51.674892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2c59b-beea-4e5d-9d8d-2829d09e7c35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:51.675192 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2c59b-beea-4e5d-9d8d-2829d09e7c35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:51.676564 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2c59b-beea-4e5d-9d8d-2829d09e7c35 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:51.688853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 344/656] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:51.689450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2c59b-beea-4e5d-9d8d-2829d09e7c35 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:51.711886 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419fb9b-7441-4965-9374-d16dedecb3db None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:51.743660 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5e87d-2b6d-4100-851a-e88dfb7f0ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:51.744381 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5e87d-2b6d-4100-851a-e88dfb7f0ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:51.744609 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5e87d-2b6d-4100-851a-e88dfb7f0ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:51.744883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5e87d-2b6d-4100-851a-e88dfb7f0ee6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:51.780589 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2c59b-beea-4e5d-9d8d-2829d09e7c35 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:51.812117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043f2b5-2a7d-436f-8500-7507d8561416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:51.812759 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043f2b5-2a7d-436f-8500-7507d8561416 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:51.813037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043f2b5-2a7d-436f-8500-7507d8561416 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:51.813307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043f2b5-2a7d-436f-8500-7507d8561416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:51.813948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5e87d-2b6d-4100-851a-e88dfb7f0ee6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:51.814128 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043f2b5-2a7d-436f-8500-7507d8561416 None admin] RBAC: Adding query filter params (role.id=ed3e6c61b2d14364a605282f0f1488ba, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=bbcd54a927bf46f183b50fbda677868d) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:51.814433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043f2b5-2a7d-436f-8500-7507d8561416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:51.815399 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5e87d-2b6d-4100-851a-e88dfb7f0ee6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:51.815834 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043f2b5-2a7d-436f-8500-7507d8561416 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:51.821990 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 345/657] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:31:51 2022] GET /identity/v3/role_assignments?user.id=bbcd54a927bf46f183b50fbda677868d&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=ed3e6c61b2d14364a605282f0f1488ba => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:51.823190 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63544be4-1e3b-4c50-8713-0280f3ba36b6 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:51.823474 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63544be4-1e3b-4c50-8713-0280f3ba36b6 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:51.823777 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63544be4-1e3b-4c50-8713-0280f3ba36b6 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:51.824987 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 346/658] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:51.825685 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63544be4-1e3b-4c50-8713-0280f3ba36b6 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:51.941869 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 313/659] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:51.941869 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5e87d-2b6d-4100-851a-e88dfb7f0ee6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:51.943704 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63544be4-1e3b-4c50-8713-0280f3ba36b6 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:51.982590 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89073710-baf1-4b0f-aada-c580c8798bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:51.983414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89073710-baf1-4b0f-aada-c580c8798bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:51.983706 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89073710-baf1-4b0f-aada-c580c8798bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:51.984016 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89073710-baf1-4b0f-aada-c580c8798bc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:51.995535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89073710-baf1-4b0f-aada-c580c8798bc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:51.997025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89073710-baf1-4b0f-aada-c580c8798bc2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:52.016879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-89073710-baf1-4b0f-aada-c580c8798bc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:52.016879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:52.016879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:52.016879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:52.016879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:52.016879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:52.016879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:52.016879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:52.016879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:52.016879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:52.016879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:52.016879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:52.016879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:52.016879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:52.016879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:52.018003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:52.018003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:52.018003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:52.018003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:52.018003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:52.018003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:52.018003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:52.018003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:52.018003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:52.018003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:52.018003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:52.018003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:52.018003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:52.018003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:52.018003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:52.018003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:52.018003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:52.018991 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:52.018991 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:52.018991 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:52.018991 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:52.018991 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 347/660] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:52.019927 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d672108-087c-4bbe-a514-0bf6de3cb508 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:52.019927 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d672108-087c-4bbe-a514-0bf6de3cb508 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:52.019927 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d672108-087c-4bbe-a514-0bf6de3cb508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:52.036299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4d672108-087c-4bbe-a514-0bf6de3cb508 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:52.037481 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4d672108-087c-4bbe-a514-0bf6de3cb508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:52.044481 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5e87d-2b6d-4100-851a-e88dfb7f0ee6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:52.079762 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817a1f7-64ec-48ff-9328-0295f7e1608e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:52.080564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817a1f7-64ec-48ff-9328-0295f7e1608e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:52.080841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817a1f7-64ec-48ff-9328-0295f7e1608e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:52.081162 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817a1f7-64ec-48ff-9328-0295f7e1608e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:52.088362 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817a1f7-64ec-48ff-9328-0295f7e1608e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:52.089802 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817a1f7-64ec-48ff-9328-0295f7e1608e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:52.104646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5817a1f7-64ec-48ff-9328-0295f7e1608e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 06:31:52.104646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:52.104646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:52.104646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:52.104646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:52.104646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:52.104646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:52.104646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:52.104646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:52.104646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:52.104646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:52.104646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:52.104646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:31:52.104646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:31:52.104646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:31:52.104646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:31:52.105839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:52.105839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:52.105839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:31:52.105839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:52.105839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:31:52.105839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:52.105839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:52.105839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:52.105839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:52.105839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:52.105839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:52.105839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:52.105839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:52.105839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:52.105839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:52.105839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:52.105839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:52.105839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:52.106791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:52.106791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:52.106791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:31:52.106791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:31:52.106791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:31:52.106791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:31:52.106791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:31:52.106791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:31:52.106791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 06:31:52.106791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:52.106791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 314/661] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:52.106791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817a1f7-64ec-48ff-9328-0295f7e1608e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:52.119634 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 348/662] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:52.120712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d672108-087c-4bbe-a514-0bf6de3cb508 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:52.213934 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817a1f7-64ec-48ff-9328-0295f7e1608e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:52.214917 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d672108-087c-4bbe-a514-0bf6de3cb508 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:52.247721 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3461dc3-c8f9-40f7-bac6-4f8b07820d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:52.247920 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d5d72-f328-44fd-97c2-5d478fec5d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:52.248464 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d5d72-f328-44fd-97c2-5d478fec5d06 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:52.248741 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d5d72-f328-44fd-97c2-5d478fec5d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:52.248842 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3461dc3-c8f9-40f7-bac6-4f8b07820d01 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:52.249009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d5d72-f328-44fd-97c2-5d478fec5d06 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:52.249302 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3461dc3-c8f9-40f7-bac6-4f8b07820d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:52.249674 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3461dc3-c8f9-40f7-bac6-4f8b07820d01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:52.249762 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d5d72-f328-44fd-97c2-5d478fec5d06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:52.250009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d5d72-f328-44fd-97c2-5d478fec5d06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:52.251357 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d5d72-f328-44fd-97c2-5d478fec5d06 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:52.260368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3461dc3-c8f9-40f7-bac6-4f8b07820d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:52.261797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3461dc3-c8f9-40f7-bac6-4f8b07820d01 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:52.267309 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 349/663] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:52.267309 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d5d72-f328-44fd-97c2-5d478fec5d06 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:52.283654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-b3461dc3-c8f9-40f7-bac6-4f8b07820d01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:52.283654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:52.283654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:52.283654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:52.283654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:52.283654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:52.283654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:52.283654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:52.283654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:52.283654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:52.283654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:52.283654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:52.283654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:52.283654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:52.283654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:52.284792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:52.284792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:52.284792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:52.284792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:52.284792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:52.284792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:52.284792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:52.284792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:52.284792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:52.284792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:52.284792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:52.284792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:52.284792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:52.284792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:52.284792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:52.284792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:52.284792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:52.285894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:52.285894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:52.285894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:52.285894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:52.285894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 315/664] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:52.285894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3461dc3-c8f9-40f7-bac6-4f8b07820d01 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:52.363782 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d5d72-f328-44fd-97c2-5d478fec5d06 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:52.386223 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3461dc3-c8f9-40f7-bac6-4f8b07820d01 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:52.395998 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf6b83-5b10-4699-8492-5b642bdacf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:52.396675 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf6b83-5b10-4699-8492-5b642bdacf7d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:52.396982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf6b83-5b10-4699-8492-5b642bdacf7d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:52.399006 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf6b83-5b10-4699-8492-5b642bdacf7d None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:52.399006 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf6b83-5b10-4699-8492-5b642bdacf7d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:52.399006 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf6b83-5b10-4699-8492-5b642bdacf7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:52.399852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf6b83-5b10-4699-8492-5b642bdacf7d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:52.418565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 350/665] 10.222.0.25 () {56 vars in 1137 bytes} [Thu May 12 06:31:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:52.419382 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf6b83-5b10-4699-8492-5b642bdacf7d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:52.427190 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d7df7-a1c7-4a8a-afb4-b495bc755a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:52.428917 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d7df7-a1c7-4a8a-afb4-b495bc755a00 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:52.429198 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d7df7-a1c7-4a8a-afb4-b495bc755a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:52.429465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d7df7-a1c7-4a8a-afb4-b495bc755a00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:52.440114 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d7df7-a1c7-4a8a-afb4-b495bc755a00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:52.448098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-9c5d7df7-a1c7-4a8a-afb4-b495bc755a00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:52.448098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:52.448098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:52.448098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:52.448098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:52.448098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:52.448098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:52.448098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:52.448098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:52.448098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:52.448098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:52.448098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:52.448098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:52.448098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:52.448098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:52.448098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:52.449031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:52.449031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:52.449031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:52.449031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:52.449031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:52.449031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:52.449031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:52.449031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:52.449031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:52.449031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:52.449031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:52.449031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:52.449031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:52.449031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:52.449031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:52.449031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:52.449898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:52.449898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:52.449898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:52.449898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:52.449898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:52.449898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:52.449898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:52.449898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:52.449898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:52.449898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:52.449898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 06:31:52.449898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:52.449898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 316/666] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:31:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:52.450607 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d7df7-a1c7-4a8a-afb4-b495bc755a00 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:52.520873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf6b83-5b10-4699-8492-5b642bdacf7d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:52.549814 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d7df7-a1c7-4a8a-afb4-b495bc755a00 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:52.553072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca34d1-6204-4b63-b661-e0e4889be0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:52.554461 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca34d1-6204-4b63-b661-e0e4889be0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:52.554739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca34d1-6204-4b63-b661-e0e4889be0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:52.555005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca34d1-6204-4b63-b661-e0e4889be0f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:52.561615 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca34d1-6204-4b63-b661-e0e4889be0f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:52.563036 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca34d1-6204-4b63-b661-e0e4889be0f8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:52.577367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-38ca34d1-6204-4b63-b661-e0e4889be0f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:52.577367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:52.577367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:52.577367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:52.577367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:52.577367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:52.577367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:52.577367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:52.577367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:52.577367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:52.577367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:52.577367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:52.577367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:31:52.577367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:31:52.577367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:31:52.578290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:31:52.578290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:52.578290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:52.578290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:52.578290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:52.578290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:52.578290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:52.578290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:52.578290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:52.578290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:52.578290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:52.578290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:52.578290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:52.578290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:52.578290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:52.578290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:52.578290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:52.579207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:31:52.579207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:31:52.579207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:31:52.579207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:31:52.579207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:31:52.579207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:31:52.579207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:52.579207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:52.586192 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 351/667] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:52.586192 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca34d1-6204-4b63-b661-e0e4889be0f8 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:52.586798 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0eb82-ef7f-48ca-955a-1109b2b318f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:52.587462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0eb82-ef7f-48ca-955a-1109b2b318f1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:52.587764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0eb82-ef7f-48ca-955a-1109b2b318f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:52.588037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0eb82-ef7f-48ca-955a-1109b2b318f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:52.588762 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0eb82-ef7f-48ca-955a-1109b2b318f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:52.589068 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0eb82-ef7f-48ca-955a-1109b2b318f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:52.590432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0eb82-ef7f-48ca-955a-1109b2b318f1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:52.606830 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 317/668] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:52.606830 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0eb82-ef7f-48ca-955a-1109b2b318f1 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:52.681762 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca34d1-6204-4b63-b661-e0e4889be0f8 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:52.698476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0eb82-ef7f-48ca-955a-1109b2b318f1 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:52.714769 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d94914-7506-4749-849d-8410ce822e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:52.715420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d94914-7506-4749-849d-8410ce822e38 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:52.715718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d94914-7506-4749-849d-8410ce822e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:52.715998 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d94914-7506-4749-849d-8410ce822e38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:52.731142 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771454e5-ce3f-4378-a7e0-40ba2b5afe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:52.731848 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771454e5-ce3f-4378-a7e0-40ba2b5afe0b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:52.732129 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771454e5-ce3f-4378-a7e0-40ba2b5afe0b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:52.732398 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771454e5-ce3f-4378-a7e0-40ba2b5afe0b None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:52.733140 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771454e5-ce3f-4378-a7e0-40ba2b5afe0b None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:52.733441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771454e5-ce3f-4378-a7e0-40ba2b5afe0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:52.734815 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771454e5-ce3f-4378-a7e0-40ba2b5afe0b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:52.743720 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 318/669] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 12 06:31:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:52.744512 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771454e5-ce3f-4378-a7e0-40ba2b5afe0b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:52.783702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d94914-7506-4749-849d-8410ce822e38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:52.785087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d94914-7506-4749-849d-8410ce822e38 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:52.841187 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771454e5-ce3f-4378-a7e0-40ba2b5afe0b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:52.874834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace02772-784e-490f-85da-c0381fddbe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:52.875574 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace02772-784e-490f-85da-c0381fddbe65 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:52.875909 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace02772-784e-490f-85da-c0381fddbe65 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:52.876169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace02772-784e-490f-85da-c0381fddbe65 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:52.876947 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace02772-784e-490f-85da-c0381fddbe65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:52.877257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace02772-784e-490f-85da-c0381fddbe65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:52.878674 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace02772-784e-490f-85da-c0381fddbe65 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:52.886027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 352/670] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:52.886027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d94914-7506-4749-849d-8410ce822e38 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:52.895042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 319/671] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:31:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:52.895042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace02772-784e-490f-85da-c0381fddbe65 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:52.985933 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d94914-7506-4749-849d-8410ce822e38 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:52.991457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace02772-784e-490f-85da-c0381fddbe65 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:53.025579 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c228b-425d-4809-a213-6322e01f3de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:53.026094 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01738452-ee00-4530-9deb-c4a69328d578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:53.026373 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c228b-425d-4809-a213-6322e01f3de6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:53.026653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c228b-425d-4809-a213-6322e01f3de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:53.026878 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01738452-ee00-4530-9deb-c4a69328d578 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:53.026995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c228b-425d-4809-a213-6322e01f3de6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:53.027153 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01738452-ee00-4530-9deb-c4a69328d578 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:53.027451 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01738452-ee00-4530-9deb-c4a69328d578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:53.033443 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c228b-425d-4809-a213-6322e01f3de6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:53.034915 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c228b-425d-4809-a213-6322e01f3de6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:53.037374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01738452-ee00-4530-9deb-c4a69328d578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:53.039326 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01738452-ee00-4530-9deb-c4a69328d578 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:53.049166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-c51c228b-425d-4809-a213-6322e01f3de6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:53.049166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:53.049166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:53.049166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:53.049166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:53.049166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:53.049166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:53.049166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:53.049166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:53.049166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:53.049166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:53.049166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:53.049166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:31:53.049166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:31:53.049166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:31:53.050072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:31:53.050072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:53.050072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:53.050072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:53.050072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:53.050072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:53.050072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:53.050072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:53.050072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:53.050072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:53.050072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:53.050072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:53.050072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:53.050072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:53.050072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:53.050072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:53.050072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:53.056195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:31:53.056195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:31:53.056195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:31:53.056195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:31:53.056195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:31:53.056195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:31:53.056195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:53.056195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:53.056195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 353/672] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:53.056195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c228b-425d-4809-a213-6322e01f3de6 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:53.056990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-01738452-ee00-4530-9deb-c4a69328d578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:53.056990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:53.056990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:53.056990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:53.056990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:53.056990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:53.056990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:53.056990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:53.056990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:53.056990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:53.056990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:53.056990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:53.056990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:53.056990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:53.056990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:53.057827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:53.057827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:53.057827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:53.057827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:53.057827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:53.057827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:53.057827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:53.057827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:53.057827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:53.057827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:53.057827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:53.057827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:53.057827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:53.057827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:53.057827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:53.057827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:53.057827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:53.058729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:53.058729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:53.058729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:53.058729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:53.058729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 320/673] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:53.059009 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01738452-ee00-4530-9deb-c4a69328d578 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:53.158713 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01738452-ee00-4530-9deb-c4a69328d578 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:53.159978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c228b-425d-4809-a213-6322e01f3de6 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:53.192237 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6208759-e728-46b6-917a-be56bd1b9e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:53.192452 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ebb24-6f0f-41c3-be7f-3dd7a694a1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:53.192896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6208759-e728-46b6-917a-be56bd1b9e05 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:53.193151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ebb24-6f0f-41c3-be7f-3dd7a694a1ae None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:53.193268 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6208759-e728-46b6-917a-be56bd1b9e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:53.193424 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ebb24-6f0f-41c3-be7f-3dd7a694a1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:53.193519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6208759-e728-46b6-917a-be56bd1b9e05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:53.193685 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ebb24-6f0f-41c3-be7f-3dd7a694a1ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:53.194738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6208759-e728-46b6-917a-be56bd1b9e05 None admin] RBAC: Adding query filter params (role.id=ed3e6c61b2d14364a605282f0f1488ba, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=4a08d8e39f6f42bc9b93dd6d2311bcbe) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:53.195049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6208759-e728-46b6-917a-be56bd1b9e05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:53.196513 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6208759-e728-46b6-917a-be56bd1b9e05 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:53.212077 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 321/674] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:31:53 2022] GET /identity/v3/role_assignments?user.id=4a08d8e39f6f42bc9b93dd6d2311bcbe&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=ed3e6c61b2d14364a605282f0f1488ba => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:53.212077 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6208759-e728-46b6-917a-be56bd1b9e05 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:53.215275 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ebb24-6f0f-41c3-be7f-3dd7a694a1ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:53.216866 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ebb24-6f0f-41c3-be7f-3dd7a694a1ae None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:53.235575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-fc3ebb24-6f0f-41c3-be7f-3dd7a694a1ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:53.235575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:53.235575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:53.235575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:53.235575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:53.235575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:53.235575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:53.235575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:53.235575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:53.235575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:53.235575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:53.235575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:53.235575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:53.235575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:53.235575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:53.236668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:53.236668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:53.236668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:53.236668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:53.236668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:53.236668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:53.236668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:53.236668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:53.236668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:53.236668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:53.236668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:53.236668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:53.236668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:53.236668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:53.236668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:53.236668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:53.236668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:53.237581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:53.237581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:53.237581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:53.237581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:53.243092 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 354/675] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:53.244653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ebb24-6f0f-41c3-be7f-3dd7a694a1ae None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:53.346462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6208759-e728-46b6-917a-be56bd1b9e05 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:53.351940 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ebb24-6f0f-41c3-be7f-3dd7a694a1ae None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:53.387579 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b942345-a4c4-4c8c-8e60-37ceb0be80b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:53.388248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b942345-a4c4-4c8c-8e60-37ceb0be80b2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:53.388591 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b942345-a4c4-4c8c-8e60-37ceb0be80b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:53.388935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b942345-a4c4-4c8c-8e60-37ceb0be80b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:53.389770 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b942345-a4c4-4c8c-8e60-37ceb0be80b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:53.390117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b942345-a4c4-4c8c-8e60-37ceb0be80b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:53.391663 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b942345-a4c4-4c8c-8e60-37ceb0be80b2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:53.394464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434e610-7380-4d01-aa08-8fee69540295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:53.395868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434e610-7380-4d01-aa08-8fee69540295 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:53.396354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434e610-7380-4d01-aa08-8fee69540295 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:53.396807 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434e610-7380-4d01-aa08-8fee69540295 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:53.397828 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434e610-7380-4d01-aa08-8fee69540295 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:53.398339 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434e610-7380-4d01-aa08-8fee69540295 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:53.400537 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434e610-7380-4d01-aa08-8fee69540295 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:53.406452 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 355/676] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:53.407358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b942345-a4c4-4c8c-8e60-37ceb0be80b2 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:53.417055 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 322/677] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:31:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:53.418144 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434e610-7380-4d01-aa08-8fee69540295 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:53.524946 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b942345-a4c4-4c8c-8e60-37ceb0be80b2 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:53.531742 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434e610-7380-4d01-aa08-8fee69540295 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:53.569418 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1df7b-dcbc-47da-b24f-3b89bac4e84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:53.570092 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1df7b-dcbc-47da-b24f-3b89bac4e84d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:53.570377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1df7b-dcbc-47da-b24f-3b89bac4e84d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:53.570663 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1df7b-dcbc-47da-b24f-3b89bac4e84d None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:53.571388 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1df7b-dcbc-47da-b24f-3b89bac4e84d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:53.571711 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1df7b-dcbc-47da-b24f-3b89bac4e84d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:53.573077 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1df7b-dcbc-47da-b24f-3b89bac4e84d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:53.574019 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad39687-570b-4eaa-8b6d-c4bfb7e8f7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:53.574803 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad39687-570b-4eaa-8b6d-c4bfb7e8f7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:53.575078 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad39687-570b-4eaa-8b6d-c4bfb7e8f7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:53.575345 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad39687-570b-4eaa-8b6d-c4bfb7e8f7c9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:53.583047 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad39687-570b-4eaa-8b6d-c4bfb7e8f7c9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:53.585144 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad39687-570b-4eaa-8b6d-c4bfb7e8f7c9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:53.588945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 356/678] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:53.590058 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1df7b-dcbc-47da-b24f-3b89bac4e84d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:53.600576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-bad39687-570b-4eaa-8b6d-c4bfb7e8f7c9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 06:31:53.600576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:53.600576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:53.600576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:53.600576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:53.600576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:53.600576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:53.600576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:53.600576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:53.600576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:53.600576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:53.600576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:53.600576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:31:53.600576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:31:53.600576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:31:53.600576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:31:53.601554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:53.601554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:53.601554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:31:53.601554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:53.601554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:31:53.601554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:53.601554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:53.601554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:53.601554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:53.601554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:53.601554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:53.601554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:53.601554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:53.601554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:53.601554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:53.601554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:53.601554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:53.601554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:53.602900 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:53.602900 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:53.602900 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:31:53.602900 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:31:53.602900 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:31:53.602900 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:31:53.602900 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:31:53.602900 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:31:53.602900 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 06:31:53.602900 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:53.602900 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 323/679] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:31:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:53.602900 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad39687-570b-4eaa-8b6d-c4bfb7e8f7c9 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:53.694356 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1df7b-dcbc-47da-b24f-3b89bac4e84d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:53.709946 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad39687-570b-4eaa-8b6d-c4bfb7e8f7c9 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:53.729211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac72710-1d6c-4c2f-a3df-8420a70628ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:53.729804 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac72710-1d6c-4c2f-a3df-8420a70628ac None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:53.730090 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac72710-1d6c-4c2f-a3df-8420a70628ac None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:53.730371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac72710-1d6c-4c2f-a3df-8420a70628ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:53.731223 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac72710-1d6c-4c2f-a3df-8420a70628ac None admin] RBAC: Adding query filter params (role.id=ed3e6c61b2d14364a605282f0f1488ba, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=5a9cbec1af6545fcb34425dce87d0ef2) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:53.731538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac72710-1d6c-4c2f-a3df-8420a70628ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:53.733023 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac72710-1d6c-4c2f-a3df-8420a70628ac None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:53.747664 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84cad8-c330-462f-9aee-d0c503cb790e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:53.748100 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 357/680] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:31:53 2022] GET /identity/v3/role_assignments?user.id=5a9cbec1af6545fcb34425dce87d0ef2&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=ed3e6c61b2d14364a605282f0f1488ba => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:53.749026 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac72710-1d6c-4c2f-a3df-8420a70628ac None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:53.749332 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84cad8-c330-462f-9aee-d0c503cb790e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:53.749882 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84cad8-c330-462f-9aee-d0c503cb790e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:53.750344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84cad8-c330-462f-9aee-d0c503cb790e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:53.758367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84cad8-c330-462f-9aee-d0c503cb790e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:53.760115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84cad8-c330-462f-9aee-d0c503cb790e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:53.779368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-3b84cad8-c330-462f-9aee-d0c503cb790e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:53.779368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:53.779368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:53.779368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:53.779368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:53.779368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:53.779368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:53.779368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:53.779368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:53.779368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:53.779368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:53.779368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:53.779368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:31:53.779368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:31:53.779368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:31:53.780394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:31:53.780394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:53.780394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:53.780394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:53.780394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:53.780394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:53.780394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:53.780394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:53.780394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:53.780394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:53.780394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:53.780394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:53.780394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:53.780394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:53.780394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:53.780394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:53.780394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:53.781299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:31:53.781299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:31:53.781299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:31:53.781299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:31:53.781299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:31:53.781299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:31:53.781299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:53.781299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:53.786728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 324/681] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:53.792541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84cad8-c330-462f-9aee-d0c503cb790e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:53.909919 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac72710-1d6c-4c2f-a3df-8420a70628ac None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:53.951342 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28a069-6749-4d1b-8d5f-d296b680d988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:53.952564 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28a069-6749-4d1b-8d5f-d296b680d988 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:53.953781 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28a069-6749-4d1b-8d5f-d296b680d988 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:53.954210 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28a069-6749-4d1b-8d5f-d296b680d988 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:53.955230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28a069-6749-4d1b-8d5f-d296b680d988 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:53.955699 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28a069-6749-4d1b-8d5f-d296b680d988 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:53.957787 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28a069-6749-4d1b-8d5f-d296b680d988 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:53.984157 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 358/682] 10.222.0.25 () {56 vars in 1135 bytes} [Thu May 12 06:31:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:53.991426 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28a069-6749-4d1b-8d5f-d296b680d988 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:54.004456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84cad8-c330-462f-9aee-d0c503cb790e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:54.054252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca536423-ec8d-4870-9171-d0a41c39b821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:54.054928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca536423-ec8d-4870-9171-d0a41c39b821 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:54.055208 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca536423-ec8d-4870-9171-d0a41c39b821 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:54.055479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca536423-ec8d-4870-9171-d0a41c39b821 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:54.056310 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca536423-ec8d-4870-9171-d0a41c39b821 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:54.056614 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca536423-ec8d-4870-9171-d0a41c39b821 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:54.058038 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca536423-ec8d-4870-9171-d0a41c39b821 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:54.070594 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 325/683] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:31:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:54.077570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca536423-ec8d-4870-9171-d0a41c39b821 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:54.110907 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28a069-6749-4d1b-8d5f-d296b680d988 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:54.146089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa7eb0-c05f-4028-9e3c-d8754ff0be91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:54.146747 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa7eb0-c05f-4028-9e3c-d8754ff0be91 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:54.147561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa7eb0-c05f-4028-9e3c-d8754ff0be91 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:54.147856 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa7eb0-c05f-4028-9e3c-d8754ff0be91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:54.183409 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca536423-ec8d-4870-9171-d0a41c39b821 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:54.217174 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ac4d6-93a7-4dec-94eb-f1006c964ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:54.217833 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ac4d6-93a7-4dec-94eb-f1006c964ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:54.218113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ac4d6-93a7-4dec-94eb-f1006c964ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:54.218383 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ac4d6-93a7-4dec-94eb-f1006c964ea4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:54.219215 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ac4d6-93a7-4dec-94eb-f1006c964ea4 None admin] RBAC: Adding query filter params (role.id=ed3e6c61b2d14364a605282f0f1488ba, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=4b5006e095ba41d994dca0bf581417e5) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:54.219524 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ac4d6-93a7-4dec-94eb-f1006c964ea4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:54.221000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ac4d6-93a7-4dec-94eb-f1006c964ea4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:54.221187 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa7eb0-c05f-4028-9e3c-d8754ff0be91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:54.222619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa7eb0-c05f-4028-9e3c-d8754ff0be91 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:54.227466 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 326/684] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:31:54 2022] GET /identity/v3/role_assignments?user.id=4b5006e095ba41d994dca0bf581417e5&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=ed3e6c61b2d14364a605282f0f1488ba => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:54.233059 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9d255-1202-451a-b39c-3f085baee602 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:54.233396 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9d255-1202-451a-b39c-3f085baee602 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:54.233661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9d255-1202-451a-b39c-3f085baee602 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:54.235259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 327/685] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:54.241986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2348d9b-20b5-420f-8f13-b5a57419040c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:54.242299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2348d9b-20b5-420f-8f13-b5a57419040c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:54.242526 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2348d9b-20b5-420f-8f13-b5a57419040c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:54.273889 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c2348d9b-20b5-420f-8f13-b5a57419040c None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:54.275105 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c2348d9b-20b5-420f-8f13-b5a57419040c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:54.342838 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 359/686] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:54.348981 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa7eb0-c05f-4028-9e3c-d8754ff0be91 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:54.395852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 328/687] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:54.422838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2348d9b-20b5-420f-8f13-b5a57419040c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:54.521579 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa7eb0-c05f-4028-9e3c-d8754ff0be91 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:54.530470 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2348d9b-20b5-420f-8f13-b5a57419040c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:54.558885 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e4aa6-c513-4056-b6db-2daae168cfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:54.559737 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e4aa6-c513-4056-b6db-2daae168cfaf None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:54.560019 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e4aa6-c513-4056-b6db-2daae168cfaf None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:54.560313 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e4aa6-c513-4056-b6db-2daae168cfaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:54.566075 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38166f5-b10e-414d-906b-7278cc1794b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:54.566860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38166f5-b10e-414d-906b-7278cc1794b4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:54.567134 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38166f5-b10e-414d-906b-7278cc1794b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:54.567399 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38166f5-b10e-414d-906b-7278cc1794b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:54.571995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e4aa6-c513-4056-b6db-2daae168cfaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:54.573432 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e4aa6-c513-4056-b6db-2daae168cfaf None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:54.578435 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38166f5-b10e-414d-906b-7278cc1794b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:54.586243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-c38166f5-b10e-414d-906b-7278cc1794b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:31:54.586243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:54.586243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:54.586243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:54.586243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:54.586243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:54.586243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:54.586243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:54.586243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:54.586243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:54.586243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:54.586243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:54.586243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:54.586243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:54.586243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:54.586243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:54.587227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:54.587227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:54.587227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:54.587227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:54.587227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:54.587227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:54.587227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:54.587227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:54.587227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:54.587227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:54.587227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:54.587227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:54.587227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:54.587227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:54.587227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:54.587227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:54.588132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:54.588132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:54.588132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:54.588132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:54.588132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:54.588132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:54.588132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:54.588132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:54.588132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:54.588132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:54.588132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:31:54.588132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:54.588799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 329/688] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:31:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:31:54.592403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-193e4aa6-c513-4056-b6db-2daae168cfaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:54.592403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:54.592403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:54.592403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:54.592403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:54.592403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:54.592403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:54.592403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:54.592403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:54.592403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:54.592403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:54.592403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:54.592403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:54.592403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:54.592403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:54.594605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:54.594605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:54.594605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:54.594605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:54.594605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:54.594605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:54.594605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:54.594605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:54.594605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:54.594605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:54.594605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:54.594605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:54.594605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:54.594605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:54.594605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:54.594605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:54.594605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:54.596136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:54.596136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:54.596136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:54.596136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:54.596411 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38166f5-b10e-414d-906b-7278cc1794b4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:54.603753 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 360/689] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:54.603753 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e4aa6-c513-4056-b6db-2daae168cfaf None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:54.697984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e4aa6-c513-4056-b6db-2daae168cfaf None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:54.699167 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38166f5-b10e-414d-906b-7278cc1794b4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:54.732457 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae0ca5-c219-4861-a5c6-a806ed4524c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:54.732825 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0e0ed-d008-4447-9298-6e77c9b1cc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:54.733130 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae0ca5-c219-4861-a5c6-a806ed4524c0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:54.733409 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae0ca5-c219-4861-a5c6-a806ed4524c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:54.733577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0e0ed-d008-4447-9298-6e77c9b1cc85 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:54.733737 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae0ca5-c219-4861-a5c6-a806ed4524c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:54.733886 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0e0ed-d008-4447-9298-6e77c9b1cc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:54.734032 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0e0ed-d008-4447-9298-6e77c9b1cc85 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:54.734397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae0ca5-c219-4861-a5c6-a806ed4524c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:54.738316 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae0ca5-c219-4861-a5c6-a806ed4524c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:54.738543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0e0ed-d008-4447-9298-6e77c9b1cc85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:54.738543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0e0ed-d008-4447-9298-6e77c9b1cc85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:54.738843 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae0ca5-c219-4861-a5c6-a806ed4524c0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:54.739011 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0e0ed-d008-4447-9298-6e77c9b1cc85 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:54.745592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 330/690] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:54.750946 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0e0ed-d008-4447-9298-6e77c9b1cc85 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:54.751765 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 361/691] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:54.753756 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae0ca5-c219-4861-a5c6-a806ed4524c0 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:54.854509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae0ca5-c219-4861-a5c6-a806ed4524c0 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:54.854814 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0e0ed-d008-4447-9298-6e77c9b1cc85 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:54.888051 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323d9c0-04bd-4895-adbf-e57e64b3148c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:54.888426 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8cf22-7f91-4a53-b374-37c4b548d48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:54.888838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323d9c0-04bd-4895-adbf-e57e64b3148c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:54.889017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8cf22-7f91-4a53-b374-37c4b548d48e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:54.889172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323d9c0-04bd-4895-adbf-e57e64b3148c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:54.889335 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8cf22-7f91-4a53-b374-37c4b548d48e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:54.889495 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323d9c0-04bd-4895-adbf-e57e64b3148c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:54.889644 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8cf22-7f91-4a53-b374-37c4b548d48e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:54.896621 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8cf22-7f91-4a53-b374-37c4b548d48e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:54.898574 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8cf22-7f91-4a53-b374-37c4b548d48e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:54.900708 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323d9c0-04bd-4895-adbf-e57e64b3148c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:54.902126 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323d9c0-04bd-4895-adbf-e57e64b3148c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:54.913348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-bfd8cf22-7f91-4a53-b374-37c4b548d48e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:54.913348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:54.913348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:54.913348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:54.913348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:54.913348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:54.913348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:54.913348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:54.913348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:54.913348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:54.913348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:54.913348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:54.913348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:31:54.913348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:31:54.913348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:31:54.915710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:31:54.915710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:54.915710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:54.915710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:54.915710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:54.915710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:54.915710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:54.915710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:54.915710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:54.915710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:54.915710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:54.915710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:54.915710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:54.915710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:54.915710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:54.915710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:54.915710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:54.918021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:31:54.918021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:31:54.918021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:31:54.918021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:31:54.918021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:31:54.918021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:31:54.918021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:54.918021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:54.923722 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 362/692] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:31:54.923940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5323d9c0-04bd-4895-adbf-e57e64b3148c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:54.923940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:54.923940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:54.923940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:54.923940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:54.923940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:54.923940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:54.923940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:54.923940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:54.923940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:54.923940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:54.923940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:54.923940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:54.923940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:54.923940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:54.925599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:54.925599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:54.925599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:54.925599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:54.925599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:54.925599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:54.925599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:54.925599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:54.925599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:54.925599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:54.925599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:54.925599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:54.925599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:54.925599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:54.925599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:54.925599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:54.925599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:54.927165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:54.927165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:54.927165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:54.927165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:54.927165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 331/693] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:31:54.927645 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8cf22-7f91-4a53-b374-37c4b548d48e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:54.927790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323d9c0-04bd-4895-adbf-e57e64b3148c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:55.027041 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323d9c0-04bd-4895-adbf-e57e64b3148c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:55.066786 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886fd53d-d4b1-4062-a76c-dbdd262b4e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:55.067450 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fd53d-d4b1-4062-a76c-dbdd262b4e52 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:55.067745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fd53d-d4b1-4062-a76c-dbdd262b4e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:55.068017 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fd53d-d4b1-4062-a76c-dbdd262b4e52 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:55.068805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886fd53d-d4b1-4062-a76c-dbdd262b4e52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:55.069108 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886fd53d-d4b1-4062-a76c-dbdd262b4e52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:55.070464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886fd53d-d4b1-4062-a76c-dbdd262b4e52 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:55.097933 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 332/694] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:55.098811 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886fd53d-d4b1-4062-a76c-dbdd262b4e52 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:55.130573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8cf22-7f91-4a53-b374-37c4b548d48e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:55.200158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4a751-b9fe-45ce-b5ce-d4a15f732191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:55.200822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4a751-b9fe-45ce-b5ce-d4a15f732191 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:55.201097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4a751-b9fe-45ce-b5ce-d4a15f732191 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:55.201363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4a751-b9fe-45ce-b5ce-d4a15f732191 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:55.202152 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4a751-b9fe-45ce-b5ce-d4a15f732191 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:55.202453 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4a751-b9fe-45ce-b5ce-d4a15f732191 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:55.204582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4a751-b9fe-45ce-b5ce-d4a15f732191 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:55.231029 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 363/695] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:31:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:55.237067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4a751-b9fe-45ce-b5ce-d4a15f732191 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:55.274918 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886fd53d-d4b1-4062-a76c-dbdd262b4e52 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:55.324704 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd7237-80aa-4910-be4f-ec3aa947099c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:55.325497 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd7237-80aa-4910-be4f-ec3aa947099c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:55.325774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd7237-80aa-4910-be4f-ec3aa947099c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:55.326039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd7237-80aa-4910-be4f-ec3aa947099c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:55.333721 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd7237-80aa-4910-be4f-ec3aa947099c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:55.335441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd7237-80aa-4910-be4f-ec3aa947099c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:55.353045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-bccd7237-80aa-4910-be4f-ec3aa947099c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 06:31:55.353045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:55.353045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:55.353045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:55.353045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:55.353045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:55.353045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:55.353045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:55.353045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:55.353045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:55.353045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:55.353045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:55.353045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:31:55.353045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:31:55.353045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:31:55.353045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:31:55.354049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:55.354049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:55.354049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:31:55.354049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:55.354049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:31:55.354049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:31:55.354049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:55.354049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:55.354049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:55.354049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:55.354049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:55.354049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:55.354049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:55.354049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:55.354049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:55.354049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:55.354049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:55.354049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:55.355007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:55.355007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:55.355007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:31:55.355007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:31:55.355007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:31:55.355007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:31:55.355007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:31:55.355007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:31:55.355007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 06:31:55.355007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:55.355007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 333/696] 10.222.0.25 () {56 vars in 1093 bytes} [Thu May 12 06:31:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:55.359762 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd7237-80aa-4910-be4f-ec3aa947099c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:55.418093 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4a751-b9fe-45ce-b5ce-d4a15f732191 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:55.452042 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d7e23-c88f-4f21-81b4-4fcfbfc593a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:55.452713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d7e23-c88f-4f21-81b4-4fcfbfc593a6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:55.453043 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d7e23-c88f-4f21-81b4-4fcfbfc593a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:55.453319 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d7e23-c88f-4f21-81b4-4fcfbfc593a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:55.454152 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d7e23-c88f-4f21-81b4-4fcfbfc593a6 None admin] RBAC: Adding query filter params (role.id=ed3e6c61b2d14364a605282f0f1488ba, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=a9882820f88349cb8fa2e3d457b19959) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:55.454463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d7e23-c88f-4f21-81b4-4fcfbfc593a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:55.455904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d7e23-c88f-4f21-81b4-4fcfbfc593a6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:55.462224 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 364/697] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:31:55 2022] GET /identity/v3/role_assignments?user.id=a9882820f88349cb8fa2e3d457b19959&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=ed3e6c61b2d14364a605282f0f1488ba => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:55.498344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd7237-80aa-4910-be4f-ec3aa947099c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:55.534352 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d620268-e117-4345-b474-dbdb2e2938af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:55.535047 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d620268-e117-4345-b474-dbdb2e2938af None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:55.535382 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d620268-e117-4345-b474-dbdb2e2938af None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:55.535658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d620268-e117-4345-b474-dbdb2e2938af None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:55.536559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d620268-e117-4345-b474-dbdb2e2938af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:55.536872 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d620268-e117-4345-b474-dbdb2e2938af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:55.538485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d620268-e117-4345-b474-dbdb2e2938af None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:55.557956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 334/698] 10.222.0.25 () {56 vars in 1133 bytes} [Thu May 12 06:31:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:55.564865 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d7e23-c88f-4f21-81b4-4fcfbfc593a6 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:55.675231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d7e23-c88f-4f21-81b4-4fcfbfc593a6 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:55.712317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f6c23-bd68-4fa5-907e-ad72175a27b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:55.712980 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f6c23-bd68-4fa5-907e-ad72175a27b5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:55.713263 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f6c23-bd68-4fa5-907e-ad72175a27b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:55.713536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f6c23-bd68-4fa5-907e-ad72175a27b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:55.784009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f6c23-bd68-4fa5-907e-ad72175a27b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:55.785532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f6c23-bd68-4fa5-907e-ad72175a27b5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:55.886441 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 365/699] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:31:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:31:55.891597 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d620268-e117-4345-b474-dbdb2e2938af None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:55.929535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c36808-b550-47a9-b9af-f507a059363d None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:55.929723 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c36808-b550-47a9-b9af-f507a059363d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:55.930007 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c36808-b550-47a9-b9af-f507a059363d None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:55.931498 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 366/700] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:31:55.936752 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd71ecb-0380-43a6-af1b-6dd297da1ed9 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:55.937279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd71ecb-0380-43a6-af1b-6dd297da1ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:55.937779 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd71ecb-0380-43a6-af1b-6dd297da1ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:55.955564 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-acd71ecb-0380-43a6-af1b-6dd297da1ed9 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:55.957117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-acd71ecb-0380-43a6-af1b-6dd297da1ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:56.007520 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d620268-e117-4345-b474-dbdb2e2938af None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:56.042331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 367/701] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:31:56.048346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bd161-aa8f-4454-892e-5b7588e7bc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:56.049141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bd161-aa8f-4454-892e-5b7588e7bc75 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:56.049420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bd161-aa8f-4454-892e-5b7588e7bc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:56.049687 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bd161-aa8f-4454-892e-5b7588e7bc75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:56.060040 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038bd161-aa8f-4454-892e-5b7588e7bc75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:56.061494 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038bd161-aa8f-4454-892e-5b7588e7bc75 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:56.072739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd71ecb-0380-43a6-af1b-6dd297da1ed9 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:56.084768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-038bd161-aa8f-4454-892e-5b7588e7bc75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:56.084768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:56.084768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:56.084768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:56.084768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:56.084768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:56.084768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:56.084768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:56.084768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:56.084768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:56.084768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:56.084768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:56.084768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:56.084768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:56.084768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:56.085730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:56.085730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:56.085730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:56.085730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:56.085730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:56.085730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:56.085730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:56.085730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:56.085730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:56.085730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:56.085730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:56.085730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:56.085730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:56.085730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:56.085730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:56.085730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:56.085730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:56.086649 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:56.086649 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:56.086649 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:56.086649 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:56.086649 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 335/702] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:56.091219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bd161-aa8f-4454-892e-5b7588e7bc75 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:56.189578 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd71ecb-0380-43a6-af1b-6dd297da1ed9 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:56.200692 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bd161-aa8f-4454-892e-5b7588e7bc75 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:56.225052 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74e608-27e9-4511-a732-aa2090281b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:56.225863 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74e608-27e9-4511-a732-aa2090281b6d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:56.226130 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74e608-27e9-4511-a732-aa2090281b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:56.226463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74e608-27e9-4511-a732-aa2090281b6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:56.235943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97bafa-c6bb-4c04-b9a4-7cbb4bbcb5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:56.236656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74e608-27e9-4511-a732-aa2090281b6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:56.237098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97bafa-c6bb-4c04-b9a4-7cbb4bbcb5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:56.237585 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97bafa-c6bb-4c04-b9a4-7cbb4bbcb5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:56.238046 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97bafa-c6bb-4c04-b9a4-7cbb4bbcb5f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:56.238149 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74e608-27e9-4511-a732-aa2090281b6d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:56.239062 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97bafa-c6bb-4c04-b9a4-7cbb4bbcb5f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:56.239572 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97bafa-c6bb-4c04-b9a4-7cbb4bbcb5f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:56.241643 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97bafa-c6bb-4c04-b9a4-7cbb4bbcb5f9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:56.254043 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 336/703] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:56.259992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97bafa-c6bb-4c04-b9a4-7cbb4bbcb5f9 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:56.372156 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97bafa-c6bb-4c04-b9a4-7cbb4bbcb5f9 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:56.378483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-7f74e608-27e9-4511-a732-aa2090281b6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:56.378483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:56.378483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:56.378483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:56.378483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:56.378483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:56.378483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:56.378483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:56.378483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:56.378483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:56.378483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:56.378483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:56.378483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:56.378483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:56.378483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:56.379391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:56.379391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:56.379391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:56.379391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:56.379391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:56.379391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:56.379391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:56.379391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:56.379391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:56.379391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:56.379391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:56.379391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:56.379391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:56.379391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:56.379391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:56.379391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:56.379391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:56.380322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:56.380322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:56.380322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:56.380322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:56.380322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 368/704] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:56.388723 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74e608-27e9-4511-a732-aa2090281b6d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:56.424956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383f382-6c95-41b1-ae03-cca4e8951e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:56.426108 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383f382-6c95-41b1-ae03-cca4e8951e89 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:56.426612 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383f382-6c95-41b1-ae03-cca4e8951e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:56.427101 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383f382-6c95-41b1-ae03-cca4e8951e89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:56.438356 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383f382-6c95-41b1-ae03-cca4e8951e89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:56.440152 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383f382-6c95-41b1-ae03-cca4e8951e89 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:56.467463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5383f382-6c95-41b1-ae03-cca4e8951e89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:56.467463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:56.467463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:56.467463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:56.467463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:56.467463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:56.467463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:56.467463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:56.467463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:56.467463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:56.467463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:56.467463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:56.467463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:31:56.467463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:31:56.467463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:31:56.468458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:31:56.468458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:56.468458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:56.468458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:56.468458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:56.468458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:56.468458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:56.468458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:56.468458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:56.468458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:56.468458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:56.468458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:56.468458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:56.468458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:56.468458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:56.468458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:56.468458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:56.469340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:31:56.469340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:31:56.469340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:31:56.469340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:31:56.469340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:31:56.469340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:31:56.469340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:31:56.469340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:56.471733 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 337/705] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:56.475594 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383f382-6c95-41b1-ae03-cca4e8951e89 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:56.500194 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74e608-27e9-4511-a732-aa2090281b6d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:56.534257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8a1d2-cdd2-4ab6-b1a5-a547b471062c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:56.534926 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8a1d2-cdd2-4ab6-b1a5-a547b471062c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:56.535205 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8a1d2-cdd2-4ab6-b1a5-a547b471062c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:56.535474 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8a1d2-cdd2-4ab6-b1a5-a547b471062c None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:56.536422 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8a1d2-cdd2-4ab6-b1a5-a547b471062c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:56.536647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8a1d2-cdd2-4ab6-b1a5-a547b471062c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:56.538057 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8a1d2-cdd2-4ab6-b1a5-a547b471062c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:56.555031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 369/706] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:56.555031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6259ea-f203-4dc5-8dd5-f59d749dd807 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:56.555031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6259ea-f203-4dc5-8dd5-f59d749dd807 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:56.555031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6259ea-f203-4dc5-8dd5-f59d749dd807 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:56.555031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 370/707] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:56.557301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6259ea-f203-4dc5-8dd5-f59d749dd807 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:56.607928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383f382-6c95-41b1-ae03-cca4e8951e89 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:56.645312 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dd6d8-22c4-432e-95e5-d4f3a4417dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:56.646358 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dd6d8-22c4-432e-95e5-d4f3a4417dfc None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:56.647411 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dd6d8-22c4-432e-95e5-d4f3a4417dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:56.647932 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dd6d8-22c4-432e-95e5-d4f3a4417dfc None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:56.648988 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7dd6d8-22c4-432e-95e5-d4f3a4417dfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:56.649500 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7dd6d8-22c4-432e-95e5-d4f3a4417dfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:56.651224 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7dd6d8-22c4-432e-95e5-d4f3a4417dfc None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:56.665107 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 338/708] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:31:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:56.665935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6259ea-f203-4dc5-8dd5-f59d749dd807 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:56.666703 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01366c1-5232-430b-84b3-dc7542bbbd63 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:56.667095 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01366c1-5232-430b-84b3-dc7542bbbd63 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:56.667472 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01366c1-5232-430b-84b3-dc7542bbbd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:56.685054 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e01366c1-5232-430b-84b3-dc7542bbbd63 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:56.686458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e01366c1-5232-430b-84b3-dc7542bbbd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:56.701448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553becf-04d3-4fbd-b33c-2789256274db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:56.702358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553becf-04d3-4fbd-b33c-2789256274db None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:56.702877 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553becf-04d3-4fbd-b33c-2789256274db None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:56.703352 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553becf-04d3-4fbd-b33c-2789256274db None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:56.704308 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553becf-04d3-4fbd-b33c-2789256274db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:56.705937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553becf-04d3-4fbd-b33c-2789256274db None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:56.761033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 339/709] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:56.761033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01366c1-5232-430b-84b3-dc7542bbbd63 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:56.819740 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 371/710] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 12 06:31:56 2022] POST /identity/v3/users => generated 254 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:31:56.820446 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553becf-04d3-4fbd-b33c-2789256274db None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:56.926303 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01366c1-5232-430b-84b3-dc7542bbbd63 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:57.018252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f232889-1f68-429f-9010-f833ec9b14e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:57.018941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f232889-1f68-429f-9010-f833ec9b14e6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:57.019225 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f232889-1f68-429f-9010-f833ec9b14e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:57.019510 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f232889-1f68-429f-9010-f833ec9b14e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:57.023268 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f232889-1f68-429f-9010-f833ec9b14e6 None admin] RBAC: Adding query filter params (role.id=5e6a73052f3b4ee7829ecb858925e5ca, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=bbcd54a927bf46f183b50fbda677868d) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:57.024430 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f232889-1f68-429f-9010-f833ec9b14e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:57.025975 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f232889-1f68-429f-9010-f833ec9b14e6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:57.033973 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 340/711] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:31:56 2022] GET /identity/v3/role_assignments?user.id=bbcd54a927bf46f183b50fbda677868d&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=5e6a73052f3b4ee7829ecb858925e5ca => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:57.054556 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553becf-04d3-4fbd-b33c-2789256274db None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:57.090841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abc659-a275-421a-bea3-9997de8ef39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:57.091654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abc659-a275-421a-bea3-9997de8ef39e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:57.091954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abc659-a275-421a-bea3-9997de8ef39e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:57.092221 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abc659-a275-421a-bea3-9997de8ef39e None admin] PATH_INFO: `/v3/services/network` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:57.092889 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abc659-a275-421a-bea3-9997de8ef39e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:57.094278 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abc659-a275-421a-bea3-9997de8ef39e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:57.109437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-c9abc659-a275-421a-bea3-9997de8ef39e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 06:31:57.109437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:57.109437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:31:57.109437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:31:57.109437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:31:57.109437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:31:57.109437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:31:57.109437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:31:57.109437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 06:31:57.109437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:57.109437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:31:57.109437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:57.109437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:57.109437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:57.109437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:57.109437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:57.109437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:57.110524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:57.110524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:57.110524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:57.110524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:57.110524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:57.110524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:57.110524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:31:57.110524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:31:57.110524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:31:57.110524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:31:57.110524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:57.110524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:57.110524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:57.110524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:57.110524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:57.110524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:57.111371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:57.111371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:57.111371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:57.111371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:57.111371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:57.111371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:57.111371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:57.111371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:57.111371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:57.111371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:57.111371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:31:57.111371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:31:57.111371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 06:31:57.111371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:57.111371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 372/712] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:31:56 2022] GET /identity/v3/services/network => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:57.118079 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f232889-1f68-429f-9010-f833ec9b14e6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:57.217704 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f9bd2-4403-4a8d-802c-bc8ba9316d34 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:57.218242 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f9bd2-4403-4a8d-802c-bc8ba9316d34 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:57.218242 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f9bd2-4403-4a8d-802c-bc8ba9316d34 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:57.219800 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 373/713] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:31:57.229105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c34c23-8ccc-45b8-af29-898f3b9b11a5 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:57.229105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c34c23-8ccc-45b8-af29-898f3b9b11a5 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:57.229105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c34c23-8ccc-45b8-af29-898f3b9b11a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:57.229458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f232889-1f68-429f-9010-f833ec9b14e6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:57.248310 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-45c34c23-8ccc-45b8-af29-898f3b9b11a5 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:57.249868 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-45c34c23-8ccc-45b8-af29-898f3b9b11a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:57.269717 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca12b2c-d190-447a-b68a-dbbd68512425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:57.270444 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca12b2c-d190-447a-b68a-dbbd68512425 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:57.270721 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca12b2c-d190-447a-b68a-dbbd68512425 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:57.271046 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca12b2c-d190-447a-b68a-dbbd68512425 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:57.272361 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca12b2c-d190-447a-b68a-dbbd68512425 None admin] RBAC: Adding query filter params (name=network) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:57.272670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca12b2c-d190-447a-b68a-dbbd68512425 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:57.274106 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca12b2c-d190-447a-b68a-dbbd68512425 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:57.279426 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 341/714] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 12 06:31:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:57.284891 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca12b2c-d190-447a-b68a-dbbd68512425 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:57.339368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 374/715] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:57.366393 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c34c23-8ccc-45b8-af29-898f3b9b11a5 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:57.408650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca12b2c-d190-447a-b68a-dbbd68512425 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:57.442821 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162a032-f590-433d-a679-73f0fb217676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:57.444030 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162a032-f590-433d-a679-73f0fb217676 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:57.444315 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162a032-f590-433d-a679-73f0fb217676 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:57.444586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162a032-f590-433d-a679-73f0fb217676 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:57.445290 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162a032-f590-433d-a679-73f0fb217676 None admin] RBAC: Adding query filter params (type=network) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:57.445588 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162a032-f590-433d-a679-73f0fb217676 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:57.446953 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162a032-f590-433d-a679-73f0fb217676 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:57.453059 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 342/716] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 12 06:31:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:31:57.494067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c34c23-8ccc-45b8-af29-898f3b9b11a5 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:57.549511 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c14850-183b-42c5-93aa-53b48b7bfff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:57.550249 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c14850-183b-42c5-93aa-53b48b7bfff5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:57.550524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c14850-183b-42c5-93aa-53b48b7bfff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:57.550790 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c14850-183b-42c5-93aa-53b48b7bfff5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:57.551449 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c14850-183b-42c5-93aa-53b48b7bfff5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:57.552863 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c14850-183b-42c5-93aa-53b48b7bfff5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:57.571169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-62c14850-183b-42c5-93aa-53b48b7bfff5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 06:31:57.571169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:57.571169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:31:57.571169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:31:57.571169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:31:57.571169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:31:57.571169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:31:57.571169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:31:57.571169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 06:31:57.571169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:57.571169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:31:57.571169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:57.571169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:57.571169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:57.571169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:57.571169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:57.572261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:57.572261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:57.572261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:57.572261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:57.572261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:57.572261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:57.572261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:57.572261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:31:57.572261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:31:57.572261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:31:57.572261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:31:57.572261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:57.572261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:57.572261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:57.572261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:57.572261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:57.573136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:57.573136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:57.573136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:31:57.573136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:57.573136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:57.573136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:57.573136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:57.573136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:57.573136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:57.573136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:57.573136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:57.573136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:31:57.573136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:31:57.573136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 06:31:57.573136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:31:57.573136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 375/717] 10.222.0.25 () {56 vars in 1129 bytes} [Thu May 12 06:31:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:57.580580 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162a032-f590-433d-a679-73f0fb217676 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:57.709843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162a032-f590-433d-a679-73f0fb217676 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:57.743452 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364d338-1cae-4d13-9cb8-8b512ba35681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:57.744199 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364d338-1cae-4d13-9cb8-8b512ba35681 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:57.744481 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364d338-1cae-4d13-9cb8-8b512ba35681 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:57.744748 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364d338-1cae-4d13-9cb8-8b512ba35681 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:57.745507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364d338-1cae-4d13-9cb8-8b512ba35681 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:57.745813 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364d338-1cae-4d13-9cb8-8b512ba35681 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:57.747184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364d338-1cae-4d13-9cb8-8b512ba35681 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:57.751968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 343/718] 10.222.0.25 () {56 vars in 1124 bytes} [Thu May 12 06:31:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:57.757915 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c14850-183b-42c5-93aa-53b48b7bfff5 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:57.866532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c14850-183b-42c5-93aa-53b48b7bfff5 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:57.911279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d325f-28d2-4837-9d9d-5befb7c7a9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:57.912481 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d325f-28d2-4837-9d9d-5befb7c7a9ad None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:57.913000 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d325f-28d2-4837-9d9d-5befb7c7a9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:57.913521 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d325f-28d2-4837-9d9d-5befb7c7a9ad None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:57.914706 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d325f-28d2-4837-9d9d-5befb7c7a9ad None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:57.915224 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d325f-28d2-4837-9d9d-5befb7c7a9ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:57.916915 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d325f-28d2-4837-9d9d-5befb7c7a9ad None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:57.928327 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 376/719] 10.222.0.25 () {56 vars in 1124 bytes} [Thu May 12 06:31:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:58.559491 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfbabc-544a-4fba-a9ad-24d2ab0d17cf None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:58.560566 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfbabc-544a-4fba-a9ad-24d2ab0d17cf None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:58.562481 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfbabc-544a-4fba-a9ad-24d2ab0d17cf None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:58.564637 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 344/720] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:58.570550 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be21243-5bae-4376-8b08-76fd7c00cddd None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:58.571445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be21243-5bae-4376-8b08-76fd7c00cddd None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:58.572005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be21243-5bae-4376-8b08-76fd7c00cddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:58.591711 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-9be21243-5bae-4376-8b08-76fd7c00cddd None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:58.591928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9be21243-5bae-4376-8b08-76fd7c00cddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:58.685549 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 377/721] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:31:58.724651 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfbabc-544a-4fba-a9ad-24d2ab0d17cf None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:58.869428 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfbabc-544a-4fba-a9ad-24d2ab0d17cf None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:58.911066 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5317e8-8890-41bf-af8e-212e4f34a95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:58.911882 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5317e8-8890-41bf-af8e-212e4f34a95a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:58.912671 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5317e8-8890-41bf-af8e-212e4f34a95a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:58.912944 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5317e8-8890-41bf-af8e-212e4f34a95a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:58.928982 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5317e8-8890-41bf-af8e-212e4f34a95a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:31:58.936570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-1d5317e8-8890-41bf-af8e-212e4f34a95a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:31:58.936570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:58.936570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:58.936570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:58.936570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:58.936570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:58.936570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:58.936570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:58.936570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:58.936570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:58.936570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:58.936570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:58.936570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:31:58.936570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:31:58.936570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:31:58.936570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:31:58.937541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:31:58.937541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:31:58.937541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:31:58.937541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:31:58.937541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:58.937541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:58.937541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:58.937541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:58.937541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:58.937541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:58.937541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:58.937541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:58.937541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:58.937541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:58.937541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:58.937541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:58.938484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:58.938484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:58.938484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:58.938484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:58.938484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:31:58.938484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:31:58.938484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:31:58.938484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:31:58.938484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:31:58.938484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:31:58.938484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:31:58.938484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:58.942439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 345/722] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:31:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:58.944763 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be21243-5bae-4376-8b08-76fd7c00cddd None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:59.248017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be21243-5bae-4376-8b08-76fd7c00cddd None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:59.294811 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d716ece-17d2-4671-b089-5a0548df40cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:59.295920 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d716ece-17d2-4671-b089-5a0548df40cf None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:59.296426 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d716ece-17d2-4671-b089-5a0548df40cf None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:59.296911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d716ece-17d2-4671-b089-5a0548df40cf None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:59.297877 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d716ece-17d2-4671-b089-5a0548df40cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:59.298414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d716ece-17d2-4671-b089-5a0548df40cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:59.300070 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d716ece-17d2-4671-b089-5a0548df40cf None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:59.311090 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 378/723] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:31:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:59.316220 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5317e8-8890-41bf-af8e-212e4f34a95a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:59.429264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5317e8-8890-41bf-af8e-212e4f34a95a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:59.467179 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb9c9c-c8be-4d06-9efa-04e1b2713f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:59.468000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb9c9c-c8be-4d06-9efa-04e1b2713f20 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:59.468279 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb9c9c-c8be-4d06-9efa-04e1b2713f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:59.468548 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb9c9c-c8be-4d06-9efa-04e1b2713f20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:59.479324 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb9c9c-c8be-4d06-9efa-04e1b2713f20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:59.480804 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb9c9c-c8be-4d06-9efa-04e1b2713f20 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:59.505292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-75fb9c9c-c8be-4d06-9efa-04e1b2713f20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:59.505292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:31:59.505292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:31:59.505292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:31:59.505292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:31:59.505292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:31:59.505292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:31:59.505292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:31:59.505292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:31:59.505292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:31:59.505292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:31:59.505292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:31:59.505292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:31:59.505292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:31:59.505292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:31:59.506281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:31:59.506281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:31:59.506281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:31:59.506281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:31:59.506281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:31:59.506281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:31:59.506281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:31:59.506281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:31:59.506281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:31:59.506281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:31:59.506281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:31:59.506281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:31:59.506281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:31:59.506281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:31:59.506281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:31:59.506281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:31:59.506281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:31:59.507222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:31:59.507222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:31:59.507222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:31:59.507222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:31:59.507222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 346/724] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:31:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:31:59.512125 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d716ece-17d2-4671-b089-5a0548df40cf None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:59.576076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7a5fb-7f01-4967-a876-632bda411834 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:59.576586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7a5fb-7f01-4967-a876-632bda411834 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:59.576691 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7a5fb-7f01-4967-a876-632bda411834 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:59.577968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 347/725] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:31:59.583217 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d0a72-560e-4ece-a293-18e099737052 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:59.583511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d0a72-560e-4ece-a293-18e099737052 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:59.583822 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d0a72-560e-4ece-a293-18e099737052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:59.601147 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1b0d0a72-560e-4ece-a293-18e099737052 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:31:59.602329 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1b0d0a72-560e-4ece-a293-18e099737052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:31:59.694124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d716ece-17d2-4671-b089-5a0548df40cf None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:59.721154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 348/726] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:31:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 06:31:59.743721 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d0a72-560e-4ece-a293-18e099737052 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:59.751178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00642e-5a50-49fe-a676-8e54db193856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:59.751897 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00642e-5a50-49fe-a676-8e54db193856 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:59.752179 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00642e-5a50-49fe-a676-8e54db193856 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:59.752450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00642e-5a50-49fe-a676-8e54db193856 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:59.758636 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00642e-5a50-49fe-a676-8e54db193856 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:31:59.758921 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00642e-5a50-49fe-a676-8e54db193856 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:59.762193 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00642e-5a50-49fe-a676-8e54db193856 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:59.783655 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 379/727] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:31:59.791896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00642e-5a50-49fe-a676-8e54db193856 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:31:59.943844 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00642e-5a50-49fe-a676-8e54db193856 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:59.946777 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d0a72-560e-4ece-a293-18e099737052 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:31:59.977907 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f5538-08d8-4aec-9075-7da2aa1058f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:59.978707 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f5538-08d8-4aec-9075-7da2aa1058f3 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:59.978989 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f5538-08d8-4aec-9075-7da2aa1058f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:59.979266 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f5538-08d8-4aec-9075-7da2aa1058f3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:31:59.987188 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f5538-08d8-4aec-9075-7da2aa1058f3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:31:59.989924 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f5538-08d8-4aec-9075-7da2aa1058f3 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:31:59.998400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f7199-64d5-4fca-85f3-fd662fe470e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:31:59.999195 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f7199-64d5-4fca-85f3-fd662fe470e7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:31:59.999474 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f7199-64d5-4fca-85f3-fd662fe470e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:31:59.999788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f7199-64d5-4fca-85f3-fd662fe470e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:00.004960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-fa2f5538-08d8-4aec-9075-7da2aa1058f3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 06:32:00.004960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:00.004960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:00.004960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:00.004960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:00.004960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:00.004960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:00.004960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:00.004960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:00.004960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:00.004960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:00.004960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:00.004960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:32:00.004960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:32:00.004960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:32:00.004960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:32:00.006458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:00.006458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:00.006458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:32:00.006458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:00.006458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:32:00.006458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:00.006458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:00.006458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:00.006458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:00.006458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:00.006458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:00.006458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:00.006458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:00.006458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:00.006458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:00.006458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:00.006458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:00.006458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:00.007445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:00.007445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:00.007445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:32:00.007445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:32:00.007445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:32:00.007445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:32:00.007445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:32:00.007445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:32:00.007445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 06:32:00.007445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:00.007445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 380/728] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:31:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:00.011142 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f7199-64d5-4fca-85f3-fd662fe470e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:32:00.013021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e90fb-f8ea-4e8e-8981-7440ac908d2a None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:00.013315 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e90fb-f8ea-4e8e-8981-7440ac908d2a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:00.013656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e90fb-f8ea-4e8e-8981-7440ac908d2a None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:00.015244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 381/729] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:00.016003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e90fb-f8ea-4e8e-8981-7440ac908d2a None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:00.023212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-843f7199-64d5-4fca-85f3-fd662fe470e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:32:00.023212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:00.023212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:00.023212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:00.023212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:00.023212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:00.023212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:00.023212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:00.023212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:00.023212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:00.023212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:00.023212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:00.023212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:32:00.023212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:32:00.023212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:32:00.023212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:32:00.025282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:32:00.025282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:32:00.025282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:32:00.025282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:32:00.025282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:00.025282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:00.025282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:00.025282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:00.025282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:00.025282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:00.025282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:00.025282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:00.025282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:00.025282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:00.025282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:00.025282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:00.027464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:00.027464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:00.027464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:00.027464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:00.027464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:32:00.027464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:32:00.027464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:32:00.027464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:32:00.027464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:32:00.027464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:32:00.027464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:32:00.027464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:00.027464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 349/730] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:31:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:00.027464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45c4b4-888f-4b6c-88c5-0ad1c68f7a7c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:00.028817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45c4b4-888f-4b6c-88c5-0ad1c68f7a7c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:00.028817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45c4b4-888f-4b6c-88c5-0ad1c68f7a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:00.044475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-cb45c4b4-888f-4b6c-88c5-0ad1c68f7a7c None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:00.045794 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cb45c4b4-888f-4b6c-88c5-0ad1c68f7a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:00.119813 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 350/731] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:32:00.120871 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45c4b4-888f-4b6c-88c5-0ad1c68f7a7c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:00.121362 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e90fb-f8ea-4e8e-8981-7440ac908d2a None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:00.155902 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1574c-22c0-4609-9d89-734de7172c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:00.156636 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1574c-22c0-4609-9d89-734de7172c4e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:00.156917 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1574c-22c0-4609-9d89-734de7172c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:00.157189 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1574c-22c0-4609-9d89-734de7172c4e None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:00.158035 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1574c-22c0-4609-9d89-734de7172c4e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:00.158344 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1574c-22c0-4609-9d89-734de7172c4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:00.159870 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1574c-22c0-4609-9d89-734de7172c4e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:00.179020 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 382/732] 10.222.0.25 () {56 vars in 1135 bytes} [Thu May 12 06:32:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:00.184210 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1574c-22c0-4609-9d89-734de7172c4e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:00.241464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45c4b4-888f-4b6c-88c5-0ad1c68f7a7c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:00.276159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ad39e-d311-4636-a280-18986819101d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:00.276751 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ad39e-d311-4636-a280-18986819101d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:00.277036 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ad39e-d311-4636-a280-18986819101d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:00.277308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ad39e-d311-4636-a280-18986819101d None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:00.278060 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ad39e-d311-4636-a280-18986819101d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:00.278363 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ad39e-d311-4636-a280-18986819101d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:00.279751 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ad39e-d311-4636-a280-18986819101d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:00.286893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1574c-22c0-4609-9d89-734de7172c4e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:00.288471 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 351/733] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:32:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:00.289653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ad39e-d311-4636-a280-18986819101d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:00.321972 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3df85-cb24-49da-8e50-715e307ccfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:00.322782 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3df85-cb24-49da-8e50-715e307ccfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:00.323063 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3df85-cb24-49da-8e50-715e307ccfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:00.323337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3df85-cb24-49da-8e50-715e307ccfd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:00.333865 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3df85-cb24-49da-8e50-715e307ccfd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:32:00.342445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-d3a3df85-cb24-49da-8e50-715e307ccfd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 06:32:00.342445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:00.342445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:00.342445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:00.342445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:00.342445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:00.342445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:00.342445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:00.342445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:00.342445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:00.342445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:00.342445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:00.342445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:32:00.342445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:32:00.342445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:32:00.342445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:32:00.344858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:32:00.344858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:32:00.344858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:32:00.344858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:32:00.344858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:00.344858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:00.344858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:00.344858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:00.344858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:00.344858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:00.344858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:00.344858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:00.344858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:00.344858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:00.344858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:00.344858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:00.347065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:00.347065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:00.347065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:00.347065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:00.347065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:32:00.347065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:32:00.347065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:32:00.347065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:32:00.347065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:32:00.347065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:32:00.347065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 06:32:00.347065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:00.347065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 383/734] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:32:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:00.347065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3df85-cb24-49da-8e50-715e307ccfd6 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:00.451066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3df85-cb24-49da-8e50-715e307ccfd6 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:00.485423 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1229b0f-f21f-4d12-901f-18e39731713c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:00.486227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1229b0f-f21f-4d12-901f-18e39731713c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:00.486510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1229b0f-f21f-4d12-901f-18e39731713c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:00.486783 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1229b0f-f21f-4d12-901f-18e39731713c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:00.498065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1229b0f-f21f-4d12-901f-18e39731713c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:00.499544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1229b0f-f21f-4d12-901f-18e39731713c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:00.517123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ad39e-d311-4636-a280-18986819101d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:00.518199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-b1229b0f-f21f-4d12-901f-18e39731713c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:00.518199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:00.518199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:00.518199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:00.518199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:00.518199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:00.518199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:00.518199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:00.518199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:00.518199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:00.518199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:00.518199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:00.518199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:00.518199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:00.518199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:00.519059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:00.519059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:00.519059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:00.519059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:00.519059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:00.519059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:00.519059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:00.519059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:00.519059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:00.519059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:00.519059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:00.519059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:00.519059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:00.519059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:00.519059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:00.519059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:00.519059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:00.520014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:00.520014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:00.520014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:00.520014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:00.520014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 384/735] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:00.520307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1229b0f-f21f-4d12-901f-18e39731713c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:00.557948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765525c9-253e-4349-9bff-f983ffd14553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:00.558518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765525c9-253e-4349-9bff-f983ffd14553 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:00.558795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765525c9-253e-4349-9bff-f983ffd14553 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:00.559946 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765525c9-253e-4349-9bff-f983ffd14553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:00.625084 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765525c9-253e-4349-9bff-f983ffd14553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:00.626325 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1229b0f-f21f-4d12-901f-18e39731713c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:00.626526 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765525c9-253e-4349-9bff-f983ffd14553 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:00.658860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dceb2c3-23ad-415d-8c9d-7e22671a0cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:00.659536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dceb2c3-23ad-415d-8c9d-7e22671a0cbd None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:00.659850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dceb2c3-23ad-415d-8c9d-7e22671a0cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:00.660128 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dceb2c3-23ad-415d-8c9d-7e22671a0cbd None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:00.660876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dceb2c3-23ad-415d-8c9d-7e22671a0cbd None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:00.661181 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dceb2c3-23ad-415d-8c9d-7e22671a0cbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:00.663059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dceb2c3-23ad-415d-8c9d-7e22671a0cbd None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:00.671772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 385/736] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 12 06:32:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:00.677018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640470c-3718-43e3-a227-84cf86a72338 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:00.677305 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640470c-3718-43e3-a227-84cf86a72338 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:00.677585 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640470c-3718-43e3-a227-84cf86a72338 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:00.679855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 386/737] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:00.680216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640470c-3718-43e3-a227-84cf86a72338 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:00.729726 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 352/738] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:32:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 06:32:00.730567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765525c9-253e-4349-9bff-f983ffd14553 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:00.777076 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640470c-3718-43e3-a227-84cf86a72338 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:00.808744 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb119e-a803-463f-a776-650c70742d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:00.809332 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb119e-a803-463f-a776-650c70742d29 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:00.809610 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb119e-a803-463f-a776-650c70742d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:00.809881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb119e-a803-463f-a776-650c70742d29 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:00.810591 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb119e-a803-463f-a776-650c70742d29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:00.810892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb119e-a803-463f-a776-650c70742d29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:00.812264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb119e-a803-463f-a776-650c70742d29 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:00.824638 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765525c9-253e-4349-9bff-f983ffd14553 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:00.825961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 387/739] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:00.827737 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3c0c8-2f4e-4681-b016-a7d9a73d5074 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:00.827737 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3c0c8-2f4e-4681-b016-a7d9a73d5074 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:00.827737 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3c0c8-2f4e-4681-b016-a7d9a73d5074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:00.843220 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-59f3c0c8-2f4e-4681-b016-a7d9a73d5074 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:00.844414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-59f3c0c8-2f4e-4681-b016-a7d9a73d5074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:00.859391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c98137-b2fa-4da2-8568-095117db2364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:00.860320 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c98137-b2fa-4da2-8568-095117db2364 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:00.860603 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c98137-b2fa-4da2-8568-095117db2364 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:00.860868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c98137-b2fa-4da2-8568-095117db2364 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:00.870592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c98137-b2fa-4da2-8568-095117db2364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:00.872044 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c98137-b2fa-4da2-8568-095117db2364 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:00.888679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-04c98137-b2fa-4da2-8568-095117db2364 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:00.888679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:00.888679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:00.888679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:00.888679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:00.888679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:00.888679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:00.888679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:00.888679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:00.888679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:00.888679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:00.888679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:00.888679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:00.888679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:00.888679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:00.889712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:00.889712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:00.889712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:00.889712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:00.889712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:00.889712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:00.889712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:00.889712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:00.889712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:00.889712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:00.889712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:00.889712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:00.889712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:00.889712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:00.889712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:00.889712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:00.889712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:00.890653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:00.890653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:00.890653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:00.890653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:00.890653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 353/740] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:00.891113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fa5cc-a7a6-458c-b914-440116dbf48c None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:00.891373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fa5cc-a7a6-458c-b914-440116dbf48c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:00.891605 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fa5cc-a7a6-458c-b914-440116dbf48c None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:00.892876 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 354/741] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:00.893568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fa5cc-a7a6-458c-b914-440116dbf48c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:00.916113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 388/742] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:32:00.917060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3c0c8-2f4e-4681-b016-a7d9a73d5074 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:00.994893 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fa5cc-a7a6-458c-b914-440116dbf48c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:01.021062 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3c0c8-2f4e-4681-b016-a7d9a73d5074 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:01.027328 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff9539-9306-43bd-98b0-b65a362d474b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:01.028148 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff9539-9306-43bd-98b0-b65a362d474b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:01.028423 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff9539-9306-43bd-98b0-b65a362d474b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:01.028691 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff9539-9306-43bd-98b0-b65a362d474b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:01.039185 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff9539-9306-43bd-98b0-b65a362d474b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:01.040931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff9539-9306-43bd-98b0-b65a362d474b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:01.054553 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ec8bf-5b02-438b-aa55-1fc7a159af45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:01.055337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ec8bf-5b02-438b-aa55-1fc7a159af45 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:01.055612 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ec8bf-5b02-438b-aa55-1fc7a159af45 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:01.055910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ec8bf-5b02-438b-aa55-1fc7a159af45 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:01.059222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-39ff9539-9306-43bd-98b0-b65a362d474b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:01.059222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:01.059222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:01.059222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:01.059222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:01.059222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:01.059222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:01.059222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:01.059222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:01.059222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:01.059222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:01.059222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:01.059222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:01.059222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:01.059222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:01.060295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:01.060295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:01.060295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:01.060295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:01.060295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:01.060295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:01.060295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:01.060295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:01.060295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:01.060295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:01.060295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:01.060295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:01.060295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:01.060295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:01.060295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:01.060295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:01.060295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:01.061642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:01.061642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:01.061642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:01.061642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:01.061642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 355/743] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:01.061642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff9539-9306-43bd-98b0-b65a362d474b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:01.067747 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ec8bf-5b02-438b-aa55-1fc7a159af45 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:01.069259 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ec8bf-5b02-438b-aa55-1fc7a159af45 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:01.083290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-d41ec8bf-5b02-438b-aa55-1fc7a159af45 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 06:32:01.083290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:01.083290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:01.083290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:01.083290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:01.083290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:01.083290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:01.083290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:01.083290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:01.083290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:01.083290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:01.083290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:01.083290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:32:01.083290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:32:01.083290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:32:01.083290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:32:01.084948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:01.084948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:01.084948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:32:01.084948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:01.084948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:32:01.084948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:01.084948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:01.084948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:01.084948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:01.084948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:01.084948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:01.084948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:01.084948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:01.084948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:01.084948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:01.084948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:01.084948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:01.084948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:01.086285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:01.086285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:01.086285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:32:01.086285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:32:01.086285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:32:01.086285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:32:01.086285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:32:01.086285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:32:01.086285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 06:32:01.086285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:01.086285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 389/744] 10.222.0.25 () {56 vars in 1093 bytes} [Thu May 12 06:32:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:01.087019 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a84d8-7a43-4a7b-9dfa-a61f31b44b62 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:01.087019 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a84d8-7a43-4a7b-9dfa-a61f31b44b62 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:01.087019 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a84d8-7a43-4a7b-9dfa-a61f31b44b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:01.107380 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-eb9a84d8-7a43-4a7b-9dfa-a61f31b44b62 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:01.108581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-eb9a84d8-7a43-4a7b-9dfa-a61f31b44b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:01.161367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff9539-9306-43bd-98b0-b65a362d474b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:01.169729 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 390/745] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 06:32:01.170519 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a84d8-7a43-4a7b-9dfa-a61f31b44b62 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:01.194713 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df940a-6450-4ffb-b938-71d2d8e7338c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:01.195461 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df940a-6450-4ffb-b938-71d2d8e7338c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:01.195838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df940a-6450-4ffb-b938-71d2d8e7338c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:01.196108 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df940a-6450-4ffb-b938-71d2d8e7338c None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:01.196826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df940a-6450-4ffb-b938-71d2d8e7338c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:01.197128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df940a-6450-4ffb-b938-71d2d8e7338c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:01.198470 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df940a-6450-4ffb-b938-71d2d8e7338c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:01.209618 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 356/746] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:01.210394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df940a-6450-4ffb-b938-71d2d8e7338c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:01.263974 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a84d8-7a43-4a7b-9dfa-a61f31b44b62 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:01.295549 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58cc07-7580-415a-a9b8-285865ed830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:01.296235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58cc07-7580-415a-a9b8-285865ed830c None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:01.296514 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58cc07-7580-415a-a9b8-285865ed830c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:01.296785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58cc07-7580-415a-a9b8-285865ed830c None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:01.297536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58cc07-7580-415a-a9b8-285865ed830c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:01.298878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58cc07-7580-415a-a9b8-285865ed830c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:01.302653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df940a-6450-4ffb-b938-71d2d8e7338c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:01.336117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f52cfb-b500-4685-be82-1a3f98e6d498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:01.336707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f52cfb-b500-4685-be82-1a3f98e6d498 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:01.336985 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f52cfb-b500-4685-be82-1a3f98e6d498 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:01.337257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f52cfb-b500-4685-be82-1a3f98e6d498 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:01.337968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f52cfb-b500-4685-be82-1a3f98e6d498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:01.338270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f52cfb-b500-4685-be82-1a3f98e6d498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:01.339716 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f52cfb-b500-4685-be82-1a3f98e6d498 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:01.350262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 357/747] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:01.351041 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f52cfb-b500-4685-be82-1a3f98e6d498 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:01.403710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 391/748] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 12 06:32:01 2022] POST /identity/v3/services => generated 240 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:32:01.404530 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58cc07-7580-415a-a9b8-285865ed830c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:01.454597 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f52cfb-b500-4685-be82-1a3f98e6d498 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:01.497732 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2847b5-e504-4077-9150-f7fd1e0b1178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:01.498416 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2847b5-e504-4077-9150-f7fd1e0b1178 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:01.498692 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2847b5-e504-4077-9150-f7fd1e0b1178 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:01.498961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2847b5-e504-4077-9150-f7fd1e0b1178 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:01.499846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2847b5-e504-4077-9150-f7fd1e0b1178 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:01.500153 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2847b5-e504-4077-9150-f7fd1e0b1178 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:01.501611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2847b5-e504-4077-9150-f7fd1e0b1178 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:01.516041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58cc07-7580-415a-a9b8-285865ed830c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:01.524803 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 358/749] 10.222.0.25 () {56 vars in 1133 bytes} [Thu May 12 06:32:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:01.524803 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2847b5-e504-4077-9150-f7fd1e0b1178 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:01.554174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca8a46-7884-440b-9471-761a686ba1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:01.554852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca8a46-7884-440b-9471-761a686ba1d1 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:01.555127 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca8a46-7884-440b-9471-761a686ba1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:01.555400 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca8a46-7884-440b-9471-761a686ba1d1 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:01.556176 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca8a46-7884-440b-9471-761a686ba1d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:01.557545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca8a46-7884-440b-9471-761a686ba1d1 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:01.623873 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2847b5-e504-4077-9150-f7fd1e0b1178 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:01.626400 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 392/750] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 12 06:32:01 2022] POST /identity/v3/services => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:32:01.628156 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca8a46-7884-440b-9471-761a686ba1d1 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:01.673389 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce460f9-870d-4c58-a194-18e05ff30935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:01.673389 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce460f9-870d-4c58-a194-18e05ff30935 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:01.673389 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce460f9-870d-4c58-a194-18e05ff30935 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:01.673389 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce460f9-870d-4c58-a194-18e05ff30935 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:01.679393 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce460f9-870d-4c58-a194-18e05ff30935 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:01.681015 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce460f9-870d-4c58-a194-18e05ff30935 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:01.697857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-7ce460f9-870d-4c58-a194-18e05ff30935 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 06:32:01.697857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:01.697857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:01.697857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:01.697857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:01.697857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:01.697857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:01.697857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:01.697857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:01.697857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:01.697857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:01.697857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:01.697857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:32:01.697857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:32:01.697857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:32:01.697857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:32:01.698862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:01.698862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:01.698862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:32:01.698862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:01.698862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:32:01.698862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:01.698862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:01.698862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:01.698862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:01.698862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:01.698862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:01.698862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:01.698862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:01.698862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:01.698862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:01.698862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:01.698862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:01.698862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:01.699856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:01.699856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:01.699856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:32:01.699856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:32:01.699856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:32:01.699856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:32:01.699856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:32:01.699856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:32:01.699856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 06:32:01.699856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:01.699856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 359/751] 10.222.0.25 () {56 vars in 1117 bytes} [Thu May 12 06:32:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:01.701002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce460f9-870d-4c58-a194-18e05ff30935 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:01.741818 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca8a46-7884-440b-9471-761a686ba1d1 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:01.777775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28725c-69d1-4ccf-b83d-de70daa81456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:01.778598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28725c-69d1-4ccf-b83d-de70daa81456 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:01.778877 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28725c-69d1-4ccf-b83d-de70daa81456 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:01.779164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28725c-69d1-4ccf-b83d-de70daa81456 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:01.786775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28725c-69d1-4ccf-b83d-de70daa81456 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:01.788857 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28725c-69d1-4ccf-b83d-de70daa81456 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:01.804776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-7a28725c-69d1-4ccf-b83d-de70daa81456 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:01.804776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:01.804776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:01.804776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:01.804776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:01.804776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:01.804776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:01.804776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:01.804776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:01.804776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:01.804776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:01.804776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:01.804776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:32:01.804776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:32:01.804776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:32:01.806872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:32:01.806872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:01.806872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:01.806872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:01.806872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:01.806872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:01.806872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:01.806872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:01.806872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:01.806872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:01.806872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:01.806872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:01.806872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:01.806872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:01.806872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:01.806872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:01.806872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:01.809363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:32:01.809363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:32:01.809363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:32:01.809363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:32:01.809363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:32:01.809363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:32:01.809363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:01.809363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:01.812219 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 393/752] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:32:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:01.812422 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce460f9-870d-4c58-a194-18e05ff30935 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:01.812995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28725c-69d1-4ccf-b83d-de70daa81456 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:01.848477 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a0fe0-fd80-45ba-9438-597828b9099f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:01.848826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a0fe0-fd80-45ba-9438-597828b9099f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:01.848983 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a0fe0-fd80-45ba-9438-597828b9099f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:01.850327 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a0fe0-fd80-45ba-9438-597828b9099f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:01.869995 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a0fe0-fd80-45ba-9438-597828b9099f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:01.871761 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a0fe0-fd80-45ba-9438-597828b9099f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:01.892344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-ee3a0fe0-fd80-45ba-9438-597828b9099f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:01.892344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:01.892344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:01.892344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:01.892344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:01.892344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:01.892344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:01.892344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:01.892344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:01.892344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:01.892344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:01.892344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:01.892344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:01.892344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:01.892344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:01.893288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:01.893288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:01.893288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:01.893288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:01.893288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:01.893288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:01.893288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:01.893288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:01.893288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:01.893288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:01.893288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:01.893288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:01.893288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:01.893288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:01.893288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:01.893288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:01.893288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:01.894275 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:01.894275 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:01.894275 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:01.894275 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:01.894275 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 360/753] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:01.894605 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a0fe0-fd80-45ba-9438-597828b9099f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:01.930958 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28725c-69d1-4ccf-b83d-de70daa81456 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:01.974232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce9702-ad47-4b05-a266-a568b27115c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:01.975464 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce9702-ad47-4b05-a266-a568b27115c7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:01.975930 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce9702-ad47-4b05-a266-a568b27115c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:01.976206 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce9702-ad47-4b05-a266-a568b27115c7 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:01.977864 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce9702-ad47-4b05-a266-a568b27115c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:01.978175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce9702-ad47-4b05-a266-a568b27115c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:01.979872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce9702-ad47-4b05-a266-a568b27115c7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:02.004616 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 394/754] 10.222.0.25 () {56 vars in 1149 bytes} [Thu May 12 06:32:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:02.005597 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce9702-ad47-4b05-a266-a568b27115c7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:02.022727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a0fe0-fd80-45ba-9438-597828b9099f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:02.065422 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff78c19-3d44-4347-8b4b-f6d776b7f9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:02.067025 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff78c19-3d44-4347-8b4b-f6d776b7f9eb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:02.067530 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff78c19-3d44-4347-8b4b-f6d776b7f9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:02.068023 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff78c19-3d44-4347-8b4b-f6d776b7f9eb None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:02.069530 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff78c19-3d44-4347-8b4b-f6d776b7f9eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:02.070159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff78c19-3d44-4347-8b4b-f6d776b7f9eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:02.072572 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff78c19-3d44-4347-8b4b-f6d776b7f9eb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:02.088319 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 361/755] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:32:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:02.089577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff78c19-3d44-4347-8b4b-f6d776b7f9eb None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:02.105449 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce9702-ad47-4b05-a266-a568b27115c7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:02.139520 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831c3cf-4bb2-47ca-a53e-1d10633856dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:02.140352 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831c3cf-4bb2-47ca-a53e-1d10633856dd None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:02.140743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831c3cf-4bb2-47ca-a53e-1d10633856dd None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:02.141089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831c3cf-4bb2-47ca-a53e-1d10633856dd None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:02.142031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831c3cf-4bb2-47ca-a53e-1d10633856dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:02.142329 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831c3cf-4bb2-47ca-a53e-1d10633856dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:02.143837 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831c3cf-4bb2-47ca-a53e-1d10633856dd None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:02.159539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 395/756] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:02.159539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831c3cf-4bb2-47ca-a53e-1d10633856dd None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:02.222951 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff78c19-3d44-4347-8b4b-f6d776b7f9eb None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:02.261314 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831c3cf-4bb2-47ca-a53e-1d10633856dd None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:02.266755 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205edaf-85d9-4514-976d-fcd8513f17f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:02.267654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205edaf-85d9-4514-976d-fcd8513f17f5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:02.268143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205edaf-85d9-4514-976d-fcd8513f17f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:02.268589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205edaf-85d9-4514-976d-fcd8513f17f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:02.297341 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e2d49-1282-43ce-95af-a5ccedea3d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:02.298117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e2d49-1282-43ce-95af-a5ccedea3d81 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:02.298465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e2d49-1282-43ce-95af-a5ccedea3d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:02.298808 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e2d49-1282-43ce-95af-a5ccedea3d81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:02.299733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e2d49-1282-43ce-95af-a5ccedea3d81 None admin] RBAC: Adding query filter params (role.id=5e6a73052f3b4ee7829ecb858925e5ca, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=a9882820f88349cb8fa2e3d457b19959) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:02.300119 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e2d49-1282-43ce-95af-a5ccedea3d81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:02.301591 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e2d49-1282-43ce-95af-a5ccedea3d81 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:02.307952 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 396/757] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:32:02 2022] GET /identity/v3/role_assignments?user.id=a9882820f88349cb8fa2e3d457b19959&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=5e6a73052f3b4ee7829ecb858925e5ca => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:02.308620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e2d49-1282-43ce-95af-a5ccedea3d81 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:02.350267 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205edaf-85d9-4514-976d-fcd8513f17f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:02.352106 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205edaf-85d9-4514-976d-fcd8513f17f5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:02.413898 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e2d49-1282-43ce-95af-a5ccedea3d81 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:02.449695 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19900c-391b-4327-9598-1997d069db4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:02.450555 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19900c-391b-4327-9598-1997d069db4c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:02.450781 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19900c-391b-4327-9598-1997d069db4c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:02.451054 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19900c-391b-4327-9598-1997d069db4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:02.456848 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 362/758] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:32:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 06:32:02.458245 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19900c-391b-4327-9598-1997d069db4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:02.463729 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19900c-391b-4327-9598-1997d069db4c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:02.464950 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205edaf-85d9-4514-976d-fcd8513f17f5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:02.491142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-4a19900c-391b-4327-9598-1997d069db4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:02.491142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:02.491142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:02.491142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:02.491142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:02.491142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:02.491142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:02.491142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:02.491142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:02.491142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:02.491142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:02.491142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:02.491142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:32:02.491142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:32:02.491142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:32:02.492340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:32:02.492340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:02.492340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:02.492340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:02.492340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:02.492340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:02.492340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:02.492340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:02.492340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:02.492340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:02.492340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:02.492340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:02.492340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:02.492340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:02.492340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:02.492340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:02.492340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:02.493302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:32:02.493302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:32:02.493302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:32:02.493302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:32:02.493302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:32:02.493302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:32:02.493302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:02.493302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:02.495383 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 397/759] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:32:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:02.502804 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19900c-391b-4327-9598-1997d069db4c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:02.638180 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205edaf-85d9-4514-976d-fcd8513f17f5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:02.648438 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19900c-391b-4327-9598-1997d069db4c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:02.673899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ee21e-b169-4b19-922c-6e7bf05273da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:02.675340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ee21e-b169-4b19-922c-6e7bf05273da None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:02.675872 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ee21e-b169-4b19-922c-6e7bf05273da None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:02.676342 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ee21e-b169-4b19-922c-6e7bf05273da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:02.683128 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fee0ab-973e-412d-9942-508cfb189e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:02.684204 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fee0ab-973e-412d-9942-508cfb189e7c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:02.684204 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fee0ab-973e-412d-9942-508cfb189e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:02.684405 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fee0ab-973e-412d-9942-508cfb189e7c None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:02.685127 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fee0ab-973e-412d-9942-508cfb189e7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:02.685431 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fee0ab-973e-412d-9942-508cfb189e7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:02.687245 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fee0ab-973e-412d-9942-508cfb189e7c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:02.688769 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ee21e-b169-4b19-922c-6e7bf05273da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:02.690656 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ee21e-b169-4b19-922c-6e7bf05273da None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:02.708474 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 398/760] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:32:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:02.709595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-e85ee21e-b169-4b19-922c-6e7bf05273da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:02.709595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:02.709595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:02.709595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:02.709595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:02.709595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:02.709595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:02.709595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:02.709595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:02.709595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:02.709595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:02.709595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:02.709595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:02.709595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:02.709595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:02.710467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:02.710467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:02.710467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:02.710467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:02.710467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:02.710467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:02.710467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:02.710467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:02.710467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:02.710467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:02.710467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:02.710467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:02.710467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:02.710467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:02.710467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:02.710467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:02.710467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:02.711368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:02.711368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:02.711368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:02.711368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:02.717679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 363/761] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:02.719525 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fee0ab-973e-412d-9942-508cfb189e7c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:02.725609 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ee21e-b169-4b19-922c-6e7bf05273da None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:02.838870 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fee0ab-973e-412d-9942-508cfb189e7c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:02.879190 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e93a1-da6a-4eb0-b776-44bd7fae1698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:02.880484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e93a1-da6a-4eb0-b776-44bd7fae1698 None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:02.882223 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e93a1-da6a-4eb0-b776-44bd7fae1698 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:02.883773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e93a1-da6a-4eb0-b776-44bd7fae1698 None admin] PATH_INFO: `/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/bbcd54a927bf46f183b50fbda677868d/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:02.888495 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e93a1-da6a-4eb0-b776-44bd7fae1698 None admin] RBAC: Authorizing `identity:create_grant(project_id=57e1a8b143974111b0ba09d041b331d5, user_id=bbcd54a927bf46f183b50fbda677868d, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:02.890123 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e93a1-da6a-4eb0-b776-44bd7fae1698 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:02.904437 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ee21e-b169-4b19-922c-6e7bf05273da None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:02.945065 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ce1e0-6826-4e94-9ac9-9c4c4246c069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:02.945659 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ce1e0-6826-4e94-9ac9-9c4c4246c069 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:02.945935 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ce1e0-6826-4e94-9ac9-9c4c4246c069 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:02.946210 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ce1e0-6826-4e94-9ac9-9c4c4246c069 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:02.946934 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ce1e0-6826-4e94-9ac9-9c4c4246c069 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:02.947242 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ce1e0-6826-4e94-9ac9-9c4c4246c069 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:02.948698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ce1e0-6826-4e94-9ac9-9c4c4246c069 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:02.966459 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 364/762] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:02.967597 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ce1e0-6826-4e94-9ac9-9c4c4246c069 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:02.980285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 399/763] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:32:02 2022] PUT /identity/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/bbcd54a927bf46f183b50fbda677868d/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:32:03.117058 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ce1e0-6826-4e94-9ac9-9c4c4246c069 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:03.169744 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c463a0-67bc-45cd-9ed6-5438985fe916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:03.170544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c463a0-67bc-45cd-9ed6-5438985fe916 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:03.170826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c463a0-67bc-45cd-9ed6-5438985fe916 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:03.171099 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c463a0-67bc-45cd-9ed6-5438985fe916 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:03.181441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c463a0-67bc-45cd-9ed6-5438985fe916 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:03.182875 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c463a0-67bc-45cd-9ed6-5438985fe916 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:03.197596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-c9c463a0-67bc-45cd-9ed6-5438985fe916 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:03.197596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:03.197596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:03.197596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:03.197596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:03.197596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:03.197596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:03.197596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:03.197596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:03.197596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:03.197596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:03.197596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:03.197596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:32:03.197596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:32:03.197596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:32:03.198613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:32:03.198613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:03.198613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:03.198613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:03.198613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:03.198613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:03.198613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:03.198613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:03.198613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:03.198613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:03.198613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:03.198613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:03.198613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:03.198613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:03.198613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:03.198613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:03.198613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:03.199520 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:32:03.199520 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:32:03.199520 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:32:03.199520 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:32:03.199520 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:32:03.199520 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:32:03.199520 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:03.199520 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:03.201617 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 365/764] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:32:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:03.206351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e93a1-da6a-4eb0-b776-44bd7fae1698 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:03.322777 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e93a1-da6a-4eb0-b776-44bd7fae1698 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:03.368173 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a709c-9f66-40da-bead-8f49dbac61fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:03.368841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a709c-9f66-40da-bead-8f49dbac61fb None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:03.369121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a709c-9f66-40da-bead-8f49dbac61fb None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:03.369393 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a709c-9f66-40da-bead-8f49dbac61fb None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:03.370188 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a709c-9f66-40da-bead-8f49dbac61fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:03.370492 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a709c-9f66-40da-bead-8f49dbac61fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:03.371940 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a709c-9f66-40da-bead-8f49dbac61fb None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:03.389203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 400/765] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:32:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:03.390559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c463a0-67bc-45cd-9ed6-5438985fe916 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:03.501784 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c463a0-67bc-45cd-9ed6-5438985fe916 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:03.535104 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65079ea-ca84-4ed4-b327-35d4427279c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:03.535785 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65079ea-ca84-4ed4-b327-35d4427279c4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:03.536069 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65079ea-ca84-4ed4-b327-35d4427279c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:03.536343 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65079ea-ca84-4ed4-b327-35d4427279c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:03.537224 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65079ea-ca84-4ed4-b327-35d4427279c4 None admin] RBAC: Adding query filter params (role.id=ed3e6c61b2d14364a605282f0f1488ba, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=7a25a3f2c9a148a1ae73e519070b190b) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:03.537537 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65079ea-ca84-4ed4-b327-35d4427279c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:03.538955 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65079ea-ca84-4ed4-b327-35d4427279c4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:03.548606 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 366/766] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:32:03 2022] GET /identity/v3/role_assignments?user.id=7a25a3f2c9a148a1ae73e519070b190b&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=ed3e6c61b2d14364a605282f0f1488ba => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:03.990498 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486257a-a35c-40fc-a8e7-8b11dc31de79 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:03.990498 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486257a-a35c-40fc-a8e7-8b11dc31de79 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:03.990498 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486257a-a35c-40fc-a8e7-8b11dc31de79 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:03.992949 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 401/767] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:03.998532 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eef6ce-ff2a-44dc-b755-156e0fab7028 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:03.998532 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eef6ce-ff2a-44dc-b755-156e0fab7028 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:03.998532 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eef6ce-ff2a-44dc-b755-156e0fab7028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:04.024721 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a9eef6ce-ff2a-44dc-b755-156e0fab7028 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:04.026263 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a9eef6ce-ff2a-44dc-b755-156e0fab7028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:04.110309 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 367/768] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:04.145273 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486257a-a35c-40fc-a8e7-8b11dc31de79 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:04.303384 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486257a-a35c-40fc-a8e7-8b11dc31de79 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:04.351138 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791371d8-f69e-4620-beeb-b4435c66e231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:04.351968 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791371d8-f69e-4620-beeb-b4435c66e231 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:04.352247 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791371d8-f69e-4620-beeb-b4435c66e231 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:04.352517 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791371d8-f69e-4620-beeb-b4435c66e231 None admin] PATH_INFO: `/v3/services/network` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:04.353182 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791371d8-f69e-4620-beeb-b4435c66e231 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:04.354543 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791371d8-f69e-4620-beeb-b4435c66e231 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:04.370103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-791371d8-f69e-4620-beeb-b4435c66e231 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 06:32:04.370103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:04.370103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:32:04.370103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:32:04.370103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:32:04.370103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:32:04.370103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:32:04.370103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:04.370103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 06:32:04.370103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:04.370103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:04.370103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:04.370103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:04.370103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:04.370103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:04.370103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:04.370103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:04.371139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:04.371139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:04.371139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:04.371139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:04.371139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:04.371139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:04.371139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:32:04.371139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:32:04.371139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:32:04.371139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:32:04.371139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:04.371139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:04.371139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:04.371139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:04.371139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:04.371139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:04.372041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:04.372041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:04.372041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:04.372041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:04.372041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:04.372041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:04.372041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:04.372041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:04.372041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:04.372041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:04.372041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:32:04.372041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:04.372041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 06:32:04.372041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:04.372041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 402/769] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:32:04 2022] GET /identity/v3/services/network => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:04.379559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eef6ce-ff2a-44dc-b755-156e0fab7028 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:04.474729 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62be4e-b0a7-47d0-8673-7773eb922875 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:04.475067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62be4e-b0a7-47d0-8673-7773eb922875 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:04.475280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62be4e-b0a7-47d0-8673-7773eb922875 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:04.479795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 403/770] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:04.488939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0730c12-46f7-4f55-866a-a028a9df545b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:04.489219 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0730c12-46f7-4f55-866a-a028a9df545b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:04.489491 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0730c12-46f7-4f55-866a-a028a9df545b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:04.511019 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eef6ce-ff2a-44dc-b755-156e0fab7028 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:04.528736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-c0730c12-46f7-4f55-866a-a028a9df545b None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:04.529940 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c0730c12-46f7-4f55-866a-a028a9df545b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:04.546860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc0456-94f1-4d66-9788-5090ede12e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:04.547933 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc0456-94f1-4d66-9788-5090ede12e7b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:04.548425 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc0456-94f1-4d66-9788-5090ede12e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:04.548921 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc0456-94f1-4d66-9788-5090ede12e7b None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:04.549833 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc0456-94f1-4d66-9788-5090ede12e7b None admin] RBAC: Adding query filter params (name=network) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:04.550362 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc0456-94f1-4d66-9788-5090ede12e7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:04.551961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc0456-94f1-4d66-9788-5090ede12e7b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:04.557662 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 368/771] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 12 06:32:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:04.565135 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc0456-94f1-4d66-9788-5090ede12e7b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:04.673973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 404/772] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:04.700463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc0456-94f1-4d66-9788-5090ede12e7b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:04.719762 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0730c12-46f7-4f55-866a-a028a9df545b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:04.767008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee34c25-f47b-4c48-9e31-72fa0b4bc306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:04.767695 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee34c25-f47b-4c48-9e31-72fa0b4bc306 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:04.769564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee34c25-f47b-4c48-9e31-72fa0b4bc306 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:04.769837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee34c25-f47b-4c48-9e31-72fa0b4bc306 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:04.770560 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee34c25-f47b-4c48-9e31-72fa0b4bc306 None admin] RBAC: Adding query filter params (type=network) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:04.770864 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee34c25-f47b-4c48-9e31-72fa0b4bc306 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:04.772792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee34c25-f47b-4c48-9e31-72fa0b4bc306 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:04.787828 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 369/773] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 12 06:32:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:04.793680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee34c25-f47b-4c48-9e31-72fa0b4bc306 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:04.908550 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0730c12-46f7-4f55-866a-a028a9df545b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:04.953850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0054087-d783-45ac-828f-7d95dcf440dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:04.954883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0054087-d783-45ac-828f-7d95dcf440dd None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:04.954996 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0054087-d783-45ac-828f-7d95dcf440dd None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:04.955185 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0054087-d783-45ac-828f-7d95dcf440dd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:04.956322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0054087-d783-45ac-828f-7d95dcf440dd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:04.957812 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0054087-d783-45ac-828f-7d95dcf440dd None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:04.964663 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee34c25-f47b-4c48-9e31-72fa0b4bc306 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:04.972379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-b0054087-d783-45ac-828f-7d95dcf440dd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 06:32:04.972379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:04.972379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:32:04.972379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:32:04.972379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:32:04.972379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:32:04.972379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:32:04.972379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:04.972379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 06:32:04.972379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:04.972379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:04.972379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:04.972379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:04.972379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:04.972379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:04.972379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:04.973641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:04.973641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:04.973641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:04.973641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:04.973641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:04.973641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:04.973641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:04.973641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:32:04.973641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:32:04.973641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:32:04.973641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:32:04.973641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:04.973641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:04.973641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:04.973641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:04.973641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:04.974673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:04.974673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:04.974673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:04.974673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:04.974673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:04.974673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:04.974673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:04.974673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:04.974673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:04.974673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:04.974673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:04.974673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:32:04.974673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:04.974673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 06:32:04.974673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:04.974673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 405/774] 10.222.0.25 () {56 vars in 1129 bytes} [Thu May 12 06:32:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:04.980394 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6243b0-c66f-4c33-9d81-e0ce831d8cea None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:04.980699 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6243b0-c66f-4c33-9d81-e0ce831d8cea None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:04.980977 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6243b0-c66f-4c33-9d81-e0ce831d8cea None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:04.982490 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 406/775] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:04.983206 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6243b0-c66f-4c33-9d81-e0ce831d8cea None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:05.007002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bd152-5f35-4411-b398-89c53775bbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:05.007743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bd152-5f35-4411-b398-89c53775bbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:05.008192 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bd152-5f35-4411-b398-89c53775bbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:05.008640 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bd152-5f35-4411-b398-89c53775bbf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:05.009635 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62bd152-5f35-4411-b398-89c53775bbf9 None admin] RBAC: Adding query filter params (interface=public, service_id=1c092a3fd98d495fa924e5975bdb2724, region_id=RegionOne) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:05.010109 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62bd152-5f35-4411-b398-89c53775bbf9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:05.011710 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62bd152-5f35-4411-b398-89c53775bbf9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:05.020713 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 370/776] 10.222.0.25 () {56 vars in 1251 bytes} [Thu May 12 06:32:04 2022] GET /identity/v3/endpoints?service_id=1c092a3fd98d495fa924e5975bdb2724&interface=public®ion_id=RegionOne => generated 194 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:05.024841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045dac2-d075-4871-ad31-8e4fe02da43b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:05.024841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045dac2-d075-4871-ad31-8e4fe02da43b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:05.024841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045dac2-d075-4871-ad31-8e4fe02da43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:05.041870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0045dac2-d075-4871-ad31-8e4fe02da43b None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:05.043172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0045dac2-d075-4871-ad31-8e4fe02da43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:05.112542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6243b0-c66f-4c33-9d81-e0ce831d8cea None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:05.116499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 371/777] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:05.117582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045dac2-d075-4871-ad31-8e4fe02da43b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:05.163750 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a3845-d523-48ab-b7d2-59dd15cc4659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:05.164957 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a3845-d523-48ab-b7d2-59dd15cc4659 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:05.165418 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a3845-d523-48ab-b7d2-59dd15cc4659 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:05.165911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a3845-d523-48ab-b7d2-59dd15cc4659 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:05.166815 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a3845-d523-48ab-b7d2-59dd15cc4659 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:05.167359 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a3845-d523-48ab-b7d2-59dd15cc4659 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:05.168939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a3845-d523-48ab-b7d2-59dd15cc4659 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:05.174069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 407/778] 10.222.0.25 () {56 vars in 1124 bytes} [Thu May 12 06:32:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:05.175203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a3845-d523-48ab-b7d2-59dd15cc4659 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:05.253507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045dac2-d075-4871-ad31-8e4fe02da43b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:05.274846 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a3845-d523-48ab-b7d2-59dd15cc4659 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:05.302909 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76931c-6d36-453f-b411-e08cd631f76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:05.303751 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76931c-6d36-453f-b411-e08cd631f76b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:05.304169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76931c-6d36-453f-b411-e08cd631f76b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:05.304453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76931c-6d36-453f-b411-e08cd631f76b None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:05.305159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76931c-6d36-453f-b411-e08cd631f76b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:05.307025 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76931c-6d36-453f-b411-e08cd631f76b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:05.313964 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 372/779] 10.222.0.25 () {56 vars in 1087 bytes} [Thu May 12 06:32:05 2022] GET /identity/v3/services => generated 772 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:05.314478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f1fa7-e5f9-4831-b103-c68b81ca5874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:05.314854 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76931c-6d36-453f-b411-e08cd631f76b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:05.315943 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f1fa7-e5f9-4831-b103-c68b81ca5874 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:05.316438 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f1fa7-e5f9-4831-b103-c68b81ca5874 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:05.316939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f1fa7-e5f9-4831-b103-c68b81ca5874 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:05.328970 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f1fa7-e5f9-4831-b103-c68b81ca5874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:32:05.338071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-7b3f1fa7-e5f9-4831-b103-c68b81ca5874 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:32:05.338071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:05.338071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:05.338071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:05.338071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:05.338071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:05.338071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:05.338071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:05.338071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:05.338071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:05.338071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:05.338071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:05.338071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:32:05.338071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:32:05.338071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:32:05.338071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:32:05.339096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:32:05.339096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:32:05.339096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:32:05.339096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:32:05.339096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:05.339096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:05.339096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:05.339096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:05.339096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:05.339096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:05.339096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:05.339096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:05.339096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:05.339096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:05.339096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:05.339096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:05.340401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:05.340401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:05.340401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:05.340401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:05.340401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:32:05.340401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:32:05.340401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:32:05.340401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:32:05.340401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:32:05.340401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:32:05.340401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:32:05.340401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:05.343197 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 408/780] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:32:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:05.352798 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f1fa7-e5f9-4831-b103-c68b81ca5874 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:05.440813 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76931c-6d36-453f-b411-e08cd631f76b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:05.482435 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fc790-c917-40bd-8e95-15221d5cb616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:05.483112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fc790-c917-40bd-8e95-15221d5cb616 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:05.483397 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fc790-c917-40bd-8e95-15221d5cb616 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:05.483674 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fc790-c917-40bd-8e95-15221d5cb616 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:05.484427 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fc790-c917-40bd-8e95-15221d5cb616 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:05.485328 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fc790-c917-40bd-8e95-15221d5cb616 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:05.486754 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fc790-c917-40bd-8e95-15221d5cb616 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:05.493083 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 373/781] 10.222.0.25 () {56 vars in 1124 bytes} [Thu May 12 06:32:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:05.500332 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fc790-c917-40bd-8e95-15221d5cb616 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:05.558721 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f1fa7-e5f9-4831-b103-c68b81ca5874 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:05.594453 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc5e3a-a891-42f2-b495-c405ea95f65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:05.596018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc5e3a-a891-42f2-b495-c405ea95f65b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:05.596304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc5e3a-a891-42f2-b495-c405ea95f65b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:05.596581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc5e3a-a891-42f2-b495-c405ea95f65b None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:05.597347 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc5e3a-a891-42f2-b495-c405ea95f65b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:05.597654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc5e3a-a891-42f2-b495-c405ea95f65b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:05.599016 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc5e3a-a891-42f2-b495-c405ea95f65b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:05.611575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 409/782] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:32:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:05.616200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fc790-c917-40bd-8e95-15221d5cb616 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:05.617172 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc5e3a-a891-42f2-b495-c405ea95f65b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:05.653703 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe7f8f-b494-40a8-b747-eb0f3280e534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:05.655462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe7f8f-b494-40a8-b747-eb0f3280e534 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:05.658601 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe7f8f-b494-40a8-b747-eb0f3280e534 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:05.659097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe7f8f-b494-40a8-b747-eb0f3280e534 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:05.660129 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe7f8f-b494-40a8-b747-eb0f3280e534 None admin] RBAC: Adding query filter params (interface=public, service_id=dbe145c232014e07b20c26eaaba15273, region_id=RegionOne) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:05.660641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe7f8f-b494-40a8-b747-eb0f3280e534 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:05.662775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe7f8f-b494-40a8-b747-eb0f3280e534 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:05.672916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 374/783] 10.222.0.25 () {56 vars in 1251 bytes} [Thu May 12 06:32:05 2022] GET /identity/v3/endpoints?service_id=dbe145c232014e07b20c26eaaba15273&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:05.681093 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe7f8f-b494-40a8-b747-eb0f3280e534 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:05.802174 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe7f8f-b494-40a8-b747-eb0f3280e534 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:05.826780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc5e3a-a891-42f2-b495-c405ea95f65b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:05.849924 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd11ee-241f-484d-bbc1-7b04288a0c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:05.850943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd11ee-241f-484d-bbc1-7b04288a0c2c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:05.851421 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd11ee-241f-484d-bbc1-7b04288a0c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:05.851925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd11ee-241f-484d-bbc1-7b04288a0c2c None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:05.852830 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd11ee-241f-484d-bbc1-7b04288a0c2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:05.854377 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd11ee-241f-484d-bbc1-7b04288a0c2c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:05.865427 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 375/784] 10.222.0.25 () {56 vars in 1087 bytes} [Thu May 12 06:32:05 2022] GET /identity/v3/services => generated 772 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:05.866666 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07826243-0de4-4fa6-aa3a-93debf693873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:05.867473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07826243-0de4-4fa6-aa3a-93debf693873 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:05.867802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07826243-0de4-4fa6-aa3a-93debf693873 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:05.868080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07826243-0de4-4fa6-aa3a-93debf693873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:05.888572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07826243-0de4-4fa6-aa3a-93debf693873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:05.890049 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07826243-0de4-4fa6-aa3a-93debf693873 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:05.922969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-07826243-0de4-4fa6-aa3a-93debf693873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:05.922969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:05.922969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:05.922969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:05.922969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:05.922969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:05.922969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:05.922969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:05.922969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:05.922969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:05.922969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:05.922969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:05.922969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:05.922969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:05.922969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:05.923982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:05.923982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:05.923982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:05.923982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:05.923982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:05.923982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:05.923982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:05.923982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:05.923982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:05.923982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:05.923982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:05.923982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:05.923982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:05.923982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:05.923982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:05.923982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:05.923982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:05.924881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:05.924881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:05.924881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:05.924881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:05.924881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 410/785] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:05.930750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd11ee-241f-484d-bbc1-7b04288a0c2c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:06.007410 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8287bb-c21e-42f5-a837-23fa0462b4e6 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:06.007799 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8287bb-c21e-42f5-a837-23fa0462b4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:06.007992 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8287bb-c21e-42f5-a837-23fa0462b4e6 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:06.009618 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 411/786] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:32:06.015401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94220c-f118-414d-ac40-31a0075ef68d None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:06.015714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94220c-f118-414d-ac40-31a0075ef68d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:06.016188 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94220c-f118-414d-ac40-31a0075ef68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:06.048222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6f94220c-f118-414d-ac40-31a0075ef68d None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:06.049438 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6f94220c-f118-414d-ac40-31a0075ef68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:06.117871 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd11ee-241f-484d-bbc1-7b04288a0c2c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:06.155014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 412/787] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:32:06.163895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90761d-3802-4ac3-b919-b3378710fdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:06.164880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90761d-3802-4ac3-b919-b3378710fdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:06.165163 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90761d-3802-4ac3-b919-b3378710fdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:06.165487 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90761d-3802-4ac3-b919-b3378710fdc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:06.166223 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90761d-3802-4ac3-b919-b3378710fdc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:06.166526 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90761d-3802-4ac3-b919-b3378710fdc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:06.167916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90761d-3802-4ac3-b919-b3378710fdc6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:06.175797 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a54e9-de7b-4c15-a4bc-5566632a4686 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:06.176090 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a54e9-de7b-4c15-a4bc-5566632a4686 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:06.176374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a54e9-de7b-4c15-a4bc-5566632a4686 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:06.178271 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 413/788] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:32:06.181887 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 376/789] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:06.186511 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd21d75-1881-451a-bf53-e5cc4cab9c5e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:06.186511 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd21d75-1881-451a-bf53-e5cc4cab9c5e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:06.186511 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd21d75-1881-451a-bf53-e5cc4cab9c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:06.187835 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90761d-3802-4ac3-b919-b3378710fdc6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:06.205462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-edd21d75-1881-451a-bf53-e5cc4cab9c5e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:06.206893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-edd21d75-1881-451a-bf53-e5cc4cab9c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:06.288760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 414/790] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:32:06.290224 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd21d75-1881-451a-bf53-e5cc4cab9c5e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:06.313082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90761d-3802-4ac3-b919-b3378710fdc6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:06.352112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5d778-60f7-47a2-a995-e6ee9860ea82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:06.353272 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5d778-60f7-47a2-a995-e6ee9860ea82 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:06.353756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5d778-60f7-47a2-a995-e6ee9860ea82 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:06.354224 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5d778-60f7-47a2-a995-e6ee9860ea82 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:06.362627 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5d778-60f7-47a2-a995-e6ee9860ea82 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:06.364447 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5d778-60f7-47a2-a995-e6ee9860ea82 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:06.378922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-34e5d778-60f7-47a2-a995-e6ee9860ea82 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 06:32:06.378922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:06.378922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:06.378922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:06.378922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:06.378922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:06.378922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:06.378922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:06.378922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:06.378922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:06.378922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:06.378922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:06.378922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:32:06.378922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:32:06.378922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:32:06.378922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:32:06.380008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:06.380008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:06.380008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:32:06.380008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:06.380008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:32:06.380008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:06.380008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:06.380008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:06.380008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:06.380008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:06.380008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:06.380008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:06.380008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:06.380008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:06.380008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:06.380008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:06.380008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:06.380008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:06.381543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:06.381543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:06.381543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:32:06.381543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:32:06.381543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:32:06.381543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:32:06.381543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:32:06.381543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:32:06.381543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 06:32:06.381543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:06.384259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 377/791] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:32:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:06.385419 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5d778-60f7-47a2-a995-e6ee9860ea82 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:06.414077 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd21d75-1881-451a-bf53-e5cc4cab9c5e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:06.456447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21f78a-3596-488e-a913-58bc0f20022c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:06.457639 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21f78a-3596-488e-a913-58bc0f20022c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:06.458143 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21f78a-3596-488e-a913-58bc0f20022c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:06.458676 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21f78a-3596-488e-a913-58bc0f20022c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:06.469156 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21f78a-3596-488e-a913-58bc0f20022c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:32:06.477892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-dd21f78a-3596-488e-a913-58bc0f20022c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:32:06.477892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:06.477892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:06.477892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:06.477892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:06.477892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:06.477892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:06.477892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:06.477892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:06.477892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:06.477892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:06.477892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:06.477892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:32:06.477892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:32:06.477892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:32:06.477892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:32:06.478860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:32:06.478860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:32:06.478860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:32:06.478860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:32:06.478860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:06.478860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:06.478860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:06.478860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:06.478860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:06.478860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:06.478860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:06.478860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:06.478860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:06.478860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:06.478860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:06.478860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:06.479733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:06.479733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:06.479733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:06.479733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:06.479733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:32:06.479733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:32:06.479733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:32:06.479733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:32:06.479733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:32:06.479733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:32:06.479733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:32:06.479733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:06.486937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 415/792] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:32:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:06.487062 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5d778-60f7-47a2-a995-e6ee9860ea82 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:06.488176 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21f78a-3596-488e-a913-58bc0f20022c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:06.531755 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7205ad-b9fb-47bc-9324-a45969b5ee8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:06.531755 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7205ad-b9fb-47bc-9324-a45969b5ee8e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:06.531755 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7205ad-b9fb-47bc-9324-a45969b5ee8e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:06.531755 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7205ad-b9fb-47bc-9324-a45969b5ee8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:06.542361 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7205ad-b9fb-47bc-9324-a45969b5ee8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:32:06.553188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-8b7205ad-b9fb-47bc-9324-a45969b5ee8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 06:32:06.553188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:06.553188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:06.553188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:06.553188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:06.553188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:06.553188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:06.553188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:06.553188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:06.553188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:06.553188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:06.553188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:06.553188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:32:06.553188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:32:06.553188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:32:06.553188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:32:06.554321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:32:06.554321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:32:06.554321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:32:06.554321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:32:06.554321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:06.554321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:06.554321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:06.554321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:06.554321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:06.554321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:06.554321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:06.554321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:06.554321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:06.554321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:06.554321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:06.554321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:06.555175 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:06.555175 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:06.555175 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:06.555175 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:06.555175 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:32:06.555175 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:32:06.555175 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:32:06.555175 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:32:06.555175 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:32:06.555175 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:32:06.555175 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 06:32:06.555175 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:06.559304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 378/793] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:32:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:06.560187 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7205ad-b9fb-47bc-9324-a45969b5ee8e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:06.599806 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21f78a-3596-488e-a913-58bc0f20022c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:06.634770 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deff048-09c0-409c-8eae-b13d219d81f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:06.635365 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deff048-09c0-409c-8eae-b13d219d81f2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:06.635645 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deff048-09c0-409c-8eae-b13d219d81f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:06.635942 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deff048-09c0-409c-8eae-b13d219d81f2 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:06.636790 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deff048-09c0-409c-8eae-b13d219d81f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:06.637092 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deff048-09c0-409c-8eae-b13d219d81f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:06.638502 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deff048-09c0-409c-8eae-b13d219d81f2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:06.656362 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 416/794] 10.222.0.25 () {56 vars in 1135 bytes} [Thu May 12 06:32:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:06.657193 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deff048-09c0-409c-8eae-b13d219d81f2 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:06.678362 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7205ad-b9fb-47bc-9324-a45969b5ee8e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:06.715210 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ece04-0460-458e-91a1-247b96f9b1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:06.716235 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ece04-0460-458e-91a1-247b96f9b1dc None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:06.716673 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ece04-0460-458e-91a1-247b96f9b1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:06.716994 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ece04-0460-458e-91a1-247b96f9b1dc None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:06.718390 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ece04-0460-458e-91a1-247b96f9b1dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:06.718701 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ece04-0460-458e-91a1-247b96f9b1dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:06.720160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ece04-0460-458e-91a1-247b96f9b1dc None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:06.732017 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 379/795] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:32:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:06.733094 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ece04-0460-458e-91a1-247b96f9b1dc None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:06.759149 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deff048-09c0-409c-8eae-b13d219d81f2 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:06.794146 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec55928-16d5-4aac-ac45-931a937af0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:06.794824 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec55928-16d5-4aac-ac45-931a937af0bd None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:06.795104 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec55928-16d5-4aac-ac45-931a937af0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:06.795376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec55928-16d5-4aac-ac45-931a937af0bd None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:06.796179 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec55928-16d5-4aac-ac45-931a937af0bd None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:06.796482 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec55928-16d5-4aac-ac45-931a937af0bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:06.797835 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec55928-16d5-4aac-ac45-931a937af0bd None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:06.806231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 417/796] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 12 06:32:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:06.807110 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec55928-16d5-4aac-ac45-931a937af0bd None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:06.856977 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ece04-0460-458e-91a1-247b96f9b1dc None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:06.892415 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f274c-4773-45fd-9055-7b72afac0256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:06.893447 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f274c-4773-45fd-9055-7b72afac0256 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:06.894023 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f274c-4773-45fd-9055-7b72afac0256 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:06.894305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f274c-4773-45fd-9055-7b72afac0256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:06.908168 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f274c-4773-45fd-9055-7b72afac0256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:06.910211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f274c-4773-45fd-9055-7b72afac0256 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:06.914765 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec55928-16d5-4aac-ac45-931a937af0bd None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:06.932928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-af9f274c-4773-45fd-9055-7b72afac0256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:06.932928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:06.932928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:06.932928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:06.932928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:06.932928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:06.932928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:06.932928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:06.932928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:06.932928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:06.932928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:06.932928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:06.932928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:06.932928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:06.932928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:06.934647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:06.934647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:06.934647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:06.934647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:06.934647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:06.934647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:06.934647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:06.934647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:06.934647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:06.934647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:06.934647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:06.934647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:06.934647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:06.934647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:06.934647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:06.934647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:06.934647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:06.936380 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:06.936380 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:06.936380 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:06.936380 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:06.939474 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 380/797] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:06.940353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f274c-4773-45fd-9055-7b72afac0256 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:06.960060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae199f4-2197-4d09-86d8-66859b44f7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:06.960922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae199f4-2197-4d09-86d8-66859b44f7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:06.961289 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae199f4-2197-4d09-86d8-66859b44f7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:06.963845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae199f4-2197-4d09-86d8-66859b44f7a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:06.975758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae199f4-2197-4d09-86d8-66859b44f7a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:06.977721 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae199f4-2197-4d09-86d8-66859b44f7a0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:07.001326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-6ae199f4-2197-4d09-86d8-66859b44f7a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:07.001326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:07.001326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:07.001326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:07.001326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:07.001326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:07.001326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:07.001326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:07.001326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:07.001326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:07.001326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:07.001326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:07.001326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:07.001326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:07.001326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:07.003124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:07.003124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:07.003124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:07.003124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:07.003124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:07.003124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:07.003124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:07.003124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:07.003124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:07.003124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:07.003124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:07.003124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:07.003124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:07.003124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:07.003124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:07.003124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:07.003124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:07.004348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:07.004348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:07.004348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:07.004348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:07.004348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 418/798] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:07.004348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae199f4-2197-4d09-86d8-66859b44f7a0 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:07.053865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f274c-4773-45fd-9055-7b72afac0256 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:07.096164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c19b81-236f-49ac-a7cb-c5686aecc550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:07.097315 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c19b81-236f-49ac-a7cb-c5686aecc550 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:07.097598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c19b81-236f-49ac-a7cb-c5686aecc550 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:07.097874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c19b81-236f-49ac-a7cb-c5686aecc550 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:07.111097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c19b81-236f-49ac-a7cb-c5686aecc550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:07.112935 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c19b81-236f-49ac-a7cb-c5686aecc550 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:07.126967 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae199f4-2197-4d09-86d8-66859b44f7a0 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:07.132883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-33c19b81-236f-49ac-a7cb-c5686aecc550 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:07.132883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:07.132883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:07.132883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:07.132883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:07.132883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:07.132883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:07.132883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:07.132883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:07.132883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:07.132883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:07.132883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:07.132883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:07.132883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:07.132883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:07.135325 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:07.135325 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:07.135325 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:07.135325 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:07.135325 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:07.135325 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:07.135325 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:07.135325 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:07.135325 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:07.135325 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:07.135325 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:07.135325 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:07.135325 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:07.135325 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:07.135325 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:07.135325 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:07.135325 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:07.136727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:07.136727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:07.136727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:07.136727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:07.136727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 381/799] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:07.136727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c19b81-236f-49ac-a7cb-c5686aecc550 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:07.172254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08915f-9e9f-4ad7-9523-b4bcf56728aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:07.172839 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08915f-9e9f-4ad7-9523-b4bcf56728aa None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:07.173296 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08915f-9e9f-4ad7-9523-b4bcf56728aa None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:07.173578 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08915f-9e9f-4ad7-9523-b4bcf56728aa None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:07.175225 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08915f-9e9f-4ad7-9523-b4bcf56728aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:07.175535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08915f-9e9f-4ad7-9523-b4bcf56728aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:07.176977 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08915f-9e9f-4ad7-9523-b4bcf56728aa None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:07.193668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 419/800] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:07.194541 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08915f-9e9f-4ad7-9523-b4bcf56728aa None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:07.256304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c19b81-236f-49ac-a7cb-c5686aecc550 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:07.294031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a169a32-444b-4078-b451-17447968e7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:07.294715 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a169a32-444b-4078-b451-17447968e7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:07.294966 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a169a32-444b-4078-b451-17447968e7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:07.295237 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a169a32-444b-4078-b451-17447968e7f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:07.296198 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a169a32-444b-4078-b451-17447968e7f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:07.296331 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a169a32-444b-4078-b451-17447968e7f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:07.297625 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a169a32-444b-4078-b451-17447968e7f4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:07.302806 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08915f-9e9f-4ad7-9523-b4bcf56728aa None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:07.310028 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 382/801] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:07.310866 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a169a32-444b-4078-b451-17447968e7f4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:07.347839 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4872cfb-d622-4f4d-a210-48fc9f3cbaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:07.348825 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4872cfb-d622-4f4d-a210-48fc9f3cbaa0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:07.349326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4872cfb-d622-4f4d-a210-48fc9f3cbaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:07.349785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4872cfb-d622-4f4d-a210-48fc9f3cbaa0 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:07.351151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4872cfb-d622-4f4d-a210-48fc9f3cbaa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:07.351672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4872cfb-d622-4f4d-a210-48fc9f3cbaa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:07.353931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4872cfb-d622-4f4d-a210-48fc9f3cbaa0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:07.369531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 420/802] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:07.370684 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4872cfb-d622-4f4d-a210-48fc9f3cbaa0 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:07.415674 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a169a32-444b-4078-b451-17447968e7f4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:07.449646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294168c-2857-4fce-aae8-990c2071ace7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:07.450591 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294168c-2857-4fce-aae8-990c2071ace7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:07.450591 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294168c-2857-4fce-aae8-990c2071ace7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:07.450885 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294168c-2857-4fce-aae8-990c2071ace7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:07.457685 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294168c-2857-4fce-aae8-990c2071ace7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:07.460248 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294168c-2857-4fce-aae8-990c2071ace7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:07.474725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-f294168c-2857-4fce-aae8-990c2071ace7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:07.474725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:07.474725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:07.474725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:07.474725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:07.474725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:07.474725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:07.474725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:07.474725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:07.474725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:07.474725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:07.474725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:07.474725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:32:07.474725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:32:07.474725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:32:07.475698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:32:07.475698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:07.475698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:07.475698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:07.475698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:07.475698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:07.475698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:07.475698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:07.475698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:07.475698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:07.475698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:07.475698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:07.475698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:07.475698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:07.475698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:07.475698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:07.475698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:07.476640 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:32:07.476640 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:32:07.476640 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:32:07.476640 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:32:07.476640 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:32:07.476640 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:32:07.476640 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:07.476640 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:07.480674 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 383/803] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:32:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:07.481538 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294168c-2857-4fce-aae8-990c2071ace7 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:07.501918 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4872cfb-d622-4f4d-a210-48fc9f3cbaa0 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:07.545628 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd83ecc-92b9-4544-885b-77b629a36b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:07.546889 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd83ecc-92b9-4544-885b-77b629a36b05 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:07.547382 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd83ecc-92b9-4544-885b-77b629a36b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:07.548134 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd83ecc-92b9-4544-885b-77b629a36b05 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:07.560333 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd83ecc-92b9-4544-885b-77b629a36b05 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:07.562624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd83ecc-92b9-4544-885b-77b629a36b05 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:07.584136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-9fd83ecc-92b9-4544-885b-77b629a36b05 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 06:32:07.584136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:07.584136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:07.584136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:07.584136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:07.584136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:07.584136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:07.584136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:07.584136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:07.584136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:07.584136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:07.584136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:07.584136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:32:07.584136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:32:07.584136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:32:07.584136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:32:07.585186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:07.585186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:07.585186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:32:07.585186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:07.585186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:32:07.585186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:07.585186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:07.585186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:07.585186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:07.585186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:07.585186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:07.585186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:07.585186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:07.585186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:07.585186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:07.585186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:07.585186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:07.585186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:07.586174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:07.586174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:07.586174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:32:07.586174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:32:07.586174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:32:07.586174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:32:07.586174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:32:07.586174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:32:07.586174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 06:32:07.586174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:07.589226 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 421/804] 10.222.0.25 () {56 vars in 1093 bytes} [Thu May 12 06:32:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:07.589491 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294168c-2857-4fce-aae8-990c2071ace7 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:07.590493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd83ecc-92b9-4544-885b-77b629a36b05 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:07.624151 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1dad1-87ca-48db-891a-306c9b1cbdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:07.625070 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1dad1-87ca-48db-891a-306c9b1cbdc0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:07.625415 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1dad1-87ca-48db-891a-306c9b1cbdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:07.625869 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1dad1-87ca-48db-891a-306c9b1cbdc0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:07.634542 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1dad1-87ca-48db-891a-306c9b1cbdc0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:07.636274 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1dad1-87ca-48db-891a-306c9b1cbdc0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:07.651432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-97d1dad1-87ca-48db-891a-306c9b1cbdc0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 06:32:07.651432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:07.651432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:07.651432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:07.651432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:07.651432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:07.651432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:07.651432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:07.651432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:07.651432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:07.651432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:07.651432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:07.651432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:32:07.651432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:32:07.651432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:32:07.651432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:32:07.652479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:07.652479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:07.652479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:32:07.652479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:07.652479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:32:07.652479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:07.652479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:07.652479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:07.652479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:07.652479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:07.652479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:07.652479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:07.652479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:07.652479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:07.652479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:07.652479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:07.652479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:07.652479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:07.653433 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:07.653433 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:07.653433 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:32:07.653433 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:32:07.653433 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:32:07.653433 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:32:07.653433 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:32:07.653433 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:32:07.653433 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 06:32:07.653433 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:07.657599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 384/805] 10.222.0.25 () {56 vars in 1117 bytes} [Thu May 12 06:32:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:07.658477 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1dad1-87ca-48db-891a-306c9b1cbdc0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:07.723040 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd83ecc-92b9-4544-885b-77b629a36b05 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:07.761853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f6c63-57e2-4692-afb0-0c03dd4d6985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:07.762490 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f6c63-57e2-4692-afb0-0c03dd4d6985 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:07.762768 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f6c63-57e2-4692-afb0-0c03dd4d6985 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:07.763039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f6c63-57e2-4692-afb0-0c03dd4d6985 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:07.763853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f6c63-57e2-4692-afb0-0c03dd4d6985 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:07.764164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f6c63-57e2-4692-afb0-0c03dd4d6985 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:07.765570 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f6c63-57e2-4692-afb0-0c03dd4d6985 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:07.769913 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1dad1-87ca-48db-891a-306c9b1cbdc0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:07.777385 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 422/806] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:32:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:07.778196 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f6c63-57e2-4692-afb0-0c03dd4d6985 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:07.812465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74152e3b-b4f6-4b4f-8b58-24082514471f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:07.813134 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74152e3b-b4f6-4b4f-8b58-24082514471f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:07.813414 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74152e3b-b4f6-4b4f-8b58-24082514471f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:07.813683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74152e3b-b4f6-4b4f-8b58-24082514471f None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:07.814529 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74152e3b-b4f6-4b4f-8b58-24082514471f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:07.814836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74152e3b-b4f6-4b4f-8b58-24082514471f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:07.816303 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74152e3b-b4f6-4b4f-8b58-24082514471f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:07.834507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 385/807] 10.222.0.25 () {56 vars in 1133 bytes} [Thu May 12 06:32:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:07.836258 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070034b-ad2e-4759-a356-9940d76caa22 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:07.836775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070034b-ad2e-4759-a356-9940d76caa22 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:07.837255 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070034b-ad2e-4759-a356-9940d76caa22 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:07.838976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 386/808] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:07.839877 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070034b-ad2e-4759-a356-9940d76caa22 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:07.884618 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f6c63-57e2-4692-afb0-0c03dd4d6985 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:07.918674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e873541-9cb7-4e42-8ea0-93b3612e9c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:07.919436 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e873541-9cb7-4e42-8ea0-93b3612e9c5c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:07.919760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e873541-9cb7-4e42-8ea0-93b3612e9c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:07.920260 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e873541-9cb7-4e42-8ea0-93b3612e9c5c None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:07.921121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e873541-9cb7-4e42-8ea0-93b3612e9c5c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:07.921428 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e873541-9cb7-4e42-8ea0-93b3612e9c5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:07.922908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e873541-9cb7-4e42-8ea0-93b3612e9c5c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:07.940065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 423/809] 10.222.0.25 () {56 vars in 1149 bytes} [Thu May 12 06:32:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:07.940905 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e873541-9cb7-4e42-8ea0-93b3612e9c5c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:07.949990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070034b-ad2e-4759-a356-9940d76caa22 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:07.987745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff93e3-4ec2-449b-a477-3b645041326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:07.988707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff93e3-4ec2-449b-a477-3b645041326a None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:07.989061 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff93e3-4ec2-449b-a477-3b645041326a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:07.989432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff93e3-4ec2-449b-a477-3b645041326a None admin] PATH_INFO: `/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/a9882820f88349cb8fa2e3d457b19959/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:07.992242 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff93e3-4ec2-449b-a477-3b645041326a None admin] RBAC: Authorizing `identity:create_grant(project_id=57e1a8b143974111b0ba09d041b331d5, user_id=a9882820f88349cb8fa2e3d457b19959, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:07.993748 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff93e3-4ec2-449b-a477-3b645041326a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:08.042541 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e873541-9cb7-4e42-8ea0-93b3612e9c5c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:08.049167 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 387/810] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:32:07 2022] PUT /identity/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/a9882820f88349cb8fa2e3d457b19959/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:32:08.055132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01934125-fb96-4798-8429-706796f20813 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:08.055406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01934125-fb96-4798-8429-706796f20813 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:08.055678 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01934125-fb96-4798-8429-706796f20813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:08.077361 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f49ea-76d3-4657-b2c0-bc3fc22afe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:08.078035 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f49ea-76d3-4657-b2c0-bc3fc22afe88 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:08.078314 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f49ea-76d3-4657-b2c0-bc3fc22afe88 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:08.078582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f49ea-76d3-4657-b2c0-bc3fc22afe88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:08.103548 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-01934125-fb96-4798-8429-706796f20813 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:08.104906 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-01934125-fb96-4798-8429-706796f20813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:08.176329 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f49ea-76d3-4657-b2c0-bc3fc22afe88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:08.180040 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f49ea-76d3-4657-b2c0-bc3fc22afe88 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:08.194950 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 388/811] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:08.195724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01934125-fb96-4798-8429-706796f20813 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:08.307184 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 424/812] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:32:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 06:32:08.308422 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f49ea-76d3-4657-b2c0-bc3fc22afe88 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:08.330448 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01934125-fb96-4798-8429-706796f20813 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:08.366516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c9610-4bb3-4f20-bc74-e9416dc4115a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:08.367395 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9610-4bb3-4f20-bc74-e9416dc4115a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:08.367777 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9610-4bb3-4f20-bc74-e9416dc4115a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:08.368056 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9610-4bb3-4f20-bc74-e9416dc4115a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:08.377932 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c9610-4bb3-4f20-bc74-e9416dc4115a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:08.379582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c9610-4bb3-4f20-bc74-e9416dc4115a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:08.398561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-801c9610-4bb3-4f20-bc74-e9416dc4115a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:08.398561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:08.398561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:08.398561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:08.398561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:08.398561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:08.398561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:08.398561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:08.398561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:08.398561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:08.398561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:08.398561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:08.398561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:08.398561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:08.398561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:08.399712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:08.399712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:08.399712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:08.399712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:08.399712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:08.399712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:08.399712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:08.399712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:08.399712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:08.399712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:08.399712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:08.399712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:08.399712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:08.399712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:08.399712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:08.399712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:08.399712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:08.400636 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:08.400636 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:08.400636 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:08.400636 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:08.401335 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 389/813] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:08.402295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c9610-4bb3-4f20-bc74-e9416dc4115a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:08.410601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f49ea-76d3-4657-b2c0-bc3fc22afe88 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:08.446456 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d338c4-8a14-4ede-a8e1-61e3c5fa94ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:08.447403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d338c4-8a14-4ede-a8e1-61e3c5fa94ff None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:08.447715 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d338c4-8a14-4ede-a8e1-61e3c5fa94ff None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:08.448020 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d338c4-8a14-4ede-a8e1-61e3c5fa94ff None admin] PATH_INFO: `/v3/services/network` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:08.448684 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d338c4-8a14-4ede-a8e1-61e3c5fa94ff None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:08.450049 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d338c4-8a14-4ede-a8e1-61e3c5fa94ff None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:08.462784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-b7d338c4-8a14-4ede-a8e1-61e3c5fa94ff None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 06:32:08.462784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:08.462784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:32:08.462784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:32:08.462784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:32:08.462784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:32:08.462784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:32:08.462784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:08.462784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 06:32:08.462784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:08.462784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:08.462784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:08.462784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:08.462784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:08.462784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:08.462784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:08.462784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:08.464195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:08.464195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:08.464195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:08.464195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:08.464195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:08.464195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:08.464195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:32:08.464195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:32:08.464195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:32:08.464195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:32:08.464195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:08.464195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:08.464195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:08.464195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:08.464195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:08.464195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:08.465105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:08.465105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:08.465105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:08.465105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:08.465105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:08.465105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:08.465105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:08.465105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:08.465105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:08.465105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:08.465105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:32:08.465105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:08.465105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 06:32:08.465105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:08.465105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 425/814] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:32:08 2022] GET /identity/v3/services/network => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:08.470606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25316b-af46-4ab0-80b7-4818f8ab3eb9 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:08.471311 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25316b-af46-4ab0-80b7-4818f8ab3eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:08.471847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25316b-af46-4ab0-80b7-4818f8ab3eb9 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:08.476115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 426/815] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:08 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:08.480690 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25316b-af46-4ab0-80b7-4818f8ab3eb9 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:08.521535 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c9610-4bb3-4f20-bc74-e9416dc4115a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:08.556193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96603da2-2ff5-49ed-b07e-eca6e0b0186b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:08.556981 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96603da2-2ff5-49ed-b07e-eca6e0b0186b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:08.557315 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96603da2-2ff5-49ed-b07e-eca6e0b0186b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:08.557539 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96603da2-2ff5-49ed-b07e-eca6e0b0186b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:08.567378 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96603da2-2ff5-49ed-b07e-eca6e0b0186b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:08.569446 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96603da2-2ff5-49ed-b07e-eca6e0b0186b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:08.586741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-96603da2-2ff5-49ed-b07e-eca6e0b0186b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:08.586741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:08.586741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:08.586741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:08.586741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:08.586741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:08.586741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:08.586741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:08.586741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:08.586741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:08.586741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:08.586741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:08.586741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:08.586741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:08.586741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:08.587903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:08.587903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:08.587903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:08.587903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:08.587903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:08.587903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:08.587903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:08.587903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:08.587903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:08.587903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:08.587903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:08.587903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:08.587903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:08.587903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:08.587903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:08.587903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:08.587903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:08.588892 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:08.588892 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:08.588892 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:08.588892 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:08.588892 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 390/816] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:08.589176 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96603da2-2ff5-49ed-b07e-eca6e0b0186b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:08.598524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25316b-af46-4ab0-80b7-4818f8ab3eb9 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:08.633535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f11b2-336f-401c-93f7-223eb09b7e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:08.634207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f11b2-336f-401c-93f7-223eb09b7e14 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:08.634487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f11b2-336f-401c-93f7-223eb09b7e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:08.634761 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f11b2-336f-401c-93f7-223eb09b7e14 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:08.635494 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f11b2-336f-401c-93f7-223eb09b7e14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:08.635841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f11b2-336f-401c-93f7-223eb09b7e14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:08.637203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f11b2-336f-401c-93f7-223eb09b7e14 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:08.648701 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 427/817] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:08.650090 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c10cc-63e9-48e8-9874-37e1d8907289 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:08.650373 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c10cc-63e9-48e8-9874-37e1d8907289 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:08.650643 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c10cc-63e9-48e8-9874-37e1d8907289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:08.667890 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d88c10cc-63e9-48e8-9874-37e1d8907289 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:08.669071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d88c10cc-63e9-48e8-9874-37e1d8907289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:08.698298 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96603da2-2ff5-49ed-b07e-eca6e0b0186b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:08.732242 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc464042-e1d2-4723-89d0-108beee23e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:08.732439 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 428/818] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:08.733151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c10cc-63e9-48e8-9874-37e1d8907289 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:08.733369 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc464042-e1d2-4723-89d0-108beee23e19 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:08.733808 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc464042-e1d2-4723-89d0-108beee23e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:08.734270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc464042-e1d2-4723-89d0-108beee23e19 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:08.735110 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc464042-e1d2-4723-89d0-108beee23e19 None admin] RBAC: Adding query filter params (name=network) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:08.735559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc464042-e1d2-4723-89d0-108beee23e19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:08.736951 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc464042-e1d2-4723-89d0-108beee23e19 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:08.744826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 391/819] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 12 06:32:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:08.745687 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc464042-e1d2-4723-89d0-108beee23e19 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:08.836738 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c10cc-63e9-48e8-9874-37e1d8907289 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:08.847785 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc464042-e1d2-4723-89d0-108beee23e19 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:08.870838 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6eae47-d949-4fed-bb8c-4b736d6013c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:08.871516 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6eae47-d949-4fed-bb8c-4b736d6013c5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:08.871826 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6eae47-d949-4fed-bb8c-4b736d6013c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:08.872099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6eae47-d949-4fed-bb8c-4b736d6013c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:08.872824 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6eae47-d949-4fed-bb8c-4b736d6013c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:08.873126 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6eae47-d949-4fed-bb8c-4b736d6013c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:08.874485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6eae47-d949-4fed-bb8c-4b736d6013c5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:08.882097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90cec0-0e42-496c-9e26-52460a9c947a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:08.882890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90cec0-0e42-496c-9e26-52460a9c947a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:08.883170 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90cec0-0e42-496c-9e26-52460a9c947a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:08.883441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90cec0-0e42-496c-9e26-52460a9c947a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:08.890613 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 429/820] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:08.890613 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6eae47-d949-4fed-bb8c-4b736d6013c5 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:08.895341 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90cec0-0e42-496c-9e26-52460a9c947a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:08.896915 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90cec0-0e42-496c-9e26-52460a9c947a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:08.911053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-1b90cec0-0e42-496c-9e26-52460a9c947a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:08.911053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:08.911053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:08.911053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:08.911053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:08.911053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:08.911053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:08.911053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:08.911053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:08.911053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:08.911053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:08.911053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:08.911053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:32:08.911053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:32:08.911053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:32:08.912564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:32:08.912564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:08.912564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:08.912564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:08.912564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:08.912564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:08.912564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:08.912564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:08.912564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:08.912564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:08.912564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:08.912564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:08.912564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:08.912564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:08.912564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:08.912564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:08.912564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:08.913489 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:32:08.913489 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:32:08.913489 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:32:08.913489 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:32:08.913489 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:32:08.913489 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:32:08.913489 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:08.913489 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:08.917231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 392/821] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:32:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:08.917231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90cec0-0e42-496c-9e26-52460a9c947a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:09.000040 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6eae47-d949-4fed-bb8c-4b736d6013c5 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:09.016962 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90cec0-0e42-496c-9e26-52460a9c947a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:09.032096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf3ab6-ba13-494b-87be-5850c0628f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:09.032758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf3ab6-ba13-494b-87be-5850c0628f4e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:09.033037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf3ab6-ba13-494b-87be-5850c0628f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:09.033312 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf3ab6-ba13-494b-87be-5850c0628f4e None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:09.034012 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf3ab6-ba13-494b-87be-5850c0628f4e None admin] RBAC: Adding query filter params (type=network) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:09.034312 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf3ab6-ba13-494b-87be-5850c0628f4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:09.035652 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf3ab6-ba13-494b-87be-5850c0628f4e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:09.040629 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 430/822] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 12 06:32:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:09.041381 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf3ab6-ba13-494b-87be-5850c0628f4e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:09.055252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329b121-e57a-4b6e-afcc-9bbf4164b5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:09.056090 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329b121-e57a-4b6e-afcc-9bbf4164b5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:09.056378 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329b121-e57a-4b6e-afcc-9bbf4164b5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:09.056654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329b121-e57a-4b6e-afcc-9bbf4164b5c6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:09.057318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329b121-e57a-4b6e-afcc-9bbf4164b5c6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:09.058669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329b121-e57a-4b6e-afcc-9bbf4164b5c6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:09.073143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-b329b121-e57a-4b6e-afcc-9bbf4164b5c6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 06:32:09.073143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:09.073143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:32:09.073143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:32:09.073143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:32:09.073143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:32:09.073143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:32:09.073143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:09.073143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 06:32:09.073143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:09.073143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:09.073143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:09.073143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:09.073143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:09.073143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:09.073143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:09.074123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:09.074123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:09.074123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:09.074123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:09.074123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:09.074123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:09.074123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:09.074123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:32:09.074123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:32:09.074123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:32:09.074123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:32:09.074123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:09.074123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:09.074123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:09.074123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:09.074123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:09.075003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:09.075003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:09.075003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:09.075003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:09.075003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:09.075003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:09.075003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:09.075003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:09.075003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:09.075003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:09.075003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:09.075003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:32:09.075003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:09.075003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 06:32:09.075003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:09.079720 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 393/823] 10.222.0.25 () {56 vars in 1129 bytes} [Thu May 12 06:32:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:09.080089 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329b121-e57a-4b6e-afcc-9bbf4164b5c6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:09.137189 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf3ab6-ba13-494b-87be-5850c0628f4e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:09.169463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec9d6c-1050-4c29-8bda-b8efdcb26559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:09.170258 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec9d6c-1050-4c29-8bda-b8efdcb26559 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:09.170541 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec9d6c-1050-4c29-8bda-b8efdcb26559 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:09.170820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec9d6c-1050-4c29-8bda-b8efdcb26559 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:09.173573 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329b121-e57a-4b6e-afcc-9bbf4164b5c6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:09.177891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec9d6c-1050-4c29-8bda-b8efdcb26559 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:09.179386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec9d6c-1050-4c29-8bda-b8efdcb26559 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:09.194017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-3aec9d6c-1050-4c29-8bda-b8efdcb26559 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:09.194017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:09.194017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:09.194017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:09.194017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:09.194017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:09.194017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:09.194017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:09.194017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:09.194017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:09.194017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:09.194017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:09.194017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:32:09.194017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:32:09.194017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:32:09.194969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:32:09.194969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:09.194969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:09.194969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:09.194969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:09.194969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:09.194969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:09.194969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:09.194969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:09.194969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:09.194969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:09.194969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:09.194969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:09.194969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:09.194969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:09.194969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:09.194969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:09.195946 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:32:09.195946 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:32:09.195946 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:32:09.195946 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:32:09.195946 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:32:09.195946 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:32:09.195946 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:09.195946 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:09.195946 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 431/824] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:32:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:09.196446 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec9d6c-1050-4c29-8bda-b8efdcb26559 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:09.212788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3b6c7-99c2-46bb-b2f7-523ab2933be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:09.213472 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3b6c7-99c2-46bb-b2f7-523ab2933be2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:09.213720 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3b6c7-99c2-46bb-b2f7-523ab2933be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:09.213989 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3b6c7-99c2-46bb-b2f7-523ab2933be2 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:09.214777 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3b6c7-99c2-46bb-b2f7-523ab2933be2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:09.215085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3b6c7-99c2-46bb-b2f7-523ab2933be2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:09.216540 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3b6c7-99c2-46bb-b2f7-523ab2933be2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:09.234042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 394/825] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:32:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:09.234042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3b6c7-99c2-46bb-b2f7-523ab2933be2 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:09.300843 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec9d6c-1050-4c29-8bda-b8efdcb26559 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:09.334657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c7427-1ac0-4c74-bb65-38965bb2b81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:09.334870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3b6c7-99c2-46bb-b2f7-523ab2933be2 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:09.335322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c7427-1ac0-4c74-bb65-38965bb2b81c None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:09.335606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c7427-1ac0-4c74-bb65-38965bb2b81c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:09.335919 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c7427-1ac0-4c74-bb65-38965bb2b81c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:09.336661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c7427-1ac0-4c74-bb65-38965bb2b81c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:09.338006 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c7427-1ac0-4c74-bb65-38965bb2b81c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:09.367779 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1909274-5bb7-4353-bccd-6598233f8ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:09.368448 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1909274-5bb7-4353-bccd-6598233f8ffc None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:09.368731 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1909274-5bb7-4353-bccd-6598233f8ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:09.368997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1909274-5bb7-4353-bccd-6598233f8ffc None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:09.369735 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1909274-5bb7-4353-bccd-6598233f8ffc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:09.370041 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1909274-5bb7-4353-bccd-6598233f8ffc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:09.371404 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1909274-5bb7-4353-bccd-6598233f8ffc None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:09.375825 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 395/826] 10.222.0.25 () {56 vars in 1124 bytes} [Thu May 12 06:32:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:09.376590 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1909274-5bb7-4353-bccd-6598233f8ffc None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:09.434710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 432/827] 10.222.0.25 () {60 vars in 1144 bytes} [Thu May 12 06:32:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:32:09.434710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c7427-1ac0-4c74-bb65-38965bb2b81c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:09.496636 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1909274-5bb7-4353-bccd-6598233f8ffc None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:09.544002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9b804-2e22-4c79-829a-d3561e9b8903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:09.544762 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9b804-2e22-4c79-829a-d3561e9b8903 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:09.545049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9b804-2e22-4c79-829a-d3561e9b8903 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:09.545487 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9b804-2e22-4c79-829a-d3561e9b8903 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:09.546626 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9b804-2e22-4c79-829a-d3561e9b8903 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:09.546940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9b804-2e22-4c79-829a-d3561e9b8903 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:09.548436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9b804-2e22-4c79-829a-d3561e9b8903 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:09.566043 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 396/828] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:32:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:09.566350 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c7427-1ac0-4c74-bb65-38965bb2b81c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:09.567178 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9b804-2e22-4c79-829a-d3561e9b8903 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:09.605359 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e45861-6321-44fb-8dc8-5fdfbde5d5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:09.606556 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e45861-6321-44fb-8dc8-5fdfbde5d5ff None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:09.606980 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e45861-6321-44fb-8dc8-5fdfbde5d5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:09.607391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e45861-6321-44fb-8dc8-5fdfbde5d5ff None admin] PATH_INFO: `/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/7a25a3f2c9a148a1ae73e519070b190b/roles/ed3e6c61b2d14364a605282f0f1488ba` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:09.624532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e45861-6321-44fb-8dc8-5fdfbde5d5ff None admin] RBAC: Authorizing `identity:create_grant(project_id=57e1a8b143974111b0ba09d041b331d5, user_id=7a25a3f2c9a148a1ae73e519070b190b, role_id=ed3e6c61b2d14364a605282f0f1488ba)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:09.626222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e45861-6321-44fb-8dc8-5fdfbde5d5ff None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:09.681396 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9b804-2e22-4c79-829a-d3561e9b8903 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:09.702811 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 433/829] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:32:09 2022] PUT /identity/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/7a25a3f2c9a148a1ae73e519070b190b/roles/ed3e6c61b2d14364a605282f0f1488ba => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:32:09.704063 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e45861-6321-44fb-8dc8-5fdfbde5d5ff None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:09.723450 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b960f0-4bb6-4da9-8311-076053180221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:09.724571 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b960f0-4bb6-4da9-8311-076053180221 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:09.725033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b960f0-4bb6-4da9-8311-076053180221 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:09.725564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b960f0-4bb6-4da9-8311-076053180221 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:09.726568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b960f0-4bb6-4da9-8311-076053180221 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:09.727069 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b960f0-4bb6-4da9-8311-076053180221 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:09.728618 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b960f0-4bb6-4da9-8311-076053180221 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:09.734787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 397/830] 10.222.0.25 () {56 vars in 1124 bytes} [Thu May 12 06:32:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:09.740483 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b960f0-4bb6-4da9-8311-076053180221 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:09.825076 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e45861-6321-44fb-8dc8-5fdfbde5d5ff None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:09.849556 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b960f0-4bb6-4da9-8311-076053180221 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:09.867160 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ddbb04-fed6-4bbd-9d2d-547488e56ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:09.868246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddbb04-fed6-4bbd-9d2d-547488e56ecf None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:09.868731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddbb04-fed6-4bbd-9d2d-547488e56ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:09.869199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddbb04-fed6-4bbd-9d2d-547488e56ecf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:09.870337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ddbb04-fed6-4bbd-9d2d-547488e56ecf None admin] RBAC: Adding query filter params (role.id=5e6a73052f3b4ee7829ecb858925e5ca, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=bbcd54a927bf46f183b50fbda677868d) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:09.870846 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ddbb04-fed6-4bbd-9d2d-547488e56ecf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:09.872700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ddbb04-fed6-4bbd-9d2d-547488e56ecf None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:09.887262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 434/831] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:32:09 2022] GET /identity/v3/role_assignments?user.id=bbcd54a927bf46f183b50fbda677868d&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=5e6a73052f3b4ee7829ecb858925e5ca => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:09.890952 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab30c6e-3121-4ddb-a316-06b61f4fe242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:09.891639 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab30c6e-3121-4ddb-a316-06b61f4fe242 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:09.891971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab30c6e-3121-4ddb-a316-06b61f4fe242 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:09.892247 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab30c6e-3121-4ddb-a316-06b61f4fe242 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:09.893304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab30c6e-3121-4ddb-a316-06b61f4fe242 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:09.894729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab30c6e-3121-4ddb-a316-06b61f4fe242 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:09.977306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 398/832] 10.222.0.25 () {60 vars in 1144 bytes} [Thu May 12 06:32:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:32:10.382326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d74b0-adcd-41db-8af6-97cfdf412940 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:10.382950 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d74b0-adcd-41db-8af6-97cfdf412940 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:10.382950 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d74b0-adcd-41db-8af6-97cfdf412940 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:10.384500 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 435/833] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:10.390006 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f973ec-d83d-40db-992b-ebb318795ded None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:10.390420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f973ec-d83d-40db-992b-ebb318795ded None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:10.390598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f973ec-d83d-40db-992b-ebb318795ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:10.407905 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e3f973ec-d83d-40db-992b-ebb318795ded None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:10.409097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e3f973ec-d83d-40db-992b-ebb318795ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:10.483107 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 399/834] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:32:10.507468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d74b0-adcd-41db-8af6-97cfdf412940 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:10.612232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d74b0-adcd-41db-8af6-97cfdf412940 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:10.646878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7517107-fcdc-4a02-a23a-9e039de7efc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:10.648044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7517107-fcdc-4a02-a23a-9e039de7efc7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:10.648535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7517107-fcdc-4a02-a23a-9e039de7efc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:10.649009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7517107-fcdc-4a02-a23a-9e039de7efc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:10.659174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7517107-fcdc-4a02-a23a-9e039de7efc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:32:10.667447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-d7517107-fcdc-4a02-a23a-9e039de7efc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:32:10.667447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:10.667447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:10.667447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:10.667447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:10.667447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:10.667447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:10.667447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:10.667447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:10.667447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:10.667447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:10.667447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:10.667447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:32:10.667447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:32:10.667447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:32:10.667447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:32:10.668478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:32:10.668478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:32:10.668478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:32:10.668478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:32:10.668478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:10.668478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:10.668478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:10.668478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:10.668478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:10.668478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:10.668478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:10.668478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:10.668478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:10.668478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:10.668478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:10.668478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:10.669376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:10.669376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:10.669376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:10.669376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:10.669376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:32:10.669376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:32:10.669376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:32:10.669376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:32:10.669376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:32:10.669376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:32:10.669376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:32:10.669376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:10.672116 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 436/835] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:32:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:10.678200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f973ec-d83d-40db-992b-ebb318795ded None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:10.779674 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f973ec-d83d-40db-992b-ebb318795ded None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:10.814670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a39a1-35f3-417b-863e-ea6b7c323ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:10.815339 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a39a1-35f3-417b-863e-ea6b7c323ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:10.815624 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a39a1-35f3-417b-863e-ea6b7c323ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:10.815934 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a39a1-35f3-417b-863e-ea6b7c323ca7 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:10.816686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a39a1-35f3-417b-863e-ea6b7c323ca7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:10.816994 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a39a1-35f3-417b-863e-ea6b7c323ca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:10.818931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a39a1-35f3-417b-863e-ea6b7c323ca7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:10.827492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 400/836] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:32:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:10.832962 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7517107-fcdc-4a02-a23a-9e039de7efc7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:10.936625 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7517107-fcdc-4a02-a23a-9e039de7efc7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:10.968926 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ead960-5de7-45ab-9f8b-433f62079545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:10.969728 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ead960-5de7-45ab-9f8b-433f62079545 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:10.970006 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ead960-5de7-45ab-9f8b-433f62079545 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:10.970277 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ead960-5de7-45ab-9f8b-433f62079545 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:10.981511 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ead960-5de7-45ab-9f8b-433f62079545 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:10.982945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ead960-5de7-45ab-9f8b-433f62079545 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:11.000850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-e9ead960-5de7-45ab-9f8b-433f62079545 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:11.000850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:11.000850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:11.000850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:11.000850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:11.000850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:11.000850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:11.000850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:11.000850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:11.000850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:11.000850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:11.000850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:11.000850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:11.000850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:11.000850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:11.001822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:11.001822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:11.001822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:11.001822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:11.001822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:11.001822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:11.001822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:11.001822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:11.001822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:11.001822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:11.001822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:11.001822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:11.001822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:11.001822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:11.001822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:11.001822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:11.001822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:11.002749 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:11.002749 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:11.002749 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:11.002749 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:11.002749 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 437/837] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:11.009428 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a39a1-35f3-417b-863e-ea6b7c323ca7 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:11.113330 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a39a1-35f3-417b-863e-ea6b7c323ca7 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:11.148080 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a6abf-6438-4ead-9f99-710fc60e9419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:11.149082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a6abf-6438-4ead-9f99-710fc60e9419 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:11.149590 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a6abf-6438-4ead-9f99-710fc60e9419 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:11.150076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a6abf-6438-4ead-9f99-710fc60e9419 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:11.151033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a6abf-6438-4ead-9f99-710fc60e9419 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:11.151552 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a6abf-6438-4ead-9f99-710fc60e9419 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:11.153150 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a6abf-6438-4ead-9f99-710fc60e9419 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:11.167258 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 401/838] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:11.173312 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ead960-5de7-45ab-9f8b-433f62079545 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:11.281686 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ead960-5de7-45ab-9f8b-433f62079545 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:11.315506 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7d844-e86d-4e2d-ab25-7e9797242c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:11.316704 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7d844-e86d-4e2d-ab25-7e9797242c51 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:11.317194 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7d844-e86d-4e2d-ab25-7e9797242c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:11.317751 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7d844-e86d-4e2d-ab25-7e9797242c51 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:11.325973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7d844-e86d-4e2d-ab25-7e9797242c51 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:11.327651 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7d844-e86d-4e2d-ab25-7e9797242c51 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:11.342264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-45f7d844-e86d-4e2d-ab25-7e9797242c51 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 06:32:11.342264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:11.342264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:11.342264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:11.342264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:11.342264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:11.342264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:11.342264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:11.342264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:11.342264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:11.342264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:11.342264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:11.342264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:32:11.342264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:32:11.342264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:32:11.342264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:32:11.343304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:11.343304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:11.343304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:32:11.343304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:11.343304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:32:11.343304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:11.343304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:11.343304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:11.343304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:11.343304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:11.343304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:11.343304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:11.343304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:11.343304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:11.343304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:11.343304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:11.343304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:11.343304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:11.344322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:11.344322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:11.344322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:32:11.344322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:32:11.344322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:32:11.344322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:32:11.344322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:32:11.344322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:32:11.344322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 06:32:11.344322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:11.346929 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 438/839] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:32:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:11.352858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a6abf-6438-4ead-9f99-710fc60e9419 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:11.453820 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a6abf-6438-4ead-9f99-710fc60e9419 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:11.490158 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e4f0d-8e0f-4cba-b8df-7df408860097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:11.491212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e4f0d-8e0f-4cba-b8df-7df408860097 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:11.491756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e4f0d-8e0f-4cba-b8df-7df408860097 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:11.492248 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e4f0d-8e0f-4cba-b8df-7df408860097 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:11.493292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e4f0d-8e0f-4cba-b8df-7df408860097 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:11.493812 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e4f0d-8e0f-4cba-b8df-7df408860097 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:11.495441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e4f0d-8e0f-4cba-b8df-7df408860097 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:11.513584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 402/840] 10.222.0.25 () {56 vars in 1135 bytes} [Thu May 12 06:32:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:11.519448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7d844-e86d-4e2d-ab25-7e9797242c51 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:11.622657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7d844-e86d-4e2d-ab25-7e9797242c51 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:11.656534 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e42e3d-9696-4443-b094-3e76258de3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:11.657191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e42e3d-9696-4443-b094-3e76258de3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:11.657469 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e42e3d-9696-4443-b094-3e76258de3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:11.657741 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e42e3d-9696-4443-b094-3e76258de3d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:11.725798 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e42e3d-9696-4443-b094-3e76258de3d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:11.727245 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e42e3d-9696-4443-b094-3e76258de3d2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:11.826866 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 439/841] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:32:11 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 06:32:11.832798 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e4f0d-8e0f-4cba-b8df-7df408860097 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:11.937509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e4f0d-8e0f-4cba-b8df-7df408860097 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:11.973161 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787d1c8-c463-4848-9724-d0b60bd1f97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:11.974367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787d1c8-c463-4848-9724-d0b60bd1f97c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:11.977108 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787d1c8-c463-4848-9724-d0b60bd1f97c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:11.977108 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787d1c8-c463-4848-9724-d0b60bd1f97c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:11.986073 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787d1c8-c463-4848-9724-d0b60bd1f97c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:11.987855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787d1c8-c463-4848-9724-d0b60bd1f97c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:12.007271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-4787d1c8-c463-4848-9724-d0b60bd1f97c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:12.007271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:12.007271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:12.007271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:12.007271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:12.007271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:12.007271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:12.007271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:12.007271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:12.007271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:12.007271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:12.007271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:12.007271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:12.007271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:12.007271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:12.008308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:12.008308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:12.008308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:12.008308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:12.008308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:12.008308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:12.008308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:12.008308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:12.008308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:12.008308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:12.008308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:12.008308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:12.008308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:12.008308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:12.008308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:12.008308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:12.008308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:12.009219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:12.009219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:12.009219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:12.009219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:12.009219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 403/842] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:12.014802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e42e3d-9696-4443-b094-3e76258de3d2 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:12.018636 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a07e0-1341-4415-aa87-e47de17b66e5 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:12.018968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a07e0-1341-4415-aa87-e47de17b66e5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:12.019197 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a07e0-1341-4415-aa87-e47de17b66e5 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:12.022147 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 404/843] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:12.029864 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2628de4-a0b9-4e70-99af-cadad4d1a202 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:12.029864 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2628de4-a0b9-4e70-99af-cadad4d1a202 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:12.030161 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2628de4-a0b9-4e70-99af-cadad4d1a202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:12.048163 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b2628de4-a0b9-4e70-99af-cadad4d1a202 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:12.049488 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b2628de4-a0b9-4e70-99af-cadad4d1a202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:12.121036 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e42e3d-9696-4443-b094-3e76258de3d2 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:12.124804 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 405/844] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:32:12.142028 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2628de4-a0b9-4e70-99af-cadad4d1a202 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:12.160808 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62688426-0ea7-4f7a-a7de-c243ce568456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:12.161938 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62688426-0ea7-4f7a-a7de-c243ce568456 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:12.162422 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62688426-0ea7-4f7a-a7de-c243ce568456 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:12.162899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62688426-0ea7-4f7a-a7de-c243ce568456 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:12.163874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62688426-0ea7-4f7a-a7de-c243ce568456 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:12.164761 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62688426-0ea7-4f7a-a7de-c243ce568456 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:12.166331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62688426-0ea7-4f7a-a7de-c243ce568456 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:12.179082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 440/845] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:12.184250 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62688426-0ea7-4f7a-a7de-c243ce568456 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:12.255128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2628de4-a0b9-4e70-99af-cadad4d1a202 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:12.284405 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62688426-0ea7-4f7a-a7de-c243ce568456 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:12.288830 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bf4b0-136d-4311-9e62-42a988015155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:12.289901 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bf4b0-136d-4311-9e62-42a988015155 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:12.290183 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bf4b0-136d-4311-9e62-42a988015155 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:12.290457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bf4b0-136d-4311-9e62-42a988015155 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:12.300471 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bf4b0-136d-4311-9e62-42a988015155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:32:12.308799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-b55bf4b0-136d-4311-9e62-42a988015155 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 06:32:12.308799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:12.308799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:12.308799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:12.308799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:12.308799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:12.308799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:12.308799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:12.308799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:12.308799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:12.308799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:12.308799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:12.308799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:32:12.308799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:32:12.308799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:32:12.308799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:32:12.309965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:32:12.309965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:32:12.309965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:32:12.309965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:32:12.309965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:12.309965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:12.309965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:12.309965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:12.309965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:12.309965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:12.309965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:12.309965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:12.309965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:12.309965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:12.309965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:12.309965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:12.311014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:12.311014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:12.311014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:12.311014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:12.311014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:32:12.311014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:32:12.311014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:32:12.311014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:32:12.311014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:32:12.311014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:32:12.311014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 06:32:12.311014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:12.314717 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 406/846] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:32:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:12.316043 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac8ff4-b116-4a7f-bdf4-3118c4e99f92 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:12.316335 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac8ff4-b116-4a7f-bdf4-3118c4e99f92 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:12.316611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac8ff4-b116-4a7f-bdf4-3118c4e99f92 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:12.318033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 407/847] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:12.319368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac8ff4-b116-4a7f-bdf4-3118c4e99f92 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:12.320721 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02411eed-e0d6-4a9c-832f-3e25e72a91df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:12.321576 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02411eed-e0d6-4a9c-832f-3e25e72a91df None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:12.321921 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02411eed-e0d6-4a9c-832f-3e25e72a91df None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:12.322448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02411eed-e0d6-4a9c-832f-3e25e72a91df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:12.329199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02411eed-e0d6-4a9c-832f-3e25e72a91df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:12.330629 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02411eed-e0d6-4a9c-832f-3e25e72a91df None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:12.345566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-02411eed-e0d6-4a9c-832f-3e25e72a91df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:12.345566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:12.345566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:12.345566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:12.345566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:12.345566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:12.345566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:12.345566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:12.345566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:12.345566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:12.345566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:12.345566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:12.345566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:32:12.345566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:32:12.345566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:32:12.346632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:32:12.346632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:12.346632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:12.346632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:12.346632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:12.346632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:12.346632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:12.346632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:12.346632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:12.346632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:12.346632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:12.346632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:12.346632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:12.346632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:12.346632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:12.346632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:12.346632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:12.347886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:32:12.347886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:32:12.347886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:32:12.347886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:32:12.347886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:32:12.347886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:32:12.347886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:12.347886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:12.347886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 441/848] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:32:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:12.348510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036424f-b8f8-4e5c-87a3-7bfe72a90092 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:12.348510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036424f-b8f8-4e5c-87a3-7bfe72a90092 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:12.350431 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036424f-b8f8-4e5c-87a3-7bfe72a90092 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:12.354804 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 442/849] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:12.354804 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be36a0-347f-45d1-9f3f-115deb1c3020 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:12.354804 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be36a0-347f-45d1-9f3f-115deb1c3020 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:12.354804 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be36a0-347f-45d1-9f3f-115deb1c3020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:12.367837 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f0be36a0-347f-45d1-9f3f-115deb1c3020 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:12.369001 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f0be36a0-347f-45d1-9f3f-115deb1c3020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:12.427488 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac8ff4-b116-4a7f-bdf4-3118c4e99f92 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:12.431147 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 443/850] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:12.431990 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be36a0-347f-45d1-9f3f-115deb1c3020 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:12.460047 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970976c9-9b7c-4223-aa6e-e745906d3115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:12.460718 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970976c9-9b7c-4223-aa6e-e745906d3115 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:12.461001 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970976c9-9b7c-4223-aa6e-e745906d3115 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:12.461277 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970976c9-9b7c-4223-aa6e-e745906d3115 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:12.462024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970976c9-9b7c-4223-aa6e-e745906d3115 None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:12.462331 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970976c9-9b7c-4223-aa6e-e745906d3115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:12.463710 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970976c9-9b7c-4223-aa6e-e745906d3115 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:12.472821 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 408/851] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 12 06:32:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:12.474375 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5a3c2-17d2-407b-aabb-f5ffd917c890 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:12.474659 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5a3c2-17d2-407b-aabb-f5ffd917c890 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:12.474928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5a3c2-17d2-407b-aabb-f5ffd917c890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:12.490564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2ed5a3c2-17d2-407b-aabb-f5ffd917c890 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:12.491747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2ed5a3c2-17d2-407b-aabb-f5ffd917c890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:12.528808 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be36a0-347f-45d1-9f3f-115deb1c3020 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:12.552983 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 409/852] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:12.553809 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5a3c2-17d2-407b-aabb-f5ffd917c890 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:12.561306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b03cb5-30ff-4d23-ba1c-54ecc1c5925a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:12.561970 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b03cb5-30ff-4d23-ba1c-54ecc1c5925a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:12.562254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b03cb5-30ff-4d23-ba1c-54ecc1c5925a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:12.562527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b03cb5-30ff-4d23-ba1c-54ecc1c5925a None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:12.563316 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b03cb5-30ff-4d23-ba1c-54ecc1c5925a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:12.563624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b03cb5-30ff-4d23-ba1c-54ecc1c5925a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:12.565167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b03cb5-30ff-4d23-ba1c-54ecc1c5925a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:12.577679 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 444/853] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:32:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:12.578672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b03cb5-30ff-4d23-ba1c-54ecc1c5925a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:12.651057 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5a3c2-17d2-407b-aabb-f5ffd917c890 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:12.669671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b03cb5-30ff-4d23-ba1c-54ecc1c5925a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:12.682756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5501a-f612-4191-87f7-c4d14917e172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:12.683557 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5501a-f612-4191-87f7-c4d14917e172 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:12.683869 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5501a-f612-4191-87f7-c4d14917e172 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:12.684143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5501a-f612-4191-87f7-c4d14917e172 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:12.684796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e5501a-f612-4191-87f7-c4d14917e172 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:12.686146 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e5501a-f612-4191-87f7-c4d14917e172 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:12.699436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-c5e5501a-f612-4191-87f7-c4d14917e172 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 06:32:12.699436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:12.699436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:32:12.699436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:32:12.699436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:32:12.699436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:32:12.699436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:32:12.699436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:12.699436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 06:32:12.699436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:12.699436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:12.699436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:12.699436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:12.699436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:12.699436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:12.699436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:12.700431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:12.700431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:12.700431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:12.700431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:12.700431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:12.700431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:12.700431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:12.700431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:32:12.700431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:32:12.700431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:32:12.700431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:32:12.700431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:12.700431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:12.700431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:12.700431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:12.700431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:12.701305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:12.701305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:12.701305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:12.701305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:12.701305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:12.701305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:12.701305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:12.701305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:12.701305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:12.701305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:12.701305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:12.701305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:32:12.701305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:12.701305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 06:32:12.701305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:12.701305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 410/854] 10.222.0.25 () {56 vars in 1132 bytes} [Thu May 12 06:32:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:12.702558 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1b9ce-af4c-40e4-ab0c-141d53b14ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:12.702661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5501a-f612-4191-87f7-c4d14917e172 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:12.702745 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1b9ce-af4c-40e4-ab0c-141d53b14ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:12.702745 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1b9ce-af4c-40e4-ab0c-141d53b14ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:12.702745 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1b9ce-af4c-40e4-ab0c-141d53b14ab8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:12.715312 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1b9ce-af4c-40e4-ab0c-141d53b14ab8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:12.716754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1b9ce-af4c-40e4-ab0c-141d53b14ab8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:12.733230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-1da1b9ce-af4c-40e4-ab0c-141d53b14ab8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:12.733230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:12.733230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:12.733230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:12.733230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:12.733230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:12.733230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:12.733230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:12.733230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:12.733230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:12.733230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:12.733230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:12.733230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:12.733230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:12.733230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:12.734121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:12.734121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:12.734121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:12.734121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:12.734121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:12.734121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:12.734121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:12.734121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:12.734121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:12.734121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:12.734121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:12.734121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:12.734121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:12.734121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:12.734121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:12.734121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:12.734121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:12.735140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:12.735140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:12.735140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:12.735140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:12.735140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 445/855] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:12.735923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1b9ce-af4c-40e4-ab0c-141d53b14ab8 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:12.802714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5501a-f612-4191-87f7-c4d14917e172 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:12.827434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1b9ce-af4c-40e4-ab0c-141d53b14ab8 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:12.834018 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec19137-ecec-4cbf-9514-11187f758c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:12.834802 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec19137-ecec-4cbf-9514-11187f758c60 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:12.835083 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec19137-ecec-4cbf-9514-11187f758c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:12.835357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec19137-ecec-4cbf-9514-11187f758c60 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:12.836042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec19137-ecec-4cbf-9514-11187f758c60 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:12.837400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec19137-ecec-4cbf-9514-11187f758c60 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:12.849478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-6ec19137-ecec-4cbf-9514-11187f758c60 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 06:32:12.849478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:12.849478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:32:12.849478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:32:12.849478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:32:12.849478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:32:12.849478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:32:12.849478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:12.849478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 06:32:12.849478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:12.849478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:12.849478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:12.849478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:12.849478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:12.849478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:12.849478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:12.849478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:12.850577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:12.850577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:12.850577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:12.850577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:12.850577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:12.850577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:12.850577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:32:12.850577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:32:12.850577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:32:12.850577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:32:12.850577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:12.850577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:12.850577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:12.850577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:12.850577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:12.850577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:12.851424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:12.851424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:12.851424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:12.851424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:12.851424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:12.851424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:12.851424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:12.851424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:12.851424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:12.851424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:12.851424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:32:12.851424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:12.851424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 06:32:12.851424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:12.851424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 411/856] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:32:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:12.852273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec19137-ecec-4cbf-9514-11187f758c60 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:12.864851 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745bffb-3681-496e-84c2-12c7daa58f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:12.865594 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745bffb-3681-496e-84c2-12c7daa58f7a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:12.865877 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745bffb-3681-496e-84c2-12c7daa58f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:12.866150 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745bffb-3681-496e-84c2-12c7daa58f7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:12.866974 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745bffb-3681-496e-84c2-12c7daa58f7a None admin] RBAC: Adding query filter params (role.id=5e6a73052f3b4ee7829ecb858925e5ca, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=a9882820f88349cb8fa2e3d457b19959) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:12.867278 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745bffb-3681-496e-84c2-12c7daa58f7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:12.868710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745bffb-3681-496e-84c2-12c7daa58f7a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:12.874310 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 446/857] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:32:12 2022] GET /identity/v3/role_assignments?user.id=a9882820f88349cb8fa2e3d457b19959&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=5e6a73052f3b4ee7829ecb858925e5ca => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:12.875071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745bffb-3681-496e-84c2-12c7daa58f7a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:12.959056 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec19137-ecec-4cbf-9514-11187f758c60 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:12.983238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745bffb-3681-496e-84c2-12c7daa58f7a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:13.002581 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d933d-18d8-4376-9791-860f5d79c63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:13.003383 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d933d-18d8-4376-9791-860f5d79c63f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:13.003788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d933d-18d8-4376-9791-860f5d79c63f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:13.004152 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d933d-18d8-4376-9791-860f5d79c63f None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:13.005059 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d933d-18d8-4376-9791-860f5d79c63f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:13.005450 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d933d-18d8-4376-9791-860f5d79c63f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:13.007173 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d933d-18d8-4376-9791-860f5d79c63f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:13.012299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 412/858] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 12 06:32:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:13.017697 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d933d-18d8-4376-9791-860f5d79c63f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:13.018336 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919c505-b377-4d01-9279-9fca5ec484b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:13.019021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919c505-b377-4d01-9279-9fca5ec484b2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:13.019301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919c505-b377-4d01-9279-9fca5ec484b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:13.019576 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919c505-b377-4d01-9279-9fca5ec484b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:13.020349 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919c505-b377-4d01-9279-9fca5ec484b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:13.021184 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919c505-b377-4d01-9279-9fca5ec484b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:13.022571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919c505-b377-4d01-9279-9fca5ec484b2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:13.035162 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 447/859] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:13.035162 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919c505-b377-4d01-9279-9fca5ec484b2 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:13.132717 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d933d-18d8-4376-9791-860f5d79c63f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:13.144535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919c505-b377-4d01-9279-9fca5ec484b2 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:13.165699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0e2fe-4cca-4266-951a-a2ebef74d750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:13.166399 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0e2fe-4cca-4266-951a-a2ebef74d750 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:13.166687 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0e2fe-4cca-4266-951a-a2ebef74d750 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:13.166955 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0e2fe-4cca-4266-951a-a2ebef74d750 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:13.167659 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0e2fe-4cca-4266-951a-a2ebef74d750 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:13.167998 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0e2fe-4cca-4266-951a-a2ebef74d750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:13.169347 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0e2fe-4cca-4266-951a-a2ebef74d750 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:13.177933 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 413/860] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:32:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:13.177933 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0e2fe-4cca-4266-951a-a2ebef74d750 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:13.182788 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e41a40-5298-4300-b056-c18aca8cf8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:13.183533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e41a40-5298-4300-b056-c18aca8cf8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:13.183910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e41a40-5298-4300-b056-c18aca8cf8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:13.184254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e41a40-5298-4300-b056-c18aca8cf8d9 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:13.185044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e41a40-5298-4300-b056-c18aca8cf8d9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:13.185426 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e41a40-5298-4300-b056-c18aca8cf8d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:13.186846 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e41a40-5298-4300-b056-c18aca8cf8d9 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:13.199891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 448/861] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 12 06:32:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:13.200960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e41a40-5298-4300-b056-c18aca8cf8d9 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:13.296393 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0e2fe-4cca-4266-951a-a2ebef74d750 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:13.315612 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e41a40-5298-4300-b056-c18aca8cf8d9 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:13.333211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658133b-a0ce-4e7c-bf14-c841e75d02ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:13.334342 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658133b-a0ce-4e7c-bf14-c841e75d02ae None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:13.334776 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658133b-a0ce-4e7c-bf14-c841e75d02ae None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:13.335206 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658133b-a0ce-4e7c-bf14-c841e75d02ae None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:13.344826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658133b-a0ce-4e7c-bf14-c841e75d02ae None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:13.346920 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658133b-a0ce-4e7c-bf14-c841e75d02ae None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:13.352257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756aab3c-1358-4fa7-90f4-29df67ca1e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:13.353013 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756aab3c-1358-4fa7-90f4-29df67ca1e14 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:13.353295 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756aab3c-1358-4fa7-90f4-29df67ca1e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:13.353565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756aab3c-1358-4fa7-90f4-29df67ca1e14 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:13.354382 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756aab3c-1358-4fa7-90f4-29df67ca1e14 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:13.354953 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756aab3c-1358-4fa7-90f4-29df67ca1e14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:13.356138 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756aab3c-1358-4fa7-90f4-29df67ca1e14 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:13.365970 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 449/862] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:32:13 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:13.368797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-6658133b-a0ce-4e7c-bf14-c841e75d02ae None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 06:32:13.368797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:13.368797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:13.368797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:13.368797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:13.368797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:13.368797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:13.368797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:13.368797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:13.368797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:13.368797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:13.368797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:13.368797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:32:13.368797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:32:13.368797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:32:13.368797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:32:13.369846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:13.369846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:13.369846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:32:13.369846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:13.369846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:32:13.369846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:13.369846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:13.369846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:13.369846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:13.369846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:13.369846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:13.369846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:13.369846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:13.369846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:13.369846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:13.369846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:13.369846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:13.369846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:13.370943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:13.370943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:13.370943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:32:13.370943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:32:13.370943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:32:13.370943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:32:13.370943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:32:13.370943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:32:13.370943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 06:32:13.370943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:13.370943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 414/863] 10.222.0.25 () {56 vars in 1117 bytes} [Thu May 12 06:32:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:13.376203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756aab3c-1358-4fa7-90f4-29df67ca1e14 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:13.485521 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756aab3c-1358-4fa7-90f4-29df67ca1e14 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:13.523719 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a0d02-4f22-4b6a-baec-eb08fbf2af82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:13.524429 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a0d02-4f22-4b6a-baec-eb08fbf2af82 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:13.524718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a0d02-4f22-4b6a-baec-eb08fbf2af82 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:13.524995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a0d02-4f22-4b6a-baec-eb08fbf2af82 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:13.525858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a0d02-4f22-4b6a-baec-eb08fbf2af82 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:13.526171 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a0d02-4f22-4b6a-baec-eb08fbf2af82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:13.527631 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a0d02-4f22-4b6a-baec-eb08fbf2af82 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:13.547708 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 450/864] 10.222.0.25 () {56 vars in 1149 bytes} [Thu May 12 06:32:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:13.553545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658133b-a0ce-4e7c-bf14-c841e75d02ae None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:13.659811 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658133b-a0ce-4e7c-bf14-c841e75d02ae None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:13.693688 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9b810-ae98-4c9e-a4a8-c4c1c730f9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:13.694433 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9b810-ae98-4c9e-a4a8-c4c1c730f9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:13.694787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9b810-ae98-4c9e-a4a8-c4c1c730f9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:13.695135 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9b810-ae98-4c9e-a4a8-c4c1c730f9b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:13.764447 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9b810-ae98-4c9e-a4a8-c4c1c730f9b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:13.766018 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9b810-ae98-4c9e-a4a8-c4c1c730f9b7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:13.866879 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 415/865] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:32:13 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 06:32:13.872420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a0d02-4f22-4b6a-baec-eb08fbf2af82 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:13.977757 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a0d02-4f22-4b6a-baec-eb08fbf2af82 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:14.017408 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3fceb-016e-40c1-a6df-2ac7526dcc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:14.018129 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3fceb-016e-40c1-a6df-2ac7526dcc9b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:14.018406 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3fceb-016e-40c1-a6df-2ac7526dcc9b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:14.018675 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3fceb-016e-40c1-a6df-2ac7526dcc9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:14.029973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3fceb-016e-40c1-a6df-2ac7526dcc9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:14.031444 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3fceb-016e-40c1-a6df-2ac7526dcc9b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:14.054772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-a2a3fceb-016e-40c1-a6df-2ac7526dcc9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:14.054772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:14.054772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:14.054772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:14.054772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:14.054772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:14.054772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:14.054772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:14.054772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:14.054772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:14.054772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:14.054772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:14.054772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:14.054772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:14.054772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:14.055931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:14.055931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:14.055931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:14.055931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:14.055931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:14.055931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:14.055931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:14.055931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:14.055931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:14.055931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:14.055931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:14.055931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:14.055931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:14.055931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:14.055931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:14.055931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:14.055931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:14.056995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:14.056995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:14.056995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:14.056995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:14.058873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 451/866] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:14.064028 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9b810-ae98-4c9e-a4a8-c4c1c730f9b7 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:14.165308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9b810-ae98-4c9e-a4a8-c4c1c730f9b7 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:14.199276 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ee6d7-3459-4f5c-a80a-92a47860af1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:14.199968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ee6d7-3459-4f5c-a80a-92a47860af1d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:14.200290 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ee6d7-3459-4f5c-a80a-92a47860af1d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:14.200569 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ee6d7-3459-4f5c-a80a-92a47860af1d None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:14.201286 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ee6d7-3459-4f5c-a80a-92a47860af1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:14.201587 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ee6d7-3459-4f5c-a80a-92a47860af1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:14.202937 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ee6d7-3459-4f5c-a80a-92a47860af1d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:14.214434 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 416/867] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:14.219776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3fceb-016e-40c1-a6df-2ac7526dcc9b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:14.317413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3fceb-016e-40c1-a6df-2ac7526dcc9b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:14.351129 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3277f0-3a1e-4c7b-ad21-bda5ffb781be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:14.352240 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3277f0-3a1e-4c7b-ad21-bda5ffb781be None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:14.352716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3277f0-3a1e-4c7b-ad21-bda5ffb781be None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:14.353208 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3277f0-3a1e-4c7b-ad21-bda5ffb781be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:14.360082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3277f0-3a1e-4c7b-ad21-bda5ffb781be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:14.361702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3277f0-3a1e-4c7b-ad21-bda5ffb781be None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:14.376163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-2e3277f0-3a1e-4c7b-ad21-bda5ffb781be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:14.376163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:14.376163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:14.376163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:14.376163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:14.376163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:14.376163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:14.376163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:14.376163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:14.376163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:14.376163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:14.376163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:14.376163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:32:14.376163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:32:14.376163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:32:14.377046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:32:14.377046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:14.377046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:14.377046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:14.377046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:14.377046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:14.377046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:14.377046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:14.377046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:14.377046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:14.377046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:14.377046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:14.377046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:14.377046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:14.377046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:14.377046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:14.377046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:14.377943 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:32:14.377943 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:32:14.377943 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:32:14.377943 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:32:14.377943 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:32:14.377943 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:32:14.377943 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:14.377943 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:14.380136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 452/868] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:32:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:14.385424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ee6d7-3459-4f5c-a80a-92a47860af1d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:14.487714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ee6d7-3459-4f5c-a80a-92a47860af1d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:14.521694 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f55663-f811-4e3b-ba51-8629c92eb851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:14.522354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f55663-f811-4e3b-ba51-8629c92eb851 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:14.522629 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f55663-f811-4e3b-ba51-8629c92eb851 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:14.522899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f55663-f811-4e3b-ba51-8629c92eb851 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:14.523680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f55663-f811-4e3b-ba51-8629c92eb851 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:14.524013 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f55663-f811-4e3b-ba51-8629c92eb851 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:14.525431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f55663-f811-4e3b-ba51-8629c92eb851 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:14.538151 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 417/869] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:32:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:14.544441 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3277f0-3a1e-4c7b-ad21-bda5ffb781be None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:14.647937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3277f0-3a1e-4c7b-ad21-bda5ffb781be None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:14.682530 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ca01d-5a8c-46e8-ae6b-1206c03ac459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:14.683277 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ca01d-5a8c-46e8-ae6b-1206c03ac459 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:14.683610 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ca01d-5a8c-46e8-ae6b-1206c03ac459 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:14.683970 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ca01d-5a8c-46e8-ae6b-1206c03ac459 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:14.684808 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ca01d-5a8c-46e8-ae6b-1206c03ac459 None admin] RBAC: Adding query filter params (role.id=ed3e6c61b2d14364a605282f0f1488ba, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=7a25a3f2c9a148a1ae73e519070b190b) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:14.685115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ca01d-5a8c-46e8-ae6b-1206c03ac459 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:14.686694 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ca01d-5a8c-46e8-ae6b-1206c03ac459 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:14.693818 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 453/870] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:32:14 2022] GET /identity/v3/role_assignments?user.id=7a25a3f2c9a148a1ae73e519070b190b&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=ed3e6c61b2d14364a605282f0f1488ba => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:15.153092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ecf2f-dfa8-488c-a46a-e7a316ad1b10 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:15.153642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ecf2f-dfa8-488c-a46a-e7a316ad1b10 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:15.153642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ecf2f-dfa8-488c-a46a-e7a316ad1b10 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:15.155243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 418/871] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:15.160735 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88bed8-b5a4-44b3-9465-a7d7861f2dff None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:15.161026 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88bed8-b5a4-44b3-9465-a7d7861f2dff None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:15.161840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88bed8-b5a4-44b3-9465-a7d7861f2dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:15.180123 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-bf88bed8-b5a4-44b3-9465-a7d7861f2dff None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:15.181308 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-bf88bed8-b5a4-44b3-9465-a7d7861f2dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:15.248026 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 454/872] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:15.269063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ecf2f-dfa8-488c-a46a-e7a316ad1b10 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:15.377219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ecf2f-dfa8-488c-a46a-e7a316ad1b10 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:15.415709 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2b629-b3bc-4964-b676-de20f5ff99ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:15.416540 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2b629-b3bc-4964-b676-de20f5ff99ee None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:15.416819 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2b629-b3bc-4964-b676-de20f5ff99ee None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:15.417096 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2b629-b3bc-4964-b676-de20f5ff99ee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:15.417769 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2b629-b3bc-4964-b676-de20f5ff99ee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:15.419158 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2b629-b3bc-4964-b676-de20f5ff99ee None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:15.432686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-fab2b629-b3bc-4964-b676-de20f5ff99ee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 06:32:15.432686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:15.432686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:32:15.432686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:32:15.432686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:32:15.432686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:32:15.432686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:32:15.432686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:15.432686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 06:32:15.432686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:15.432686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:15.432686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:15.432686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:15.432686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:15.432686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:15.432686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:15.432686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:15.435367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:15.435367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:15.435367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:15.435367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:15.435367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:15.435367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:15.435367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:32:15.435367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:32:15.435367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:32:15.435367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:32:15.435367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:15.435367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:15.435367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:15.435367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:15.435367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:15.435367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:15.436462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:15.436462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:15.436462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:15.436462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:15.436462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:15.436462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:15.436462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:15.436462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:15.436462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:15.436462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:15.436462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:32:15.436462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:15.436462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 06:32:15.436462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:15.436462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 419/873] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 12 06:32:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:15.440320 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88bed8-b5a4-44b3-9465-a7d7861f2dff None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:15.543958 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88bed8-b5a4-44b3-9465-a7d7861f2dff None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:15.578389 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b09537-63f9-4ef2-af9c-aa398424d5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:15.579062 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b09537-63f9-4ef2-af9c-aa398424d5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:15.579341 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b09537-63f9-4ef2-af9c-aa398424d5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:15.579612 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b09537-63f9-4ef2-af9c-aa398424d5a5 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:15.580350 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b09537-63f9-4ef2-af9c-aa398424d5a5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:15.580652 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b09537-63f9-4ef2-af9c-aa398424d5a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:15.582011 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b09537-63f9-4ef2-af9c-aa398424d5a5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:15.588199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 455/874] 10.222.0.25 () {56 vars in 1122 bytes} [Thu May 12 06:32:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:15.593677 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2b629-b3bc-4964-b676-de20f5ff99ee None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:15.602449 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39aa0e-332a-4908-9151-70cc00722a38 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:15.602449 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39aa0e-332a-4908-9151-70cc00722a38 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:15.602449 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39aa0e-332a-4908-9151-70cc00722a38 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:15.602979 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 456/875] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:32:15.608140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512dcc9-a833-4bcc-8da3-ae114ee0fc4c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:15.608586 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512dcc9-a833-4bcc-8da3-ae114ee0fc4c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:15.609009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512dcc9-a833-4bcc-8da3-ae114ee0fc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:15.625875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-2512dcc9-a833-4bcc-8da3-ae114ee0fc4c None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:15.627290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2512dcc9-a833-4bcc-8da3-ae114ee0fc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:15.706965 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 457/876] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:15.706965 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21eaa52-9149-498d-bc35-337779553a6b None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:15.706965 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21eaa52-9149-498d-bc35-337779553a6b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:15.706965 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21eaa52-9149-498d-bc35-337779553a6b None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:15.706965 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 458/877] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:15.714095 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8897a1-87b0-4dda-a967-cd2589d829aa None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:15.714095 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8897a1-87b0-4dda-a967-cd2589d829aa None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:15.714095 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8897a1-87b0-4dda-a967-cd2589d829aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:15.716852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2b629-b3bc-4964-b676-de20f5ff99ee None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:15.732183 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-5f8897a1-87b0-4dda-a967-cd2589d829aa None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:15.733352 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5f8897a1-87b0-4dda-a967-cd2589d829aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:15.750593 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f69cf3-28fc-46e1-a9bd-b2aa7ff1a0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:15.751249 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f69cf3-28fc-46e1-a9bd-b2aa7ff1a0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:15.751529 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f69cf3-28fc-46e1-a9bd-b2aa7ff1a0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:15.751832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f69cf3-28fc-46e1-a9bd-b2aa7ff1a0b3 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:15.752538 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f69cf3-28fc-46e1-a9bd-b2aa7ff1a0b3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:15.752840 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f69cf3-28fc-46e1-a9bd-b2aa7ff1a0b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:15.754193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f69cf3-28fc-46e1-a9bd-b2aa7ff1a0b3 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:15.764113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 420/878] 10.222.0.25 () {56 vars in 1122 bytes} [Thu May 12 06:32:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:15.765453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f69cf3-28fc-46e1-a9bd-b2aa7ff1a0b3 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:15.809483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 459/879] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:32:15.828325 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8897a1-87b0-4dda-a967-cd2589d829aa None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:15.884681 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f69cf3-28fc-46e1-a9bd-b2aa7ff1a0b3 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:15.924146 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ad522-9060-4ba6-b451-b9786aa2a71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:15.924824 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ad522-9060-4ba6-b451-b9786aa2a71a None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:15.925103 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ad522-9060-4ba6-b451-b9786aa2a71a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:15.925372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ad522-9060-4ba6-b451-b9786aa2a71a None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:15.926113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ad522-9060-4ba6-b451-b9786aa2a71a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:15.928090 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ad522-9060-4ba6-b451-b9786aa2a71a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:15.956639 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8897a1-87b0-4dda-a967-cd2589d829aa None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:16.002358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf29f7-1e97-4ea8-b5fd-3a47a780895a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:16.003024 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf29f7-1e97-4ea8-b5fd-3a47a780895a None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:16.003312 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf29f7-1e97-4ea8-b5fd-3a47a780895a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:16.003593 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf29f7-1e97-4ea8-b5fd-3a47a780895a None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:16.004344 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf29f7-1e97-4ea8-b5fd-3a47a780895a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:16.005736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf29f7-1e97-4ea8-b5fd-3a47a780895a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:16.020069 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 421/880] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 12 06:32:15 2022] POST /identity/v3/services => generated 269 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:32:16.075227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 460/881] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 12 06:32:15 2022] POST /identity/v3/services => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:32:17.077092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c52ad9-72e4-42a9-bb04-2f1c731338ad None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:17.077599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c52ad9-72e4-42a9-bb04-2f1c731338ad None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:17.077676 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c52ad9-72e4-42a9-bb04-2f1c731338ad None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:17.079117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 422/882] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:17.084981 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6ad96-fee4-4c84-85d2-c7b747aed852 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:17.085778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6ad96-fee4-4c84-85d2-c7b747aed852 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:17.086248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6ad96-fee4-4c84-85d2-c7b747aed852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:17.103347 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-14f6ad96-fee4-4c84-85d2-c7b747aed852 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:17.104860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-14f6ad96-fee4-4c84-85d2-c7b747aed852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:17.182498 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 461/883] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:32:17.206542 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c52ad9-72e4-42a9-bb04-2f1c731338ad None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:17.310657 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c52ad9-72e4-42a9-bb04-2f1c731338ad None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:17.343184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbb40e-f98a-4a63-a07f-9548c733199b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:17.344024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbb40e-f98a-4a63-a07f-9548c733199b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:17.344356 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbb40e-f98a-4a63-a07f-9548c733199b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:17.344637 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbb40e-f98a-4a63-a07f-9548c733199b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:17.355945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbb40e-f98a-4a63-a07f-9548c733199b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:32:17.364285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-7cfbb40e-f98a-4a63-a07f-9548c733199b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 06:32:17.364285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:17.364285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:17.364285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:17.364285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:17.364285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:17.364285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:17.364285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:17.364285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:17.364285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:17.364285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:17.364285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:17.364285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:32:17.364285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:32:17.364285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:32:17.364285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:32:17.365750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:32:17.365750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:32:17.365750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:32:17.365750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:32:17.365750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:17.365750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:17.365750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:17.365750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:17.365750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:17.365750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:17.365750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:17.365750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:17.365750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:17.365750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:17.365750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:17.365750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:17.366611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:17.366611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:17.366611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:17.366611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:17.366611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:32:17.366611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:32:17.366611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:32:17.366611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:32:17.366611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:32:17.366611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:32:17.366611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 06:32:17.366611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:17.366611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 423/884] 10.222.0.25 () {56 vars in 1120 bytes} [Thu May 12 06:32:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:17.373727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6ad96-fee4-4c84-85d2-c7b747aed852 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:17.475810 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6ad96-fee4-4c84-85d2-c7b747aed852 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:17.509136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc0bfe-027f-4a81-a8d5-a3bf81405bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:17.510146 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc0bfe-027f-4a81-a8d5-a3bf81405bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:17.510647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc0bfe-027f-4a81-a8d5-a3bf81405bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:17.511116 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc0bfe-027f-4a81-a8d5-a3bf81405bb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:17.512093 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc0bfe-027f-4a81-a8d5-a3bf81405bb8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:17.512618 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc0bfe-027f-4a81-a8d5-a3bf81405bb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:17.514167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc0bfe-027f-4a81-a8d5-a3bf81405bb8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:17.523428 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 462/885] 10.222.0.25 () {56 vars in 1115 bytes} [Thu May 12 06:32:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:17.532756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbb40e-f98a-4a63-a07f-9548c733199b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:17.635176 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbb40e-f98a-4a63-a07f-9548c733199b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:17.669472 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24381fc0-936d-4aa3-b650-f05dd994712e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:17.670263 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24381fc0-936d-4aa3-b650-f05dd994712e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:17.670544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24381fc0-936d-4aa3-b650-f05dd994712e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:17.670816 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24381fc0-936d-4aa3-b650-f05dd994712e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:17.681436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24381fc0-936d-4aa3-b650-f05dd994712e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:17.682883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24381fc0-936d-4aa3-b650-f05dd994712e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:17.700834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-24381fc0-936d-4aa3-b650-f05dd994712e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:17.700834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:17.700834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:17.700834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:17.700834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:17.700834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:17.700834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:17.700834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:17.700834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:17.700834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:17.700834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:17.700834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:17.700834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:17.700834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:17.700834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:17.701745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:17.701745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:17.701745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:17.701745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:17.701745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:17.701745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:17.701745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:17.701745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:17.701745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:17.701745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:17.701745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:17.701745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:17.701745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:17.701745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:17.701745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:17.701745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:17.701745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:17.702642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:17.702642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:17.702642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:17.702642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:17.702642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 424/886] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:17.709068 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc0bfe-027f-4a81-a8d5-a3bf81405bb8 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:17.808966 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc0bfe-027f-4a81-a8d5-a3bf81405bb8 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:17.847871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac74898-1cce-43ad-a129-92016969da63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:17.849062 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac74898-1cce-43ad-a129-92016969da63 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:17.849542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac74898-1cce-43ad-a129-92016969da63 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:17.850009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac74898-1cce-43ad-a129-92016969da63 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:17.850949 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac74898-1cce-43ad-a129-92016969da63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:17.851477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac74898-1cce-43ad-a129-92016969da63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:17.853084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac74898-1cce-43ad-a129-92016969da63 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:17.866272 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 463/887] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:17.872024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24381fc0-936d-4aa3-b650-f05dd994712e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:17.974185 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24381fc0-936d-4aa3-b650-f05dd994712e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:18.008160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a31df-7372-4840-a2e7-5ba9c10f1757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:18.008978 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a31df-7372-4840-a2e7-5ba9c10f1757 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:18.009255 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a31df-7372-4840-a2e7-5ba9c10f1757 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:18.009522 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a31df-7372-4840-a2e7-5ba9c10f1757 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:18.014136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff154a17-4258-4107-855b-dc13bdb94fe5 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:18.014664 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff154a17-4258-4107-855b-dc13bdb94fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:18.015153 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff154a17-4258-4107-855b-dc13bdb94fe5 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:18.017006 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 464/888] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:32:18.017383 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a31df-7372-4840-a2e7-5ba9c10f1757 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:18.018830 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a31df-7372-4840-a2e7-5ba9c10f1757 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:18.024927 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c892068-d374-4356-aba2-ee4c7f034ac3 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:18.025442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c892068-d374-4356-aba2-ee4c7f034ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:18.025913 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c892068-d374-4356-aba2-ee4c7f034ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:18.033527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-3b3a31df-7372-4840-a2e7-5ba9c10f1757 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 06:32:18.033527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:18.033527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:18.033527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:18.033527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:18.033527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:18.033527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:18.033527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:18.033527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:18.033527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:18.033527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:18.033527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:18.033527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:32:18.033527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:32:18.033527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:32:18.033527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:32:18.034475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:18.034475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:18.034475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:32:18.034475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:18.034475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:32:18.034475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:18.034475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:18.034475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:18.034475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:18.034475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:18.034475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:18.034475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:18.034475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:18.034475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:18.034475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:18.034475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:18.034475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:18.034475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:18.035439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:18.035439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:18.035439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:32:18.035439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:32:18.035439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:32:18.035439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:32:18.035439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:32:18.035439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:32:18.035439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 06:32:18.035439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:18.035439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 425/889] 10.222.0.25 () {56 vars in 1117 bytes} [Thu May 12 06:32:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:18.042572 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a31df-7372-4840-a2e7-5ba9c10f1757 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:18.050808 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-7c892068-d374-4356-aba2-ee4c7f034ac3 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:18.052489 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7c892068-d374-4356-aba2-ee4c7f034ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:18.125946 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 465/890] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:32:18.142803 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a31df-7372-4840-a2e7-5ba9c10f1757 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:18.145124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c892068-d374-4356-aba2-ee4c7f034ac3 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:18.179698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1da277-db3c-4dcf-8d89-74b69315347a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:18.180396 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1da277-db3c-4dcf-8d89-74b69315347a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:18.180676 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1da277-db3c-4dcf-8d89-74b69315347a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:18.180948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1da277-db3c-4dcf-8d89-74b69315347a None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:18.181819 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1da277-db3c-4dcf-8d89-74b69315347a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:18.182129 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1da277-db3c-4dcf-8d89-74b69315347a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:18.183606 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1da277-db3c-4dcf-8d89-74b69315347a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:18.202902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 426/891] 10.222.0.25 () {56 vars in 1149 bytes} [Thu May 12 06:32:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:18.209558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1da277-db3c-4dcf-8d89-74b69315347a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:18.256958 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c892068-d374-4356-aba2-ee4c7f034ac3 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:18.291627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c848bb-a422-4513-8018-2c7b1b158f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:18.292718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c848bb-a422-4513-8018-2c7b1b158f51 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:18.293265 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c848bb-a422-4513-8018-2c7b1b158f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:18.293734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c848bb-a422-4513-8018-2c7b1b158f51 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:18.294659 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c848bb-a422-4513-8018-2c7b1b158f51 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:18.296352 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c848bb-a422-4513-8018-2c7b1b158f51 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:18.311185 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1da277-db3c-4dcf-8d89-74b69315347a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:18.346352 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d904f48-b1b0-4f6d-aa64-fc908e3a995b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:18.347004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d904f48-b1b0-4f6d-aa64-fc908e3a995b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:18.347284 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d904f48-b1b0-4f6d-aa64-fc908e3a995b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:18.347561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d904f48-b1b0-4f6d-aa64-fc908e3a995b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:18.380381 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 466/892] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 12 06:32:18 2022] POST /identity/v3/services => generated 241 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:32:18.389466 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e7585-05dd-467e-81a3-90c6fa85d54a None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:18.389776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e7585-05dd-467e-81a3-90c6fa85d54a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:18.390837 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e7585-05dd-467e-81a3-90c6fa85d54a None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:18.396703 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 467/893] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:18 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:18.400109 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30091c-5325-474b-b2c6-4123aa4ec947 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:18.400109 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30091c-5325-474b-b2c6-4123aa4ec947 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:18.400388 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30091c-5325-474b-b2c6-4123aa4ec947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:18.419414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-cd30091c-5325-474b-b2c6-4123aa4ec947 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:18.420686 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-cd30091c-5325-474b-b2c6-4123aa4ec947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:18.428117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d904f48-b1b0-4f6d-aa64-fc908e3a995b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:18.430315 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d904f48-b1b0-4f6d-aa64-fc908e3a995b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:18.497209 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 468/894] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:18.498580 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e79a6-820e-4322-9c24-44e465032323 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:18.498865 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e79a6-820e-4322-9c24-44e465032323 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:18.499142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e79a6-820e-4322-9c24-44e465032323 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:18.500699 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 469/895] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:18.506388 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0992be-0319-486f-bfdd-59629b091b66 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:18.506674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0992be-0319-486f-bfdd-59629b091b66 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:18.506956 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0992be-0319-486f-bfdd-59629b091b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:18.524634 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-9b0992be-0319-486f-bfdd-59629b091b66 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:18.525766 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9b0992be-0319-486f-bfdd-59629b091b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:18.558168 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 427/896] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:32:18 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 06:32:18.558168 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d904f48-b1b0-4f6d-aa64-fc908e3a995b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:18.604599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 470/897] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:18.605783 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0992be-0319-486f-bfdd-59629b091b66 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:18.660812 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d904f48-b1b0-4f6d-aa64-fc908e3a995b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:18.697768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0519be8-753a-4358-ac26-ac62eb841f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:18.698856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0519be8-753a-4358-ac26-ac62eb841f73 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:18.699313 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0519be8-753a-4358-ac26-ac62eb841f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:18.699791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0519be8-753a-4358-ac26-ac62eb841f73 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:18.700612 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0519be8-753a-4358-ac26-ac62eb841f73 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:18.702159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0519be8-753a-4358-ac26-ac62eb841f73 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:18.708773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0992be-0319-486f-bfdd-59629b091b66 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:18.716214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-e0519be8-753a-4358-ac26-ac62eb841f73 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 06:32:18.716214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:18.716214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:32:18.716214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:32:18.716214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:32:18.716214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:32:18.716214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:32:18.716214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:18.716214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 06:32:18.716214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:18.716214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:18.716214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:18.716214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:18.716214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:18.716214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:18.716214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:18.717346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:18.717346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:18.717346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:18.717346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:18.717346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:18.717346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:18.717346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:18.717346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:32:18.717346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:32:18.717346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:32:18.717346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:32:18.717346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:18.717346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:18.717346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:18.717346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:18.717346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:18.718373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:18.718373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:18.718373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:18.718373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:18.718373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:18.718373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:18.718373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:18.718373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:18.718373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:18.718373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:18.718373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:18.718373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:32:18.718373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:18.718373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 06:32:18.718373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:18.720596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 428/898] 10.222.0.25 () {56 vars in 1132 bytes} [Thu May 12 06:32:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:18.721492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0519be8-753a-4358-ac26-ac62eb841f73 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:18.744218 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a56bb-336f-4ee0-b86f-28f8f5d96feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:18.745016 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a56bb-336f-4ee0-b86f-28f8f5d96feb None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:18.745297 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a56bb-336f-4ee0-b86f-28f8f5d96feb None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:18.745563 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a56bb-336f-4ee0-b86f-28f8f5d96feb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:18.756089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a56bb-336f-4ee0-b86f-28f8f5d96feb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:18.757525 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a56bb-336f-4ee0-b86f-28f8f5d96feb None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:18.775078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-1b7a56bb-336f-4ee0-b86f-28f8f5d96feb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:18.775078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:18.775078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:18.775078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:18.775078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:18.775078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:18.775078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:18.775078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:18.775078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:18.775078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:18.775078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:18.775078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:18.775078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:18.775078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:18.775078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:18.776269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:18.776269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:18.776269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:18.776269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:18.776269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:18.776269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:18.776269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:18.776269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:18.776269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:18.776269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:18.776269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:18.776269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:18.776269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:18.776269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:18.776269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:18.776269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:18.776269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:18.777176 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:18.777176 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:18.777176 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:18.777176 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:18.777176 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 471/899] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:18.777528 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a56bb-336f-4ee0-b86f-28f8f5d96feb None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:18.826350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0519be8-753a-4358-ac26-ac62eb841f73 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:18.859482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1323b-0899-4158-b4fe-a56cc097d828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:18.860297 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1323b-0899-4158-b4fe-a56cc097d828 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:18.860583 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1323b-0899-4158-b4fe-a56cc097d828 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:18.860854 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1323b-0899-4158-b4fe-a56cc097d828 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:18.861511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1323b-0899-4158-b4fe-a56cc097d828 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:18.862875 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1323b-0899-4158-b4fe-a56cc097d828 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:18.874714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-caf1323b-0899-4158-b4fe-a56cc097d828 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 06:32:18.874714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:18.874714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:32:18.874714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:32:18.874714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:32:18.874714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:32:18.874714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:32:18.874714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:18.874714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 06:32:18.874714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:18.874714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:18.874714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:18.874714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:18.874714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:18.874714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:18.874714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:18.874714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:18.881456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:18.881456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:18.881456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:18.881456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:18.881456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:18.881456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:18.881456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:32:18.881456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:32:18.881456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:32:18.881456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:32:18.881456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:18.881456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:18.881456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:18.881456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:18.881456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:18.881456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:18.882620 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:18.882620 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:18.882620 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:18.882620 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:18.882620 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:18.882620 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:18.882620 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:18.882620 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:18.882620 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:18.882620 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:18.882620 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:32:18.882620 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:18.882620 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 06:32:18.882620 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:18.883518 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a56bb-336f-4ee0-b86f-28f8f5d96feb None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:18.883616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 429/900] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:32:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:18.883616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1323b-0899-4158-b4fe-a56cc097d828 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:18.916949 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb231291-be97-4673-9c94-0d15fdf58c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:18.917862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb231291-be97-4673-9c94-0d15fdf58c09 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:18.918292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb231291-be97-4673-9c94-0d15fdf58c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:18.918739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb231291-be97-4673-9c94-0d15fdf58c09 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:18.919597 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb231291-be97-4673-9c94-0d15fdf58c09 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:18.920075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb231291-be97-4673-9c94-0d15fdf58c09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:18.921591 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb231291-be97-4673-9c94-0d15fdf58c09 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:18.931493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 472/901] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 12 06:32:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:18.932602 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb231291-be97-4673-9c94-0d15fdf58c09 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:18.977454 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1323b-0899-4158-b4fe-a56cc097d828 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:19.013874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67b391-2d63-40ab-94ef-af3627a85703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:19.014615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67b391-2d63-40ab-94ef-af3627a85703 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:19.014897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67b391-2d63-40ab-94ef-af3627a85703 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:19.015167 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67b391-2d63-40ab-94ef-af3627a85703 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:19.015913 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67b391-2d63-40ab-94ef-af3627a85703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:19.016213 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67b391-2d63-40ab-94ef-af3627a85703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:19.017553 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67b391-2d63-40ab-94ef-af3627a85703 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:19.029547 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 430/902] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:19.030228 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67b391-2d63-40ab-94ef-af3627a85703 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:19.042638 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb231291-be97-4673-9c94-0d15fdf58c09 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:19.077786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4221ee6-449e-4121-9bad-1357e85c5445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:19.078618 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4221ee6-449e-4121-9bad-1357e85c5445 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:19.078903 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4221ee6-449e-4121-9bad-1357e85c5445 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:19.079181 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4221ee6-449e-4121-9bad-1357e85c5445 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:19.079918 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4221ee6-449e-4121-9bad-1357e85c5445 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:19.080225 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4221ee6-449e-4121-9bad-1357e85c5445 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:19.081579 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4221ee6-449e-4121-9bad-1357e85c5445 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:19.087130 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 473/903] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:32:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:19.087946 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4221ee6-449e-4121-9bad-1357e85c5445 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:19.129371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67b391-2d63-40ab-94ef-af3627a85703 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:19.162490 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5a38f-606b-44bb-8f51-f284b8b6511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:19.163155 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5a38f-606b-44bb-8f51-f284b8b6511b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:19.163432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5a38f-606b-44bb-8f51-f284b8b6511b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:19.163717 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5a38f-606b-44bb-8f51-f284b8b6511b None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:19.164693 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5a38f-606b-44bb-8f51-f284b8b6511b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:19.164992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5a38f-606b-44bb-8f51-f284b8b6511b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:19.166351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5a38f-606b-44bb-8f51-f284b8b6511b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:19.175759 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 431/904] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 12 06:32:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:19.175759 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5a38f-606b-44bb-8f51-f284b8b6511b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:19.188292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4221ee6-449e-4121-9bad-1357e85c5445 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:19.223747 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb392e1-195b-4c4a-8e12-5fdfb36b4692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:19.224669 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb392e1-195b-4c4a-8e12-5fdfb36b4692 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:19.224953 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb392e1-195b-4c4a-8e12-5fdfb36b4692 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:19.225223 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb392e1-195b-4c4a-8e12-5fdfb36b4692 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:19.231874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb392e1-195b-4c4a-8e12-5fdfb36b4692 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:19.233305 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb392e1-195b-4c4a-8e12-5fdfb36b4692 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:19.248539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-cdb392e1-195b-4c4a-8e12-5fdfb36b4692 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:19.248539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:19.248539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:19.248539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:19.248539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:19.248539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:19.248539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:19.248539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:19.248539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:19.248539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:19.248539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:19.248539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:19.248539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:32:19.248539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:32:19.248539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:32:19.249646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:32:19.249646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:19.249646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:19.249646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:19.249646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:19.249646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:19.249646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:19.249646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:19.249646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:19.249646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:19.249646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:19.249646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:19.249646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:19.249646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:19.249646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:19.249646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:19.249646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:19.250606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:32:19.250606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:32:19.250606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:32:19.250606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:32:19.250606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:32:19.250606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:32:19.250606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:19.250606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:19.250606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 474/905] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:32:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:19.251113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb392e1-195b-4c4a-8e12-5fdfb36b4692 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:19.271553 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5a38f-606b-44bb-8f51-f284b8b6511b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:19.305619 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219067a-db68-442a-a46a-e284244c5b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:19.306208 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219067a-db68-442a-a46a-e284244c5b69 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:19.306491 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219067a-db68-442a-a46a-e284244c5b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:19.306764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219067a-db68-442a-a46a-e284244c5b69 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:19.307466 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219067a-db68-442a-a46a-e284244c5b69 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:19.307804 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219067a-db68-442a-a46a-e284244c5b69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:19.309164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219067a-db68-442a-a46a-e284244c5b69 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:19.318493 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 432/906] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:32:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:19.318493 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219067a-db68-442a-a46a-e284244c5b69 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:19.349311 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb392e1-195b-4c4a-8e12-5fdfb36b4692 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:19.382738 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f3928-2263-4010-8e23-0d7d31ebc07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:19.383390 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f3928-2263-4010-8e23-0d7d31ebc07b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:19.383669 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f3928-2263-4010-8e23-0d7d31ebc07b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:19.383968 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f3928-2263-4010-8e23-0d7d31ebc07b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:19.384761 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f3928-2263-4010-8e23-0d7d31ebc07b None admin] RBAC: Adding query filter params (interface=public, service_id=f9b03eb408064d6aa239a50a3addf8b7, region_id=RegionOne) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:19.385065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f3928-2263-4010-8e23-0d7d31ebc07b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:19.386412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f3928-2263-4010-8e23-0d7d31ebc07b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:19.398095 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 475/907] 10.222.0.25 () {56 vars in 1251 bytes} [Thu May 12 06:32:19 2022] GET /identity/v3/endpoints?service_id=f9b03eb408064d6aa239a50a3addf8b7&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:19.398095 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f3928-2263-4010-8e23-0d7d31ebc07b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:19.416877 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219067a-db68-442a-a46a-e284244c5b69 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:19.451945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd62ead-97cc-45a3-b656-bc4ae9541aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:19.452611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd62ead-97cc-45a3-b656-bc4ae9541aee None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:19.452893 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd62ead-97cc-45a3-b656-bc4ae9541aee None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:19.453165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd62ead-97cc-45a3-b656-bc4ae9541aee None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:19.453955 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd62ead-97cc-45a3-b656-bc4ae9541aee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:19.454407 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd62ead-97cc-45a3-b656-bc4ae9541aee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:19.455861 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd62ead-97cc-45a3-b656-bc4ae9541aee None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:19.467806 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 433/908] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:32:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:19.469087 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd62ead-97cc-45a3-b656-bc4ae9541aee None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:19.499488 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f3928-2263-4010-8e23-0d7d31ebc07b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:19.535760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb043f4-2ea4-4049-bbe0-7c210879f143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:19.537080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb043f4-2ea4-4049-bbe0-7c210879f143 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:19.537456 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb043f4-2ea4-4049-bbe0-7c210879f143 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:19.537825 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb043f4-2ea4-4049-bbe0-7c210879f143 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:19.538714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb043f4-2ea4-4049-bbe0-7c210879f143 None admin] RBAC: Adding query filter params (interface=public, service_id=f4b7a93c04e44430bcae2e0e30a88fd6, region_id=RegionOne) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:19.539392 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb043f4-2ea4-4049-bbe0-7c210879f143 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:19.540878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb043f4-2ea4-4049-bbe0-7c210879f143 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:19.550333 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 476/909] 10.222.0.25 () {56 vars in 1251 bytes} [Thu May 12 06:32:19 2022] GET /identity/v3/endpoints?service_id=f4b7a93c04e44430bcae2e0e30a88fd6&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:19.550333 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb043f4-2ea4-4049-bbe0-7c210879f143 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:19.578394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd62ead-97cc-45a3-b656-bc4ae9541aee None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:19.618740 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c69b0-d5fa-4010-a5bf-478d52bd152f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:19.619405 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c69b0-d5fa-4010-a5bf-478d52bd152f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:19.619677 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c69b0-d5fa-4010-a5bf-478d52bd152f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:19.619986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c69b0-d5fa-4010-a5bf-478d52bd152f None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:19.620672 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c69b0-d5fa-4010-a5bf-478d52bd152f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:19.622030 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c69b0-d5fa-4010-a5bf-478d52bd152f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:19.628226 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 434/910] 10.222.0.25 () {56 vars in 1087 bytes} [Thu May 12 06:32:19 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:32:19.628991 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c69b0-d5fa-4010-a5bf-478d52bd152f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:19.669311 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb043f4-2ea4-4049-bbe0-7c210879f143 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:19.706397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc58e7d-7bd6-4205-85d6-4d27dbf7b642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:19.707469 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc58e7d-7bd6-4205-85d6-4d27dbf7b642 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:19.708013 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc58e7d-7bd6-4205-85d6-4d27dbf7b642 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:19.708535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc58e7d-7bd6-4205-85d6-4d27dbf7b642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:19.709605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc58e7d-7bd6-4205-85d6-4d27dbf7b642 None admin] RBAC: Adding query filter params (role.id=b675985f8bdd471ab51fb4fc2daff01e, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=7a25a3f2c9a148a1ae73e519070b190b) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:19.710130 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc58e7d-7bd6-4205-85d6-4d27dbf7b642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:19.711841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc58e7d-7bd6-4205-85d6-4d27dbf7b642 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:19.718720 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 477/911] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:32:19 2022] GET /identity/v3/role_assignments?user.id=7a25a3f2c9a148a1ae73e519070b190b&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=b675985f8bdd471ab51fb4fc2daff01e => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:19.742956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c69b0-d5fa-4010-a5bf-478d52bd152f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:19.788443 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa552f-7c4e-4805-b7cd-d5cbd379f5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:19.789379 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa552f-7c4e-4805-b7cd-d5cbd379f5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:19.789658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa552f-7c4e-4805-b7cd-d5cbd379f5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:19.789925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa552f-7c4e-4805-b7cd-d5cbd379f5c0 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:19.790624 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa552f-7c4e-4805-b7cd-d5cbd379f5c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:19.792168 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa552f-7c4e-4805-b7cd-d5cbd379f5c0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:19.799736 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 435/912] 10.222.0.25 () {56 vars in 1087 bytes} [Thu May 12 06:32:19 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:32:20.635569 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61008c-0cb2-41d2-9d4d-050239662ab8 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:20.636142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61008c-0cb2-41d2-9d4d-050239662ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:20.636142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61008c-0cb2-41d2-9d4d-050239662ab8 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:20.637760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 478/913] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:20.643241 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e695054-01a3-4d07-a10c-93ccf9f4bcfd None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:20.643666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e695054-01a3-4d07-a10c-93ccf9f4bcfd None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:20.643788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e695054-01a3-4d07-a10c-93ccf9f4bcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:20.661334 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1e695054-01a3-4d07-a10c-93ccf9f4bcfd None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:20.662580 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1e695054-01a3-4d07-a10c-93ccf9f4bcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:20.729809 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 436/914] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:32:20.751927 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61008c-0cb2-41d2-9d4d-050239662ab8 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:20.857471 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61008c-0cb2-41d2-9d4d-050239662ab8 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:20.891495 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d6c55-0ede-470e-9e72-23e5cbe948ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:20.892261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d6c55-0ede-470e-9e72-23e5cbe948ca None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:20.892544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d6c55-0ede-470e-9e72-23e5cbe948ca None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:20.892819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d6c55-0ede-470e-9e72-23e5cbe948ca None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:20.893482 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d6c55-0ede-470e-9e72-23e5cbe948ca None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:20.894840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d6c55-0ede-470e-9e72-23e5cbe948ca None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:20.907849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-3b7d6c55-0ede-470e-9e72-23e5cbe948ca None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 06:32:20.907849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:20.907849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:32:20.907849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:32:20.907849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:32:20.907849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:32:20.907849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:32:20.907849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:20.907849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 06:32:20.907849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:20.907849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:20.907849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:20.907849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:20.907849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:20.907849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:20.907849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:20.907849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:20.908881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:20.908881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:20.908881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:20.908881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:20.908881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:20.908881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:20.908881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:32:20.908881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:32:20.908881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:32:20.908881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:32:20.908881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:20.908881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:20.908881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:20.908881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:20.908881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:20.908881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:20.909733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:20.909733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:20.909733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:20.909733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:20.909733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:20.909733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:20.909733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:20.909733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:20.909733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:20.909733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:20.909733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:32:20.909733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:20.909733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 06:32:20.909733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:20.909733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 479/915] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 12 06:32:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:20.915642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e695054-01a3-4d07-a10c-93ccf9f4bcfd None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:21.023261 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e695054-01a3-4d07-a10c-93ccf9f4bcfd None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:21.064369 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93f075-00b5-43bd-89c8-1e73cd0a1a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:21.065100 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93f075-00b5-43bd-89c8-1e73cd0a1a44 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:21.065382 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93f075-00b5-43bd-89c8-1e73cd0a1a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:21.065653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93f075-00b5-43bd-89c8-1e73cd0a1a44 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:21.066368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93f075-00b5-43bd-89c8-1e73cd0a1a44 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:21.066673 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93f075-00b5-43bd-89c8-1e73cd0a1a44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:21.070245 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93f075-00b5-43bd-89c8-1e73cd0a1a44 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:21.076771 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 437/916] 10.222.0.25 () {56 vars in 1122 bytes} [Thu May 12 06:32:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:21.088807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d6c55-0ede-470e-9e72-23e5cbe948ca None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:21.233869 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d6c55-0ede-470e-9e72-23e5cbe948ca None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:21.267462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427dfb0-fbff-4f11-bbdf-2e8b8663357a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:21.268182 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427dfb0-fbff-4f11-bbdf-2e8b8663357a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:21.268466 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427dfb0-fbff-4f11-bbdf-2e8b8663357a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:21.268879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427dfb0-fbff-4f11-bbdf-2e8b8663357a None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:21.272399 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427dfb0-fbff-4f11-bbdf-2e8b8663357a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:21.272399 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427dfb0-fbff-4f11-bbdf-2e8b8663357a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:21.272399 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427dfb0-fbff-4f11-bbdf-2e8b8663357a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:21.276678 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 480/917] 10.222.0.25 () {56 vars in 1122 bytes} [Thu May 12 06:32:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:21.282379 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93f075-00b5-43bd-89c8-1e73cd0a1a44 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:21.413361 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93f075-00b5-43bd-89c8-1e73cd0a1a44 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:21.460884 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828af243-84e9-401e-9acd-fe039d8f468b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:21.461558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828af243-84e9-401e-9acd-fe039d8f468b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:21.461843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828af243-84e9-401e-9acd-fe039d8f468b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:21.462113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828af243-84e9-401e-9acd-fe039d8f468b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:21.462918 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828af243-84e9-401e-9acd-fe039d8f468b None admin] RBAC: Adding query filter params (interface=public, service_id=e638a5406ccf4e35acbed75418f4098c, region_id=RegionOne) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:21.463228 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828af243-84e9-401e-9acd-fe039d8f468b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:21.464623 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828af243-84e9-401e-9acd-fe039d8f468b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:21.472755 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 438/918] 10.222.0.25 () {56 vars in 1251 bytes} [Thu May 12 06:32:21 2022] GET /identity/v3/endpoints?service_id=e638a5406ccf4e35acbed75418f4098c&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:21.478229 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427dfb0-fbff-4f11-bbdf-2e8b8663357a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:21.580388 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427dfb0-fbff-4f11-bbdf-2e8b8663357a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:21.615142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f698530-94c0-4759-9ae0-8386ed439932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:21.615845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f698530-94c0-4759-9ae0-8386ed439932 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:21.616133 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f698530-94c0-4759-9ae0-8386ed439932 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:21.616408 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f698530-94c0-4759-9ae0-8386ed439932 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:21.617093 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f698530-94c0-4759-9ae0-8386ed439932 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:21.618460 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f698530-94c0-4759-9ae0-8386ed439932 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:21.625042 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 481/919] 10.222.0.25 () {56 vars in 1087 bytes} [Thu May 12 06:32:21 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:32:21.991980 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514a7df-4393-446f-b213-ec86e20d5620 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:21.992420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514a7df-4393-446f-b213-ec86e20d5620 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:21.992497 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514a7df-4393-446f-b213-ec86e20d5620 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:21.994193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 439/920] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:21.999789 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92e180-8faf-4d76-a324-51781227b96a None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:22.000240 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92e180-8faf-4d76-a324-51781227b96a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:22.000319 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92e180-8faf-4d76-a324-51781227b96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:22.017867 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3b92e180-8faf-4d76-a324-51781227b96a None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:22.019033 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3b92e180-8faf-4d76-a324-51781227b96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:22.088876 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9f388-a880-47bc-a9ed-ececaca6828a None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:22.089191 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9f388-a880-47bc-a9ed-ececaca6828a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:22.089421 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9f388-a880-47bc-a9ed-ececaca6828a None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:22.092077 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 440/921] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:22.096120 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e01922-2c23-4377-92ab-13e5de595cba None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:22.096432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e01922-2c23-4377-92ab-13e5de595cba None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:22.096712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e01922-2c23-4377-92ab-13e5de595cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:22.103009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 482/922] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:22.113922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c2e01922-2c23-4377-92ab-13e5de595cba None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:22.115110 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c2e01922-2c23-4377-92ab-13e5de595cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:22.125583 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92e180-8faf-4d76-a324-51781227b96a None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:22.185433 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 441/923] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:32:22.186843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaa6a6-3aab-4e0c-8af3-3843fe06f203 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:22.187134 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaa6a6-3aab-4e0c-8af3-3843fe06f203 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:22.187406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaa6a6-3aab-4e0c-8af3-3843fe06f203 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:22.193011 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 442/924] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:22.194176 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c487f-f2ef-41c9-85f5-c1c0891cf35e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:22.194461 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c487f-f2ef-41c9-85f5-c1c0891cf35e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:22.194740 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c487f-f2ef-41c9-85f5-c1c0891cf35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:22.211377 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7c8c487f-f2ef-41c9-85f5-c1c0891cf35e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:22.212670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7c8c487f-f2ef-41c9-85f5-c1c0891cf35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:22.223502 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92e180-8faf-4d76-a324-51781227b96a None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:22.256934 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cdc5c-d960-4449-8567-deefcf1026e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:22.257789 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cdc5c-d960-4449-8567-deefcf1026e5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:22.258070 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cdc5c-d960-4449-8567-deefcf1026e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:22.258339 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cdc5c-d960-4449-8567-deefcf1026e5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:22.258992 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024cdc5c-d960-4449-8567-deefcf1026e5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:22.260380 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024cdc5c-d960-4449-8567-deefcf1026e5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:22.273018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-024cdc5c-d960-4449-8567-deefcf1026e5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 06:32:22.273018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:22.273018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:32:22.273018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:32:22.273018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:32:22.273018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:32:22.273018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:32:22.273018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:22.273018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 06:32:22.273018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:22.273018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:22.273018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:22.273018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:22.273018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:22.273018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:22.273018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:22.273995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:22.273995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:22.273995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:22.273995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:22.273995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:22.273995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:22.273995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:22.273995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:32:22.273995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:32:22.273995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:32:22.273995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:32:22.273995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:22.273995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:22.273995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:22.273995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:22.273995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:22.274904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:22.274904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:22.274904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:22.274904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:22.274904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:22.274904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:22.274904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:22.274904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:22.274904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:22.274904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:22.274904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:22.274904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:32:22.274904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:22.274904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 06:32:22.274904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:22.274904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 483/925] 10.222.0.25 () {56 vars in 1132 bytes} [Thu May 12 06:32:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:22.275795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cdc5c-d960-4449-8567-deefcf1026e5 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:22.284458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 443/926] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:22.285302 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c487f-f2ef-41c9-85f5-c1c0891cf35e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:22.382446 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c487f-f2ef-41c9-85f5-c1c0891cf35e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:22.385649 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cdc5c-d960-4449-8567-deefcf1026e5 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:22.415427 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabf25a-1253-43b6-a393-dcbccfb337ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:22.416112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabf25a-1253-43b6-a393-dcbccfb337ec None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:22.416389 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabf25a-1253-43b6-a393-dcbccfb337ec None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:22.416716 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabf25a-1253-43b6-a393-dcbccfb337ec None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:22.417351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabf25a-1253-43b6-a393-dcbccfb337ec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:22.417653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabf25a-1253-43b6-a393-dcbccfb337ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:22.417855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df73b5-17a9-455c-86ac-00e6162c3ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:22.418666 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df73b5-17a9-455c-86ac-00e6162c3ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:22.418948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df73b5-17a9-455c-86ac-00e6162c3ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:22.419040 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabf25a-1253-43b6-a393-dcbccfb337ec None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:22.419218 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df73b5-17a9-455c-86ac-00e6162c3ad4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:22.423904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 444/927] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 12 06:32:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:22.424679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabf25a-1253-43b6-a393-dcbccfb337ec None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:22.435608 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df73b5-17a9-455c-86ac-00e6162c3ad4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:32:22.444640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-f9df73b5-17a9-455c-86ac-00e6162c3ad4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 06:32:22.444640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:22.444640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:22.444640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:22.444640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:22.444640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:22.444640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:22.444640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:22.444640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:22.444640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:22.444640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:22.444640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:22.444640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:32:22.444640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:32:22.444640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:32:22.444640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:32:22.445572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:32:22.445572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:32:22.445572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:32:22.445572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:32:22.445572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:22.445572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:22.445572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:22.445572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:22.445572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:22.445572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:22.445572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:22.445572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:22.445572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:22.445572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:22.445572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:22.445572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:22.446412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:22.446412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:22.446412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:22.446412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:22.446412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:32:22.446412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:32:22.446412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:32:22.446412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:32:22.446412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:32:22.446412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:32:22.446412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 06:32:22.446412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:22.446412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 484/928] 10.222.0.25 () {56 vars in 1120 bytes} [Thu May 12 06:32:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:22.447110 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df73b5-17a9-455c-86ac-00e6162c3ad4 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:22.530692 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabf25a-1253-43b6-a393-dcbccfb337ec None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:22.543044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df73b5-17a9-455c-86ac-00e6162c3ad4 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:22.564298 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dc2b5-6981-4035-aeba-37480fd01977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:22.565419 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dc2b5-6981-4035-aeba-37480fd01977 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:22.565894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dc2b5-6981-4035-aeba-37480fd01977 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:22.566340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dc2b5-6981-4035-aeba-37480fd01977 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:22.567718 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725dc2b5-6981-4035-aeba-37480fd01977 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:22.569244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725dc2b5-6981-4035-aeba-37480fd01977 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:22.575358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3a273-38cb-4af1-b73f-f09acd0c6903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:22.576053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3a273-38cb-4af1-b73f-f09acd0c6903 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:22.576336 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3a273-38cb-4af1-b73f-f09acd0c6903 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:22.576608 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3a273-38cb-4af1-b73f-f09acd0c6903 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:22.577316 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3a273-38cb-4af1-b73f-f09acd0c6903 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:22.577621 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3a273-38cb-4af1-b73f-f09acd0c6903 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:22.578958 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3a273-38cb-4af1-b73f-f09acd0c6903 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:22.582316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-725dc2b5-6981-4035-aeba-37480fd01977 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 06:32:22.582316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:22.582316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:32:22.582316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:32:22.582316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:32:22.582316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:32:22.582316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:32:22.582316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:22.582316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 06:32:22.582316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:22.582316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:22.582316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:22.582316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:22.582316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:22.582316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:22.582316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:22.582316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:22.583353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:22.583353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:22.583353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:22.583353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:22.583353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:22.583353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:22.583353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:32:22.583353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:32:22.583353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:32:22.583353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:32:22.583353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:22.583353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:22.583353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:22.583353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:22.583353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:22.583353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:22.584259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:22.584259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:22.584259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:22.584259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:22.584259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:22.584259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:22.584259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:22.584259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:22.584259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:22.584259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:22.584259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:32:22.584259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:22.584259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 06:32:22.584259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:22.590218 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 445/929] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:32:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:22.590218 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dc2b5-6981-4035-aeba-37480fd01977 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:22.590441 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 485/930] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 12 06:32:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:22.590441 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3a273-38cb-4af1-b73f-f09acd0c6903 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:22.686029 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dc2b5-6981-4035-aeba-37480fd01977 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:22.691331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3a273-38cb-4af1-b73f-f09acd0c6903 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:22.719310 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd749b-dc9a-4c7c-ae2f-6abe24773ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:22.720000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd749b-dc9a-4c7c-ae2f-6abe24773ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:22.720281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd749b-dc9a-4c7c-ae2f-6abe24773ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:22.720554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd749b-dc9a-4c7c-ae2f-6abe24773ae6 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:22.721298 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd749b-dc9a-4c7c-ae2f-6abe24773ae6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:22.721607 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd749b-dc9a-4c7c-ae2f-6abe24773ae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:22.722962 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd749b-dc9a-4c7c-ae2f-6abe24773ae6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:22.724835 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889db3e7-c84a-4f20-ae7e-fb7b3ac58cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:22.725661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889db3e7-c84a-4f20-ae7e-fb7b3ac58cd2 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:22.726085 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889db3e7-c84a-4f20-ae7e-fb7b3ac58cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:22.726501 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889db3e7-c84a-4f20-ae7e-fb7b3ac58cd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:22.727389 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889db3e7-c84a-4f20-ae7e-fb7b3ac58cd2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:22.729017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889db3e7-c84a-4f20-ae7e-fb7b3ac58cd2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:22.730650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 446/931] 10.222.0.25 () {56 vars in 1115 bytes} [Thu May 12 06:32:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:22.731426 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd749b-dc9a-4c7c-ae2f-6abe24773ae6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:22.832374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd749b-dc9a-4c7c-ae2f-6abe24773ae6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:22.868220 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 486/932] 10.222.0.25 () {60 vars in 1144 bytes} [Thu May 12 06:32:22 2022] POST /identity/v3/endpoints => generated 347 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:32:22.869306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889db3e7-c84a-4f20-ae7e-fb7b3ac58cd2 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:22.877306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f0197-1571-40f3-9809-d9da53f5a92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:22.877973 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f0197-1571-40f3-9809-d9da53f5a92d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:22.878255 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f0197-1571-40f3-9809-d9da53f5a92d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:22.878534 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f0197-1571-40f3-9809-d9da53f5a92d None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:22.879246 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f0197-1571-40f3-9809-d9da53f5a92d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:22.879608 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f0197-1571-40f3-9809-d9da53f5a92d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:22.881062 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f0197-1571-40f3-9809-d9da53f5a92d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:22.886287 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 447/933] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:32:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:22.892059 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f0197-1571-40f3-9809-d9da53f5a92d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:23.012216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889db3e7-c84a-4f20-ae7e-fb7b3ac58cd2 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:23.018439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f0197-1571-40f3-9809-d9da53f5a92d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:23.049688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b0141-ab29-494d-b2d1-cf875f38dcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:23.050517 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b0141-ab29-494d-b2d1-cf875f38dcc6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:23.050797 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b0141-ab29-494d-b2d1-cf875f38dcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:23.051071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b0141-ab29-494d-b2d1-cf875f38dcc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:23.055823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9206cc-0554-43dc-8a1f-3fa2d1652a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:23.056509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9206cc-0554-43dc-8a1f-3fa2d1652a36 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:23.056818 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9206cc-0554-43dc-8a1f-3fa2d1652a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:23.057065 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9206cc-0554-43dc-8a1f-3fa2d1652a36 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:23.057790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9206cc-0554-43dc-8a1f-3fa2d1652a36 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:23.058098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9206cc-0554-43dc-8a1f-3fa2d1652a36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:23.059497 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9206cc-0554-43dc-8a1f-3fa2d1652a36 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:23.063380 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b0141-ab29-494d-b2d1-cf875f38dcc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:23.064871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b0141-ab29-494d-b2d1-cf875f38dcc6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:23.066254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 448/934] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 12 06:32:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:23.071466 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9206cc-0554-43dc-8a1f-3fa2d1652a36 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:23.088060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-d59b0141-ab29-494d-b2d1-cf875f38dcc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:23.088060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:23.088060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:23.088060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:23.088060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:23.088060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:23.088060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:23.088060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:23.088060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:23.088060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:23.088060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:23.088060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:23.088060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:23.088060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:23.088060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:23.088976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:23.088976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:23.088976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:23.088976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:23.088976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:23.088976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:23.088976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:23.088976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:23.088976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:23.088976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:23.088976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:23.088976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:23.088976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:23.088976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:23.088976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:23.088976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:23.088976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:23.089893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:23.089893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:23.089893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:23.089893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:23.089893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 487/935] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:23.094826 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b0141-ab29-494d-b2d1-cf875f38dcc6 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:23.174531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9206cc-0554-43dc-8a1f-3fa2d1652a36 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:23.195337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b0141-ab29-494d-b2d1-cf875f38dcc6 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:23.209241 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be143fc-2eb6-4a60-9a6d-152f3f48d7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:23.209905 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be143fc-2eb6-4a60-9a6d-152f3f48d7f0 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:23.210189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be143fc-2eb6-4a60-9a6d-152f3f48d7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:23.210509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be143fc-2eb6-4a60-9a6d-152f3f48d7f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:23.211260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be143fc-2eb6-4a60-9a6d-152f3f48d7f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:23.212663 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be143fc-2eb6-4a60-9a6d-152f3f48d7f0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:23.229491 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b20894-ed69-4f28-88df-352891bc4750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:23.230161 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b20894-ed69-4f28-88df-352891bc4750 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:23.233315 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b20894-ed69-4f28-88df-352891bc4750 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:23.233315 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b20894-ed69-4f28-88df-352891bc4750 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:23.233315 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b20894-ed69-4f28-88df-352891bc4750 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:23.233315 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b20894-ed69-4f28-88df-352891bc4750 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:23.233315 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b20894-ed69-4f28-88df-352891bc4750 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:23.244811 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 488/936] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:23.250244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b20894-ed69-4f28-88df-352891bc4750 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:23.280754 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 449/937] 10.222.0.25 () {60 vars in 1144 bytes} [Thu May 12 06:32:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:32:23.362379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b20894-ed69-4f28-88df-352891bc4750 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:23.405607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c3608-1002-49d9-8a66-b6ae24a7d0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:23.406440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c3608-1002-49d9-8a66-b6ae24a7d0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:23.406718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c3608-1002-49d9-8a66-b6ae24a7d0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:23.406988 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c3608-1002-49d9-8a66-b6ae24a7d0a4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:23.416119 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c3608-1002-49d9-8a66-b6ae24a7d0a4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:23.417588 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c3608-1002-49d9-8a66-b6ae24a7d0a4 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:23.434510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-fe3c3608-1002-49d9-8a66-b6ae24a7d0a4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 06:32:23.434510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:23.434510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:23.434510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:23.434510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:23.434510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:23.434510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:23.434510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:23.434510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:23.434510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:23.434510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:23.434510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:23.434510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:32:23.434510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:32:23.434510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:32:23.434510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:32:23.435573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:23.435573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:23.435573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:32:23.435573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:23.435573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:32:23.435573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:23.435573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:23.435573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:23.435573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:23.435573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:23.435573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:23.435573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:23.435573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:23.435573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:23.435573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:23.435573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:23.435573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:23.435573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:23.436599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:23.436599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:23.436599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:32:23.436599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:32:23.436599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:32:23.436599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:32:23.436599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:32:23.436599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:32:23.436599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 06:32:23.436599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:23.436599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 489/938] 10.222.0.25 () {56 vars in 1117 bytes} [Thu May 12 06:32:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:23.444163 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be143fc-2eb6-4a60-9a6d-152f3f48d7f0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:23.554335 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be143fc-2eb6-4a60-9a6d-152f3f48d7f0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:23.587427 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727c57b-e31a-432f-b872-7315198a8cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:23.588128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727c57b-e31a-432f-b872-7315198a8cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:23.588408 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727c57b-e31a-432f-b872-7315198a8cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:23.588673 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727c57b-e31a-432f-b872-7315198a8cd4 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:23.589512 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727c57b-e31a-432f-b872-7315198a8cd4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:23.589813 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727c57b-e31a-432f-b872-7315198a8cd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:23.591219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727c57b-e31a-432f-b872-7315198a8cd4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:23.609280 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 450/939] 10.222.0.25 () {56 vars in 1149 bytes} [Thu May 12 06:32:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:23.614925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c3608-1002-49d9-8a66-b6ae24a7d0a4 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:23.717895 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c3608-1002-49d9-8a66-b6ae24a7d0a4 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:23.752342 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419afcf-2321-425b-8252-13bdbcf5f01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:23.753192 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419afcf-2321-425b-8252-13bdbcf5f01f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:23.753471 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419afcf-2321-425b-8252-13bdbcf5f01f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:23.753790 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419afcf-2321-425b-8252-13bdbcf5f01f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:23.763890 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419afcf-2321-425b-8252-13bdbcf5f01f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:23.765325 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419afcf-2321-425b-8252-13bdbcf5f01f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:23.784080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-e419afcf-2321-425b-8252-13bdbcf5f01f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:23.784080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:23.784080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:23.784080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:23.784080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:23.784080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:23.784080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:23.784080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:23.784080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:23.784080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:23.784080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:23.784080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:23.784080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:23.784080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:23.784080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:23.785067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:23.785067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:23.785067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:23.785067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:23.785067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:23.785067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:23.785067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:23.785067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:23.785067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:23.785067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:23.785067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:23.785067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:23.785067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:23.785067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:23.785067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:23.785067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:23.785067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:23.786205 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:23.786205 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:23.786205 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:23.786205 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:23.786205 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 490/940] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:23.792859 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727c57b-e31a-432f-b872-7315198a8cd4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:23.901506 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727c57b-e31a-432f-b872-7315198a8cd4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:23.938925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1cbd4-8ffc-4e34-8d68-62ddc33cc95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:23.939960 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1cbd4-8ffc-4e34-8d68-62ddc33cc95d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:23.940414 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1cbd4-8ffc-4e34-8d68-62ddc33cc95d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:23.947838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1cbd4-8ffc-4e34-8d68-62ddc33cc95d None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:23.947838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1cbd4-8ffc-4e34-8d68-62ddc33cc95d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:23.947838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1cbd4-8ffc-4e34-8d68-62ddc33cc95d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:23.947838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1cbd4-8ffc-4e34-8d68-62ddc33cc95d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:23.955180 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 451/941] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:23.961293 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419afcf-2321-425b-8252-13bdbcf5f01f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:24.062591 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419afcf-2321-425b-8252-13bdbcf5f01f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:24.089099 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a30fd-6fce-4d37-abb6-5766f3fecf25 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:24.089619 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a30fd-6fce-4d37-abb6-5766f3fecf25 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:24.089729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a30fd-6fce-4d37-abb6-5766f3fecf25 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:24.091261 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 452/942] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:32:24.096692 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad7f04-4ec4-4050-9688-990b40a750d5 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:24.097093 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad7f04-4ec4-4050-9688-990b40a750d5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:24.097499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad7f04-4ec4-4050-9688-990b40a750d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:24.102453 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c156d98-c782-4ffa-aea8-f997d755756a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:24.103256 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c156d98-c782-4ffa-aea8-f997d755756a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:24.103532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c156d98-c782-4ffa-aea8-f997d755756a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:24.103849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c156d98-c782-4ffa-aea8-f997d755756a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:24.110862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c156d98-c782-4ffa-aea8-f997d755756a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:24.112342 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c156d98-c782-4ffa-aea8-f997d755756a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:24.116037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-35ad7f04-4ec4-4050-9688-990b40a750d5 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:24.117347 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-35ad7f04-4ec4-4050-9688-990b40a750d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:24.126512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-6c156d98-c782-4ffa-aea8-f997d755756a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:24.126512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:24.126512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:24.126512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:24.126512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:24.126512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:24.126512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:24.126512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:24.126512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:24.126512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:24.126512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:24.126512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:24.126512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:32:24.126512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:32:24.126512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:32:24.128141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:32:24.128141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:24.128141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:24.128141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:24.128141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:24.128141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:24.128141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:24.128141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:24.128141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:24.128141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:24.128141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:24.128141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:24.128141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:24.128141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:24.128141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:24.128141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:24.128141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:24.130207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:32:24.130207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:32:24.130207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:32:24.130207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:32:24.130207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:32:24.130207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:32:24.130207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:24.130207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:24.130207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 491/943] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:32:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:24.134061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c156d98-c782-4ffa-aea8-f997d755756a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:24.195802 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 453/944] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:32:24.215315 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad7f04-4ec4-4050-9688-990b40a750d5 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:24.242901 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c156d98-c782-4ffa-aea8-f997d755756a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:24.276848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da90699-a3ab-4981-8f28-2db533413d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:24.277859 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da90699-a3ab-4981-8f28-2db533413d63 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:24.278363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da90699-a3ab-4981-8f28-2db533413d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:24.278855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da90699-a3ab-4981-8f28-2db533413d63 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:24.279900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da90699-a3ab-4981-8f28-2db533413d63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:24.280437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da90699-a3ab-4981-8f28-2db533413d63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:24.282061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da90699-a3ab-4981-8f28-2db533413d63 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:24.299964 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 492/945] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:32:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:24.301200 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da90699-a3ab-4981-8f28-2db533413d63 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:24.315545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad7f04-4ec4-4050-9688-990b40a750d5 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:24.350039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445b80c-dca9-4d14-a3f7-4a55830364fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:24.350834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445b80c-dca9-4d14-a3f7-4a55830364fb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:24.351112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445b80c-dca9-4d14-a3f7-4a55830364fb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:24.351384 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445b80c-dca9-4d14-a3f7-4a55830364fb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:24.352066 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445b80c-dca9-4d14-a3f7-4a55830364fb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:24.353418 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445b80c-dca9-4d14-a3f7-4a55830364fb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:24.365565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-2445b80c-dca9-4d14-a3f7-4a55830364fb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 06:32:24.365565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:24.365565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:32:24.365565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:32:24.365565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:32:24.365565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:32:24.365565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:32:24.365565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:24.365565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 06:32:24.365565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:24.365565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:24.365565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:24.365565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:24.365565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:24.365565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:24.365565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:24.365565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:24.366613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:24.366613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:24.366613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:24.366613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:24.366613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:24.366613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:24.366613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:32:24.366613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:32:24.366613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:32:24.366613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:32:24.366613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:24.366613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:24.366613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:24.366613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:24.366613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:24.366613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:24.367568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:24.367568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:24.367568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:24.367568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:24.367568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:24.367568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:24.367568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:24.367568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:24.367568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:24.367568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:24.367568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:32:24.367568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:24.367568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 06:32:24.367568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:24.372171 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 454/946] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 12 06:32:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:24.373399 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445b80c-dca9-4d14-a3f7-4a55830364fb None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:24.405192 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da90699-a3ab-4981-8f28-2db533413d63 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:24.440023 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80025a26-be6e-41b8-af57-9c60c81a6de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:24.441145 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80025a26-be6e-41b8-af57-9c60c81a6de4 None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:24.441611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80025a26-be6e-41b8-af57-9c60c81a6de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:24.442088 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80025a26-be6e-41b8-af57-9c60c81a6de4 None admin] PATH_INFO: `/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/7a25a3f2c9a148a1ae73e519070b190b/roles/b675985f8bdd471ab51fb4fc2daff01e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:24.449510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80025a26-be6e-41b8-af57-9c60c81a6de4 None admin] RBAC: Authorizing `identity:create_grant(project_id=57e1a8b143974111b0ba09d041b331d5, user_id=7a25a3f2c9a148a1ae73e519070b190b, role_id=b675985f8bdd471ab51fb4fc2daff01e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:24.451403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80025a26-be6e-41b8-af57-9c60c81a6de4 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:24.473711 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445b80c-dca9-4d14-a3f7-4a55830364fb None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:24.509978 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be383369-ab16-479f-a242-0b365abbe628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:24.510646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be383369-ab16-479f-a242-0b365abbe628 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:24.510932 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be383369-ab16-479f-a242-0b365abbe628 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:24.511212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be383369-ab16-479f-a242-0b365abbe628 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:24.511963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be383369-ab16-479f-a242-0b365abbe628 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:24.512262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be383369-ab16-479f-a242-0b365abbe628 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:24.513632 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be383369-ab16-479f-a242-0b365abbe628 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:24.524830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 493/948] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:32:24 2022] PUT /identity/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/7a25a3f2c9a148a1ae73e519070b190b/roles/b675985f8bdd471ab51fb4fc2daff01e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:32:24.525224 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 455/948] 10.222.0.25 () {56 vars in 1122 bytes} [Thu May 12 06:32:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:24.526875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80025a26-be6e-41b8-af57-9c60c81a6de4 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:24.635965 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80025a26-be6e-41b8-af57-9c60c81a6de4 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:24.673627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75e065-5b2c-44ec-b6f2-30098df6bb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:24.674712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75e065-5b2c-44ec-b6f2-30098df6bb84 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:24.675194 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75e065-5b2c-44ec-b6f2-30098df6bb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:24.675664 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75e065-5b2c-44ec-b6f2-30098df6bb84 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:24.677133 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75e065-5b2c-44ec-b6f2-30098df6bb84 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:24.677653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75e065-5b2c-44ec-b6f2-30098df6bb84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:24.679243 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75e065-5b2c-44ec-b6f2-30098df6bb84 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:24.689751 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 494/949] 10.222.0.25 () {56 vars in 1122 bytes} [Thu May 12 06:32:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:24.691488 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be383369-ab16-479f-a242-0b365abbe628 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:24.795726 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be383369-ab16-479f-a242-0b365abbe628 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:24.828618 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b326e-5d49-487d-bc43-29de8e7a4c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:24.829277 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b326e-5d49-487d-bc43-29de8e7a4c8a None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:24.829552 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b326e-5d49-487d-bc43-29de8e7a4c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:24.829823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b326e-5d49-487d-bc43-29de8e7a4c8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:24.830573 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b326e-5d49-487d-bc43-29de8e7a4c8a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:24.832065 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b326e-5d49-487d-bc43-29de8e7a4c8a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:24.911402 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 456/950] 10.222.0.25 () {60 vars in 1144 bytes} [Thu May 12 06:32:24 2022] POST /identity/v3/endpoints => generated 349 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:32:25.201397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42fb27-b89f-4f6a-8a54-edbe2c7a205e None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:25.202095 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42fb27-b89f-4f6a-8a54-edbe2c7a205e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:25.202095 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42fb27-b89f-4f6a-8a54-edbe2c7a205e None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:25.203525 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 495/951] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:25.209384 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4ef0a-e887-450d-ac66-0b395aa67b0b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:25.209865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4ef0a-e887-450d-ac66-0b395aa67b0b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:25.210017 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4ef0a-e887-450d-ac66-0b395aa67b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:25.226925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-99e4ef0a-e887-450d-ac66-0b395aa67b0b None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:25.228189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-99e4ef0a-e887-450d-ac66-0b395aa67b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:25.307267 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 457/952] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:25.324657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42fb27-b89f-4f6a-8a54-edbe2c7a205e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:25.430902 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42fb27-b89f-4f6a-8a54-edbe2c7a205e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:25.469152 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c349a1f-3c25-4e87-ad42-3ff6597d5517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:25.469874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c349a1f-3c25-4e87-ad42-3ff6597d5517 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:25.470152 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c349a1f-3c25-4e87-ad42-3ff6597d5517 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:25.470423 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c349a1f-3c25-4e87-ad42-3ff6597d5517 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:25.471075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c349a1f-3c25-4e87-ad42-3ff6597d5517 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:25.472456 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c349a1f-3c25-4e87-ad42-3ff6597d5517 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:25.484984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-1c349a1f-3c25-4e87-ad42-3ff6597d5517 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 06:32:25.484984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:25.484984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:32:25.484984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:32:25.484984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:32:25.484984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:32:25.484984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:32:25.484984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:25.484984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 06:32:25.484984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:25.484984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:25.484984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:25.484984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:25.484984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:25.484984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:25.484984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:25.484984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:25.487213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:25.487213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:25.487213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:25.487213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:25.487213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:25.487213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:25.487213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:32:25.487213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:32:25.487213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:32:25.487213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:32:25.487213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:25.487213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:25.487213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:25.487213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:25.487213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:25.487213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:25.489937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:25.489937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:25.489937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:25.489937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:25.489937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:25.489937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:25.489937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:25.489937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:25.489937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:25.489937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:25.489937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:32:25.489937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:25.489937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 06:32:25.489937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:25.491651 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 496/953] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:32:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:25.497001 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4ef0a-e887-450d-ac66-0b395aa67b0b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:25.596164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4ef0a-e887-450d-ac66-0b395aa67b0b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:25.613179 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb84a2-c80b-4ed7-abf8-51f48f94a2e6 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:25.613462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb84a2-c80b-4ed7-abf8-51f48f94a2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:25.613780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb84a2-c80b-4ed7-abf8-51f48f94a2e6 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:25.615150 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 497/954] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:25.621026 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92434a64-dda0-4abf-a216-9b6e8725d276 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:25.621418 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92434a64-dda0-4abf-a216-9b6e8725d276 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:25.621793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92434a64-dda0-4abf-a216-9b6e8725d276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:25.634434 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4418da-40ac-408f-add0-a8076810f34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:25.635109 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4418da-40ac-408f-add0-a8076810f34d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:25.635391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4418da-40ac-408f-add0-a8076810f34d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:25.635661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4418da-40ac-408f-add0-a8076810f34d None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:25.636413 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4418da-40ac-408f-add0-a8076810f34d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:25.636715 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4418da-40ac-408f-add0-a8076810f34d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:25.638080 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4418da-40ac-408f-add0-a8076810f34d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:25.642958 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-92434a64-dda0-4abf-a216-9b6e8725d276 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:25.643163 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 458/955] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 12 06:32:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:25.644656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-92434a64-dda0-4abf-a216-9b6e8725d276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:25.648943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4418da-40ac-408f-add0-a8076810f34d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:25.739833 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 498/956] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:25.763622 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4418da-40ac-408f-add0-a8076810f34d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:25.765213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92434a64-dda0-4abf-a216-9b6e8725d276 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:25.803428 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68b86c-0edf-40d1-9a9f-cd15b40773e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:25.804480 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68b86c-0edf-40d1-9a9f-cd15b40773e0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:25.804985 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68b86c-0edf-40d1-9a9f-cd15b40773e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:25.805476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68b86c-0edf-40d1-9a9f-cd15b40773e0 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:25.806379 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68b86c-0edf-40d1-9a9f-cd15b40773e0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:25.806900 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68b86c-0edf-40d1-9a9f-cd15b40773e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:25.808566 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68b86c-0edf-40d1-9a9f-cd15b40773e0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:25.813737 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 459/957] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 12 06:32:25 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:25.880574 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92434a64-dda0-4abf-a216-9b6e8725d276 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:25.917095 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85746623-9331-48c9-a20f-97b5f49266d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:25.918159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85746623-9331-48c9-a20f-97b5f49266d8 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:25.918665 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85746623-9331-48c9-a20f-97b5f49266d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:25.919202 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85746623-9331-48c9-a20f-97b5f49266d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:25.920260 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85746623-9331-48c9-a20f-97b5f49266d8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:25.921929 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85746623-9331-48c9-a20f-97b5f49266d8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:25.923655 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: WARNING keystone.server.flask.common [None req-85746623-9331-48c9-a20f-97b5f49266d8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 12 06:32:25.997060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.sql.core [None req-85746623-9331-48c9-a20f-97b5f49266d8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 06:32:25.997060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 06:32:25.997060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [parameters: {'id': 'cf7840f139fd482a97264ac85d645fff', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 06:32:25.997060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80359) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 06:32:26.014609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-85746623-9331-48c9-a20f-97b5f49266d8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cf7840f139fd482a97264ac85d645fff.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cf7840f139fd482a97264ac85d645fff. May 12 06:32:26.014609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:26.014609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 06:32:26.014609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 06:32:26.014609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 06:32:26.014609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 06:32:26.014609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 06:32:26.014609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application result = self._query(query) May 12 06:32:26.014609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 06:32:26.014609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application conn.query(q) May 12 06:32:26.014609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 06:32:26.014609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 06:32:26.014609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 06:32:26.016529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application result.read() May 12 06:32:26.016529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 06:32:26.016529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 06:32:26.016529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 06:32:26.016529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 06:32:26.016529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 06:32:26.016529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 06:32:26.016529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 06:32:26.016529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 06:32:26.016529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 06:32:26.016529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:26.016529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 06:32:26.016529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:26.016529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:26.016529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 06:32:26.016529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 06:32:26.016529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 12 06:32:26.016529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return project_ref.to_dict() May 12 06:32:26.018912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 06:32:26.018912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application next(self.gen) May 12 06:32:26.018912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 06:32:26.018912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application yield resource May 12 06:32:26.018912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 06:32:26.018912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application next(self.gen) May 12 06:32:26.018912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 06:32:26.018912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self.session.rollback() May 12 06:32:26.018912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 06:32:26.018912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self.force_reraise() May 12 06:32:26.018912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 06:32:26.018912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise self.value May 12 06:32:26.018912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 06:32:26.018912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 06:32:26.018912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 06:32:26.018912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application session.commit() May 12 06:32:26.018912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 06:32:26.021211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 06:32:26.021211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 06:32:26.021211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._prepare_impl() May 12 06:32:26.021211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 06:32:26.021211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self.session.flush() May 12 06:32:26.021211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 06:32:26.021211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._flush(objects) May 12 06:32:26.021211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 06:32:26.021211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 06:32:26.021211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 06:32:26.021211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application compat.raise_( May 12 06:32:26.021211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 06:32:26.021211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception May 12 06:32:26.021211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 06:32:26.021211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application flush_context.execute() May 12 06:32:26.021211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 06:32:26.021211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rec.execute(self) May 12 06:32:26.022280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 06:32:26.022280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 06:32:26.022280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 06:32:26.022280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 06:32:26.022280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 12 06:32:26.022280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application c = connection._execute_20( May 12 06:32:26.022280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 06:32:26.022280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 06:32:26.022280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 06:32:26.022280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 06:32:26.022280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 06:32:26.022280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 06:32:26.022280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 06:32:26.022280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 06:32:26.022280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 06:32:26.023899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 06:32:26.023899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 06:32:26.023899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception May 12 06:32:26.023899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 06:32:26.023899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 06:32:26.023899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 06:32:26.023899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 06:32:26.023899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 06:32:26.023899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application result = self._query(query) May 12 06:32:26.023899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 06:32:26.023899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application conn.query(q) May 12 06:32:26.023899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 06:32:26.023899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 06:32:26.023899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 06:32:26.023899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application result.read() May 12 06:32:26.023899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 06:32:26.023899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 06:32:26.025954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 06:32:26.025954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 06:32:26.025954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 06:32:26.025954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 06:32:26.025954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 06:32:26.025954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 06:32:26.025954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 06:32:26.025954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 06:32:26.025954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [parameters: {'id': 'cf7840f139fd482a97264ac85d645fff', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 06:32:26.025954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 06:32:26.025954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:26.025954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:26.025954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:26.025954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:26.025954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 12 06:32:26.027795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 12 06:32:26.027795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 06:32:26.027795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 06:32:26.027795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 12 06:32:26.027795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:26.027795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:26.027795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:26.027795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:26.027795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:26.027795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:26.027795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:26.027795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:26.027795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:26.027795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:26.027795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:26.027795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:26.027795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:26.029873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:26.029873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 12 06:32:26.029873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 12 06:32:26.029873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:26.029873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:26.029873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 12 06:32:26.029873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.Conflict( May 12 06:32:26.029873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cf7840f139fd482a97264ac85d645fff. May 12 06:32:26.029873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:26.029873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 499/958] 10.222.0.25 () {60 vars in 1140 bytes} [Thu May 12 06:32:25 2022] POST /identity/v3/projects => generated 262 bytes in 252 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:26.031831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68b86c-0edf-40d1-9a9f-cd15b40773e0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:26.129645 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68b86c-0edf-40d1-9a9f-cd15b40773e0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:26.164419 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2a6de-712d-42cf-b2fd-b9852a29c5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:26.165577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2a6de-712d-42cf-b2fd-b9852a29c5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:26.166117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2a6de-712d-42cf-b2fd-b9852a29c5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:26.166595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2a6de-712d-42cf-b2fd-b9852a29c5b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:26.173555 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2a6de-712d-42cf-b2fd-b9852a29c5b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:26.175270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2a6de-712d-42cf-b2fd-b9852a29c5b9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:26.190666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-fdc2a6de-712d-42cf-b2fd-b9852a29c5b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:26.190666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:26.190666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:26.190666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:26.190666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:26.190666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:26.190666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:26.190666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:26.190666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:26.190666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:26.190666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:26.190666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:26.190666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:32:26.190666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:32:26.190666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:32:26.191598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:32:26.191598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:26.191598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:26.191598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:26.191598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:26.191598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:26.191598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:26.191598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:26.191598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:26.191598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:26.191598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:26.191598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:26.191598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:26.191598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:26.191598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:26.191598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:26.191598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:26.192626 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:32:26.192626 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:32:26.192626 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:32:26.192626 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:32:26.192626 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:32:26.192626 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:32:26.192626 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:26.192626 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:26.195145 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 460/959] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:32:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:26.200806 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85746623-9331-48c9-a20f-97b5f49266d8 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:26.304660 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85746623-9331-48c9-a20f-97b5f49266d8 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:26.337628 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663460c-61db-4bb5-aeeb-e38bdd0b82e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:26.338286 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663460c-61db-4bb5-aeeb-e38bdd0b82e3 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:26.338565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663460c-61db-4bb5-aeeb-e38bdd0b82e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:26.338833 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663460c-61db-4bb5-aeeb-e38bdd0b82e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:26.339593 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663460c-61db-4bb5-aeeb-e38bdd0b82e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:26.339922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663460c-61db-4bb5-aeeb-e38bdd0b82e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:26.341712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663460c-61db-4bb5-aeeb-e38bdd0b82e3 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:26.367667 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 500/960] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 12 06:32:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:26.843877 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e7f0d-091b-4f61-b69a-9f7ef454d190 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:26.844579 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e7f0d-091b-4f61-b69a-9f7ef454d190 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:26.844579 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e7f0d-091b-4f61-b69a-9f7ef454d190 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:26.846026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 461/961] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:26.852135 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221c90c-fa89-4770-83d0-67e785cff467 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:26.852427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221c90c-fa89-4770-83d0-67e785cff467 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:26.852711 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221c90c-fa89-4770-83d0-67e785cff467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:26.869763 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-7221c90c-fa89-4770-83d0-67e785cff467 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:26.871270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7221c90c-fa89-4770-83d0-67e785cff467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:26.941894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 501/962] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:26.965792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e7f0d-091b-4f61-b69a-9f7ef454d190 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:27.082907 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e7f0d-091b-4f61-b69a-9f7ef454d190 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:27.117195 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a5534-5240-40ee-a8e1-0500149fc12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:27.118362 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a5534-5240-40ee-a8e1-0500149fc12f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:27.118842 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a5534-5240-40ee-a8e1-0500149fc12f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:27.119323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a5534-5240-40ee-a8e1-0500149fc12f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:27.131594 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a5534-5240-40ee-a8e1-0500149fc12f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:32:27.140035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-b31a5534-5240-40ee-a8e1-0500149fc12f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 06:32:27.140035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:27.140035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:27.140035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:27.140035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:27.140035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:27.140035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:27.140035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:27.140035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:27.140035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:27.140035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:27.140035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:27.140035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:32:27.140035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:32:27.140035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:32:27.140035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:32:27.140976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:32:27.140976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:32:27.140976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:32:27.140976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:32:27.140976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:27.140976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:27.140976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:27.140976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:27.140976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:27.140976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:27.140976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:27.140976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:27.140976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:27.140976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:27.140976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:27.140976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:27.141855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:27.141855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:27.141855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:27.141855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:27.141855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:32:27.141855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:32:27.141855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:32:27.141855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:32:27.141855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:32:27.141855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:32:27.141855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 06:32:27.141855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:27.144655 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 462/963] 10.222.0.25 () {56 vars in 1120 bytes} [Thu May 12 06:32:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:27.152426 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221c90c-fa89-4770-83d0-67e785cff467 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:27.214295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed852dd9-e762-4816-abd8-b75baa92a836 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:27.214606 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed852dd9-e762-4816-abd8-b75baa92a836 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:27.214844 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed852dd9-e762-4816-abd8-b75baa92a836 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:27.216490 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 463/964] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:32:27.221287 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5872c1-37e5-47b1-b74e-9c0c4464bd65 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:27.221571 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5872c1-37e5-47b1-b74e-9c0c4464bd65 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:27.221844 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5872c1-37e5-47b1-b74e-9c0c4464bd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:27.240571 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5e5872c1-37e5-47b1-b74e-9c0c4464bd65 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:27.242169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5e5872c1-37e5-47b1-b74e-9c0c4464bd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:27.254951 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221c90c-fa89-4770-83d0-67e785cff467 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:27.296114 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cfb08-6687-4ee0-a990-0957bfafaf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:27.297242 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cfb08-6687-4ee0-a990-0957bfafaf5f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:27.297671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cfb08-6687-4ee0-a990-0957bfafaf5f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:27.298465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cfb08-6687-4ee0-a990-0957bfafaf5f None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:27.299661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cfb08-6687-4ee0-a990-0957bfafaf5f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:27.300151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cfb08-6687-4ee0-a990-0957bfafaf5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:27.302644 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cfb08-6687-4ee0-a990-0957bfafaf5f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:27.313419 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 502/965] 10.222.0.25 () {56 vars in 1115 bytes} [Thu May 12 06:32:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:27.318525 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cfb08-6687-4ee0-a990-0957bfafaf5f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:27.323764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 464/966] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:32:27.345051 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5872c1-37e5-47b1-b74e-9c0c4464bd65 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:27.446229 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cfb08-6687-4ee0-a990-0957bfafaf5f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:27.446910 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5872c1-37e5-47b1-b74e-9c0c4464bd65 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:27.480858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69a2b3-8557-4af1-a267-86c08e6c6844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:27.481998 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69a2b3-8557-4af1-a267-86c08e6c6844 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:27.482518 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69a2b3-8557-4af1-a267-86c08e6c6844 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:27.482986 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69a2b3-8557-4af1-a267-86c08e6c6844 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:27.484402 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e14ea-5cf1-44f7-bc95-97adeb3230a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:27.485220 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e14ea-5cf1-44f7-bc95-97adeb3230a2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:27.485463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e14ea-5cf1-44f7-bc95-97adeb3230a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:27.485731 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e14ea-5cf1-44f7-bc95-97adeb3230a2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:27.486384 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e14ea-5cf1-44f7-bc95-97adeb3230a2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:27.487746 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e14ea-5cf1-44f7-bc95-97adeb3230a2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:27.495805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69a2b3-8557-4af1-a267-86c08e6c6844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:27.497470 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69a2b3-8557-4af1-a267-86c08e6c6844 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:27.500323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-692e14ea-5cf1-44f7-bc95-97adeb3230a2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 06:32:27.500323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:27.500323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:32:27.500323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:32:27.500323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:32:27.500323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:32:27.500323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:32:27.500323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:27.500323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 06:32:27.500323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:27.500323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:27.500323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:27.500323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:27.500323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:27.500323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:27.500323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:27.500323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:27.501747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:27.501747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:27.501747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:27.501747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:27.501747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:27.501747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:27.501747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:32:27.501747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:32:27.501747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:32:27.501747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:32:27.501747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:27.501747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:27.501747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:27.501747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:27.501747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:27.501747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:27.503042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:27.503042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:27.503042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:27.503042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:27.503042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:27.503042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:27.503042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:27.503042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:27.503042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:27.503042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:27.503042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:32:27.503042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:27.503042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 06:32:27.503042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:27.506639 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 465/967] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 12 06:32:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:27.507873 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e14ea-5cf1-44f7-bc95-97adeb3230a2 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:27.520688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-6b69a2b3-8557-4af1-a267-86c08e6c6844 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:27.520688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:27.520688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:27.520688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:27.520688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:27.520688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:27.520688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:27.520688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:27.520688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:27.520688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:27.520688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:27.520688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:27.520688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:27.520688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:27.520688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:27.521609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:27.521609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:27.521609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:27.521609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:27.521609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:27.521609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:27.521609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:27.521609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:27.521609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:27.521609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:27.521609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:27.521609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:27.521609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:27.521609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:27.521609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:27.521609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:27.521609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:27.522554 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:27.522554 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:27.522554 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:27.522554 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:27.524806 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 503/968] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:27.535707 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69a2b3-8557-4af1-a267-86c08e6c6844 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:27.617642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e14ea-5cf1-44f7-bc95-97adeb3230a2 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:27.657176 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e3ac4-e8dc-412f-badc-790b34279168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:27.657859 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e3ac4-e8dc-412f-badc-790b34279168 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:27.658139 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e3ac4-e8dc-412f-badc-790b34279168 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:27.658407 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e3ac4-e8dc-412f-badc-790b34279168 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:27.659118 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e3ac4-e8dc-412f-badc-790b34279168 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:27.659420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e3ac4-e8dc-412f-badc-790b34279168 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:27.660868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e3ac4-e8dc-412f-badc-790b34279168 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:27.662217 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69a2b3-8557-4af1-a267-86c08e6c6844 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:27.671572 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 466/969] 10.222.0.25 () {56 vars in 1122 bytes} [Thu May 12 06:32:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:27.673092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e3ac4-e8dc-412f-badc-790b34279168 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:27.702183 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e2514-d56b-417f-aa2b-abda1d9269e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:27.702832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e2514-d56b-417f-aa2b-abda1d9269e5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:27.703110 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e2514-d56b-417f-aa2b-abda1d9269e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:27.703381 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e2514-d56b-417f-aa2b-abda1d9269e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:27.708347 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e2514-d56b-417f-aa2b-abda1d9269e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:27.708666 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e2514-d56b-417f-aa2b-abda1d9269e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:27.710025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e2514-d56b-417f-aa2b-abda1d9269e5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:27.725769 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 504/970] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:27.732460 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e2514-d56b-417f-aa2b-abda1d9269e5 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:27.803230 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e3ac4-e8dc-412f-badc-790b34279168 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:27.839870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244e87e-2ade-4d31-863b-e26e823677e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:27.840529 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244e87e-2ade-4d31-863b-e26e823677e7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:27.840856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244e87e-2ade-4d31-863b-e26e823677e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:27.841132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244e87e-2ade-4d31-863b-e26e823677e7 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:27.841827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244e87e-2ade-4d31-863b-e26e823677e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:27.842127 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244e87e-2ade-4d31-863b-e26e823677e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:27.843467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244e87e-2ade-4d31-863b-e26e823677e7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:27.849223 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 467/971] 10.222.0.25 () {56 vars in 1122 bytes} [Thu May 12 06:32:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:27.854609 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244e87e-2ade-4d31-863b-e26e823677e7 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:27.859465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e2514-d56b-417f-aa2b-abda1d9269e5 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:27.903966 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9ba5e-5ec7-4b24-85f0-ed5fbb379550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:27.905353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9ba5e-5ec7-4b24-85f0-ed5fbb379550 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:27.905801 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9ba5e-5ec7-4b24-85f0-ed5fbb379550 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:27.906414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9ba5e-5ec7-4b24-85f0-ed5fbb379550 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:27.917154 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9ba5e-5ec7-4b24-85f0-ed5fbb379550 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:27.919918 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9ba5e-5ec7-4b24-85f0-ed5fbb379550 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:27.940878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-24a9ba5e-5ec7-4b24-85f0-ed5fbb379550 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 06:32:27.940878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:27.940878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:27.940878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:27.940878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:27.940878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:27.940878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:27.940878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:27.940878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:27.940878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:27.940878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:27.940878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:27.940878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:32:27.940878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:32:27.940878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:32:27.940878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:32:27.944069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:27.944069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:27.944069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:32:27.944069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:27.944069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:32:27.944069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:27.944069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:27.944069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:27.944069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:27.944069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:27.944069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:27.944069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:27.944069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:27.944069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:27.944069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:27.944069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:27.944069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:27.944069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:27.945317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:27.945317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:27.945317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:32:27.945317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:32:27.945317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:32:27.945317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:32:27.945317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:32:27.945317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:32:27.945317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 06:32:27.945317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:27.951591 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 505/972] 10.222.0.25 () {56 vars in 1117 bytes} [Thu May 12 06:32:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:27.952860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9ba5e-5ec7-4b24-85f0-ed5fbb379550 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:27.978074 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244e87e-2ade-4d31-863b-e26e823677e7 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:28.020963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436bd46-4b40-41a6-9ed3-dddd8f045c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:28.022579 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436bd46-4b40-41a6-9ed3-dddd8f045c8e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:28.023082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436bd46-4b40-41a6-9ed3-dddd8f045c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:28.023735 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436bd46-4b40-41a6-9ed3-dddd8f045c8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:28.025348 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436bd46-4b40-41a6-9ed3-dddd8f045c8e None admin] RBAC: Adding query filter params (interface=admin, service_id=e638a5406ccf4e35acbed75418f4098c, region_id=RegionOne) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:28.025871 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436bd46-4b40-41a6-9ed3-dddd8f045c8e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:28.028244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436bd46-4b40-41a6-9ed3-dddd8f045c8e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:28.035762 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 468/973] 10.222.0.25 () {56 vars in 1249 bytes} [Thu May 12 06:32:27 2022] GET /identity/v3/endpoints?service_id=e638a5406ccf4e35acbed75418f4098c&interface=admin®ion_id=RegionOne => generated 193 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:28.040802 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436bd46-4b40-41a6-9ed3-dddd8f045c8e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:28.073983 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9ba5e-5ec7-4b24-85f0-ed5fbb379550 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:28.108417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91f2d6-9dbc-477c-87dd-e370e9a17f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:28.109090 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91f2d6-9dbc-477c-87dd-e370e9a17f11 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:28.109368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91f2d6-9dbc-477c-87dd-e370e9a17f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:28.109638 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91f2d6-9dbc-477c-87dd-e370e9a17f11 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:28.110476 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91f2d6-9dbc-477c-87dd-e370e9a17f11 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:28.110930 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91f2d6-9dbc-477c-87dd-e370e9a17f11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:28.112218 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91f2d6-9dbc-477c-87dd-e370e9a17f11 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:28.129800 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 506/974] 10.222.0.25 () {56 vars in 1149 bytes} [Thu May 12 06:32:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:28.131108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25493aa6-3480-4a67-9f85-71460a4c5b2a None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:28.131394 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25493aa6-3480-4a67-9f85-71460a4c5b2a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:28.131666 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25493aa6-3480-4a67-9f85-71460a4c5b2a None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:28.135728 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 507/975] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:28.136016 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25493aa6-3480-4a67-9f85-71460a4c5b2a None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:28.158403 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436bd46-4b40-41a6-9ed3-dddd8f045c8e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:28.191258 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff40eb-968b-40df-9439-d18bdd863ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:28.192516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff40eb-968b-40df-9439-d18bdd863ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:28.192799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff40eb-968b-40df-9439-d18bdd863ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:28.193070 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff40eb-968b-40df-9439-d18bdd863ee2 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:28.193752 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff40eb-968b-40df-9439-d18bdd863ee2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:28.195118 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff40eb-968b-40df-9439-d18bdd863ee2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:28.202331 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 469/976] 10.222.0.25 () {56 vars in 1087 bytes} [Thu May 12 06:32:28 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 06:32:28.203572 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea021f-cc79-468a-a2f7-0a757a4bb67e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:28.203824 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea021f-cc79-468a-a2f7-0a757a4bb67e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:28.204099 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea021f-cc79-468a-a2f7-0a757a4bb67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:28.232146 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-bdea021f-cc79-468a-a2f7-0a757a4bb67e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:28.233960 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bdea021f-cc79-468a-a2f7-0a757a4bb67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:28.251480 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25493aa6-3480-4a67-9f85-71460a4c5b2a None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:28.290701 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e881ed6-221b-4bcc-ba1a-5e1557638c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:28.291434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e881ed6-221b-4bcc-ba1a-5e1557638c62 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:28.291764 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e881ed6-221b-4bcc-ba1a-5e1557638c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:28.292091 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e881ed6-221b-4bcc-ba1a-5e1557638c62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:28.327582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 470/977] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:28.350038 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea021f-cc79-468a-a2f7-0a757a4bb67e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:28.378279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e881ed6-221b-4bcc-ba1a-5e1557638c62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:28.380650 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e881ed6-221b-4bcc-ba1a-5e1557638c62 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:28.480718 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea021f-cc79-468a-a2f7-0a757a4bb67e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:28.492574 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 508/978] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:32:28 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 06:32:28.497753 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e881ed6-221b-4bcc-ba1a-5e1557638c62 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:28.525641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a709979-388d-4f1f-8be6-d0f7afeb898f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:28.527182 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a709979-388d-4f1f-8be6-d0f7afeb898f None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:28.527638 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a709979-388d-4f1f-8be6-d0f7afeb898f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:28.528423 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a709979-388d-4f1f-8be6-d0f7afeb898f None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:28.529382 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a709979-388d-4f1f-8be6-d0f7afeb898f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:28.531885 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a709979-388d-4f1f-8be6-d0f7afeb898f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:28.603118 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e881ed6-221b-4bcc-ba1a-5e1557638c62 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:28.623612 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 471/979] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 12 06:32:28 2022] POST /identity/v3/services => generated 242 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:32:28.652488 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969797b-8270-48a3-bbe0-ed8349b36080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:28.653723 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969797b-8270-48a3-bbe0-ed8349b36080 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:28.654239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969797b-8270-48a3-bbe0-ed8349b36080 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:28.654697 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969797b-8270-48a3-bbe0-ed8349b36080 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:28.667952 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969797b-8270-48a3-bbe0-ed8349b36080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:28.669746 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969797b-8270-48a3-bbe0-ed8349b36080 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:28.690232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-d969797b-8270-48a3-bbe0-ed8349b36080 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:28.690232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:28.690232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:28.690232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:28.690232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:28.690232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:28.690232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:28.690232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:28.690232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:28.690232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:28.690232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:28.690232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:28.690232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:28.690232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:28.690232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:28.691234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:28.691234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:28.691234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:28.691234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:28.691234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:28.691234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:28.691234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:28.691234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:28.691234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:28.691234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:28.691234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:28.691234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:28.691234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:28.691234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:28.691234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:28.691234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:28.691234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:28.692259 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:28.692259 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:28.692259 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:28.692259 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:28.694429 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 509/980] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:28.700340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a709979-388d-4f1f-8be6-d0f7afeb898f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:28.721226 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe900ddf-146d-4aca-8d10-62a7ecca6b94 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:28.721502 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe900ddf-146d-4aca-8d10-62a7ecca6b94 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:28.721891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe900ddf-146d-4aca-8d10-62a7ecca6b94 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:28.724076 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 510/981] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:28.729658 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf35ed-a048-4978-9d5a-201911963354 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:28.729938 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf35ed-a048-4978-9d5a-201911963354 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:28.730212 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf35ed-a048-4978-9d5a-201911963354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:28.750519 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6fcf35ed-a048-4978-9d5a-201911963354 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:28.752121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6fcf35ed-a048-4978-9d5a-201911963354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:28.828163 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a709979-388d-4f1f-8be6-d0f7afeb898f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:28.838512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 511/982] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:32:28.864949 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b9aca-fff3-46d1-a948-59a870928660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:28.864949 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b9aca-fff3-46d1-a948-59a870928660 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:28.864949 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b9aca-fff3-46d1-a948-59a870928660 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:28.865632 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b9aca-fff3-46d1-a948-59a870928660 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:28.865901 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b9aca-fff3-46d1-a948-59a870928660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:28.866242 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf35ed-a048-4978-9d5a-201911963354 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:28.866343 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b9aca-fff3-46d1-a948-59a870928660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:28.867650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b9aca-fff3-46d1-a948-59a870928660 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:28.884550 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 472/983] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:28.890193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b9aca-fff3-46d1-a948-59a870928660 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:29.005005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf35ed-a048-4978-9d5a-201911963354 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:29.010558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b9aca-fff3-46d1-a948-59a870928660 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:29.040741 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5dc026-fef9-426a-909a-2241ff637163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:29.041972 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dc026-fef9-426a-909a-2241ff637163 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:29.042455 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dc026-fef9-426a-909a-2241ff637163 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:29.042926 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dc026-fef9-426a-909a-2241ff637163 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:29.043875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5dc026-fef9-426a-909a-2241ff637163 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:29.045571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5dc026-fef9-426a-909a-2241ff637163 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:29.050771 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8746e73-6e55-4402-8e69-f63134da5097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:29.052103 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8746e73-6e55-4402-8e69-f63134da5097 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:29.052392 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8746e73-6e55-4402-8e69-f63134da5097 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:29.052669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8746e73-6e55-4402-8e69-f63134da5097 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:29.061127 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8746e73-6e55-4402-8e69-f63134da5097 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:29.062569 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8746e73-6e55-4402-8e69-f63134da5097 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:29.077067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-c8746e73-6e55-4402-8e69-f63134da5097 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:29.077067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:29.077067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:29.077067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:29.077067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:29.077067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:29.077067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:29.077067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:29.077067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:29.077067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:29.077067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:29.077067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:29.077067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:32:29.077067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:32:29.077067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:32:29.078031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:32:29.078031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:29.078031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:29.078031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:29.078031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:29.078031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:29.078031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:29.078031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:29.078031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:29.078031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:29.078031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:29.078031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:29.078031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:29.078031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:29.078031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:29.078031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:29.078031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:29.078968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:32:29.078968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:32:29.078968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:32:29.078968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:32:29.078968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:32:29.078968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:32:29.078968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:29.078968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:29.078968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 473/984] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:32:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:29.084042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8746e73-6e55-4402-8e69-f63134da5097 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:29.094324 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.sql.core [None req-7a5dc026-fef9-426a-909a-2241ff637163 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 06:32:29.094324 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 06:32:29.094324 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [parameters: {'user_id': '54eec8e8940b46678fe58b1bf0cf0834', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 06:32:29.094324 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80359) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 06:32:29.105505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-7a5dc026-fef9-426a-909a-2241ff637163 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 06:32:29.105505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:29.105505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 06:32:29.105505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 06:32:29.105505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 06:32:29.105505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 06:32:29.105505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 06:32:29.105505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application result = self._query(query) May 12 06:32:29.105505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 06:32:29.105505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application conn.query(q) May 12 06:32:29.105505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 06:32:29.105505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 06:32:29.105505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 06:32:29.105505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application result.read() May 12 06:32:29.105505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 06:32:29.106430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 06:32:29.106430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 06:32:29.106430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 06:32:29.106430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 06:32:29.106430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 06:32:29.106430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 06:32:29.106430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 06:32:29.106430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 06:32:29.106430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:29.106430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 06:32:29.106430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:29.106430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:29.106430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 06:32:29.106430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 06:32:29.106430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 12 06:32:29.106430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 12 06:32:29.106430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 06:32:29.106430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application next(self.gen) May 12 06:32:29.107433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 06:32:29.107433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application yield resource May 12 06:32:29.107433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 06:32:29.107433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application next(self.gen) May 12 06:32:29.107433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 06:32:29.107433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self.session.rollback() May 12 06:32:29.107433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 06:32:29.107433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self.force_reraise() May 12 06:32:29.107433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 06:32:29.107433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise self.value May 12 06:32:29.107433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 06:32:29.107433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 06:32:29.107433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 06:32:29.107433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application session.commit() May 12 06:32:29.107433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 06:32:29.107433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 06:32:29.107433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 06:32:29.108450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._prepare_impl() May 12 06:32:29.108450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 06:32:29.108450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self.session.flush() May 12 06:32:29.108450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 06:32:29.108450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._flush(objects) May 12 06:32:29.108450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 06:32:29.108450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 06:32:29.108450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 06:32:29.108450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application compat.raise_( May 12 06:32:29.108450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 06:32:29.108450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception May 12 06:32:29.108450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 06:32:29.108450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application flush_context.execute() May 12 06:32:29.108450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 06:32:29.108450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rec.execute(self) May 12 06:32:29.108450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 06:32:29.108450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 06:32:29.109395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 06:32:29.109395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 06:32:29.109395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 12 06:32:29.109395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application result = connection._execute_20( May 12 06:32:29.109395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 06:32:29.109395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 06:32:29.109395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 06:32:29.109395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 06:32:29.109395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 06:32:29.109395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 06:32:29.109395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 06:32:29.109395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 06:32:29.109395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 06:32:29.109395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 06:32:29.109395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 06:32:29.109395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception May 12 06:32:29.110307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 06:32:29.110307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 06:32:29.110307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 06:32:29.110307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 06:32:29.110307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 06:32:29.110307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application result = self._query(query) May 12 06:32:29.110307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 06:32:29.110307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application conn.query(q) May 12 06:32:29.110307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 06:32:29.110307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 06:32:29.110307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 06:32:29.110307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application result.read() May 12 06:32:29.110307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 06:32:29.110307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 06:32:29.110307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 06:32:29.110307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 06:32:29.111177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 06:32:29.111177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 06:32:29.111177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 06:32:29.111177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 06:32:29.111177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 06:32:29.111177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 06:32:29.111177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [parameters: {'user_id': '54eec8e8940b46678fe58b1bf0cf0834', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 06:32:29.111177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 06:32:29.111177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:29.111177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:29.111177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:29.111177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:29.111177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:29.111177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:29.111177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:29.114656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:29.114656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:29.114656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:29.114656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:29.114656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:29.114656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:29.114656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:29.114656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 12 06:32:29.114656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 12 06:32:29.114656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:29.114656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:29.114656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:32:29.114656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:29.114656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:32:29.114656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:29.114656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 12 06:32:29.114656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 12 06:32:29.116981 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 12 06:32:29.116981 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 12 06:32:29.116981 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 06:32:29.116981 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 06:32:29.116981 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 06:32:29.116981 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:29.118036 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 512/985] 10.222.0.25 () {60 vars in 1131 bytes} [Thu May 12 06:32:28 2022] POST /identity/v3/users => generated 160 bytes in 246 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:29.119471 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5dc026-fef9-426a-909a-2241ff637163 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:29.197320 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8746e73-6e55-4402-8e69-f63134da5097 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:29.230008 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5dc026-fef9-426a-909a-2241ff637163 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:29.236203 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e262a6b-00b1-4b28-9d2f-3e40e130b65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:29.237120 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e262a6b-00b1-4b28-9d2f-3e40e130b65a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:29.237638 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e262a6b-00b1-4b28-9d2f-3e40e130b65a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:29.238126 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e262a6b-00b1-4b28-9d2f-3e40e130b65a None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:29.239163 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e262a6b-00b1-4b28-9d2f-3e40e130b65a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:29.239725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e262a6b-00b1-4b28-9d2f-3e40e130b65a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:29.241365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e262a6b-00b1-4b28-9d2f-3e40e130b65a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:29.255400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 474/986] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:32:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:29.261975 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e262a6b-00b1-4b28-9d2f-3e40e130b65a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:29.272494 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cb049-eed7-47a4-8099-7de72e0aeb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:29.273715 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cb049-eed7-47a4-8099-7de72e0aeb4b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:29.274227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cb049-eed7-47a4-8099-7de72e0aeb4b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:29.274754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cb049-eed7-47a4-8099-7de72e0aeb4b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:29.282950 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7cb049-eed7-47a4-8099-7de72e0aeb4b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:29.284954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7cb049-eed7-47a4-8099-7de72e0aeb4b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:29.299727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-9a7cb049-eed7-47a4-8099-7de72e0aeb4b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 06:32:29.299727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:29.299727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:29.299727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:29.299727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:29.299727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:29.299727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:29.299727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:29.299727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:29.299727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:29.299727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:29.299727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:29.299727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:32:29.299727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:32:29.299727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:32:29.299727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:32:29.300716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:29.300716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:29.300716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:32:29.300716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:29.300716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:32:29.300716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:29.300716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:29.300716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:29.300716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:29.300716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:29.300716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:29.300716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:29.300716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:29.300716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:29.300716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:29.300716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:29.300716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:29.300716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:29.301755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:29.301755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:29.301755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:32:29.301755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:32:29.301755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:32:29.301755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:32:29.301755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:32:29.301755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:32:29.301755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 06:32:29.301755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:29.305593 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 513/987] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:32:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:29.311777 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cb049-eed7-47a4-8099-7de72e0aeb4b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:29.369242 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e262a6b-00b1-4b28-9d2f-3e40e130b65a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:29.407144 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59d25d-d611-46ae-b944-51efb304109d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:29.408267 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59d25d-d611-46ae-b944-51efb304109d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:29.408767 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59d25d-d611-46ae-b944-51efb304109d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:29.409253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59d25d-d611-46ae-b944-51efb304109d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:29.410367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59d25d-d611-46ae-b944-51efb304109d None admin] RBAC: Adding query filter params (role.id=b675985f8bdd471ab51fb4fc2daff01e, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=7a25a3f2c9a148a1ae73e519070b190b) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:29.410908 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59d25d-d611-46ae-b944-51efb304109d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:29.412572 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59d25d-d611-46ae-b944-51efb304109d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:29.418587 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cb049-eed7-47a4-8099-7de72e0aeb4b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:29.420007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 475/988] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:32:29 2022] GET /identity/v3/role_assignments?user.id=7a25a3f2c9a148a1ae73e519070b190b&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=b675985f8bdd471ab51fb4fc2daff01e => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:29.467240 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21ebb3-4354-4315-afb1-33ade1096d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:29.468027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21ebb3-4354-4315-afb1-33ade1096d50 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:29.468314 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21ebb3-4354-4315-afb1-33ade1096d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:29.468592 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21ebb3-4354-4315-afb1-33ade1096d50 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:29.469479 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21ebb3-4354-4315-afb1-33ade1096d50 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:29.469786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21ebb3-4354-4315-afb1-33ade1096d50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:29.471295 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21ebb3-4354-4315-afb1-33ade1096d50 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:29.519987 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 514/989] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 12 06:32:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:30.498282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7461e-d7da-43d6-9687-e679af282d53 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:30.498782 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7461e-d7da-43d6-9687-e679af282d53 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:30.498887 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7461e-d7da-43d6-9687-e679af282d53 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:30.500409 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 476/990] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:30.505592 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75886e-44a1-4bca-a4f1-2a3f06628f6a None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:30.505978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75886e-44a1-4bca-a4f1-2a3f06628f6a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:30.506170 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75886e-44a1-4bca-a4f1-2a3f06628f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:30.523155 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-cc75886e-44a1-4bca-a4f1-2a3f06628f6a None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:30.524685 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-cc75886e-44a1-4bca-a4f1-2a3f06628f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:30.588748 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 515/991] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:30.611154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7461e-d7da-43d6-9687-e679af282d53 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:30.709014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7461e-d7da-43d6-9687-e679af282d53 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:30.742067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a86ec-832d-4c10-b4e5-15186c9b7c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:30.742895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a86ec-832d-4c10-b4e5-15186c9b7c43 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:30.743174 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a86ec-832d-4c10-b4e5-15186c9b7c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:30.743441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a86ec-832d-4c10-b4e5-15186c9b7c43 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:30.744142 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a86ec-832d-4c10-b4e5-15186c9b7c43 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:30.745557 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a86ec-832d-4c10-b4e5-15186c9b7c43 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:30.758727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-1a5a86ec-832d-4c10-b4e5-15186c9b7c43 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 06:32:30.758727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:30.758727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:32:30.758727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:32:30.758727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:32:30.758727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:32:30.758727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:32:30.758727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:30.758727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 06:32:30.758727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:30.758727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:30.758727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:30.758727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:30.758727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:30.758727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:30.758727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:30.758727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:30.759925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:30.759925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:30.759925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:30.759925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:30.759925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:30.759925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:30.759925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:32:30.759925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:32:30.759925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:32:30.759925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:32:30.759925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:30.759925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:30.759925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:30.759925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:30.759925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:30.759925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:30.760837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:30.760837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:30.760837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:30.760837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:30.760837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:30.760837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:30.760837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:30.760837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:30.760837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:30.760837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:30.760837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:32:30.760837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:30.760837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 06:32:30.760837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:30.762981 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 477/992] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 12 06:32:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:30.766312 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75886e-44a1-4bca-a4f1-2a3f06628f6a None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:30.862498 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75886e-44a1-4bca-a4f1-2a3f06628f6a None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:30.895127 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dae4f-c457-4917-9511-693ad1878485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:30.895825 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dae4f-c457-4917-9511-693ad1878485 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:30.896109 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dae4f-c457-4917-9511-693ad1878485 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:30.896384 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dae4f-c457-4917-9511-693ad1878485 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:30.897094 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6dae4f-c457-4917-9511-693ad1878485 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:30.897399 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6dae4f-c457-4917-9511-693ad1878485 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:30.898764 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6dae4f-c457-4917-9511-693ad1878485 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:30.908160 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 516/993] 10.222.0.25 () {56 vars in 1122 bytes} [Thu May 12 06:32:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:30.909366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a86ec-832d-4c10-b4e5-15186c9b7c43 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:30.936402 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d4e90-961d-44fd-a42a-0f2f943eef48 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:30.936684 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d4e90-961d-44fd-a42a-0f2f943eef48 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:30.936955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d4e90-961d-44fd-a42a-0f2f943eef48 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:30.948111 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 517/994] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:32:30.948111 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702426fb-813a-4bd8-9232-0f0d521b2ce6 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:30.948111 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702426fb-813a-4bd8-9232-0f0d521b2ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:30.948111 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702426fb-813a-4bd8-9232-0f0d521b2ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:30.961316 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-702426fb-813a-4bd8-9232-0f0d521b2ce6 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:30.962487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-702426fb-813a-4bd8-9232-0f0d521b2ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:31.019446 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a86ec-832d-4c10-b4e5-15186c9b7c43 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:31.031967 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 518/995] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:32:31.047070 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f18e07-a399-47a0-a5ed-0cc55f0f053b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:31.047767 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f18e07-a399-47a0-a5ed-0cc55f0f053b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:31.048052 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f18e07-a399-47a0-a5ed-0cc55f0f053b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:31.048323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f18e07-a399-47a0-a5ed-0cc55f0f053b None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:31.049025 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f18e07-a399-47a0-a5ed-0cc55f0f053b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:31.049326 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f18e07-a399-47a0-a5ed-0cc55f0f053b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:31.050681 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f18e07-a399-47a0-a5ed-0cc55f0f053b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:31.055614 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702426fb-813a-4bd8-9232-0f0d521b2ce6 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:31.060537 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 478/996] 10.222.0.25 () {56 vars in 1122 bytes} [Thu May 12 06:32:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:31.061339 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f18e07-a399-47a0-a5ed-0cc55f0f053b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:31.156289 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702426fb-813a-4bd8-9232-0f0d521b2ce6 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:31.160442 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f18e07-a399-47a0-a5ed-0cc55f0f053b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:31.190439 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f82543-5db2-4ee1-8bd5-cbc736b6d4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:31.191253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f82543-5db2-4ee1-8bd5-cbc736b6d4ca None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:31.191618 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f82543-5db2-4ee1-8bd5-cbc736b6d4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:31.191937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f82543-5db2-4ee1-8bd5-cbc736b6d4ca None admin] PATH_INFO: `/v3/services/compute` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:31.192596 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f82543-5db2-4ee1-8bd5-cbc736b6d4ca None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:31.193977 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f82543-5db2-4ee1-8bd5-cbc736b6d4ca None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:31.194536 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add6d1c-eafe-4966-8baa-60a75b050da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:31.195347 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add6d1c-eafe-4966-8baa-60a75b050da1 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:31.195802 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add6d1c-eafe-4966-8baa-60a75b050da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:31.196215 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add6d1c-eafe-4966-8baa-60a75b050da1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:31.197113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add6d1c-eafe-4966-8baa-60a75b050da1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:31.198582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add6d1c-eafe-4966-8baa-60a75b050da1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:31.205688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-b1f82543-5db2-4ee1-8bd5-cbc736b6d4ca None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 06:32:31.205688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:31.205688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:32:31.205688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:32:31.205688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:32:31.205688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:32:31.205688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:32:31.205688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:31.205688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 06:32:31.205688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:31.205688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:31.205688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:31.205688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:31.205688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:31.205688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:31.205688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:31.205688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:31.206900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:31.206900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:31.206900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:31.206900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:31.206900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:31.206900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:31.206900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:32:31.206900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:32:31.206900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:32:31.206900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:32:31.206900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:31.206900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:31.206900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:31.206900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:31.206900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:31.206900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:31.208542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:31.208542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:31.208542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:31.208542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:31.208542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:31.208542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:31.208542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:31.208542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:31.208542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:31.208542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:31.208542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:32:31.208542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:31.208542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 06:32:31.208542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:31.211823 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 519/997] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:32:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:31.213293 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f82543-5db2-4ee1-8bd5-cbc736b6d4ca None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:31.299727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 479/998] 10.222.0.25 () {60 vars in 1144 bytes} [Thu May 12 06:32:31 2022] POST /identity/v3/endpoints => generated 325 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:32:31.318715 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f82543-5db2-4ee1-8bd5-cbc736b6d4ca None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:31.361555 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c5374-0ef2-4e2a-996c-080b435deab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:31.362241 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c5374-0ef2-4e2a-996c-080b435deab9 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:31.362518 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c5374-0ef2-4e2a-996c-080b435deab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:31.362783 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c5374-0ef2-4e2a-996c-080b435deab9 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:31.363550 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c5374-0ef2-4e2a-996c-080b435deab9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:31.363884 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c5374-0ef2-4e2a-996c-080b435deab9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:31.365293 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c5374-0ef2-4e2a-996c-080b435deab9 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:31.375575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 520/999] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 12 06:32:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:31.377485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add6d1c-eafe-4966-8baa-60a75b050da1 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:31.481349 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add6d1c-eafe-4966-8baa-60a75b050da1 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:31.514797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58c658-e0cb-4554-94a5-5b8a2fade831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:31.515578 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58c658-e0cb-4554-94a5-5b8a2fade831 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:31.515819 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58c658-e0cb-4554-94a5-5b8a2fade831 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:31.516036 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58c658-e0cb-4554-94a5-5b8a2fade831 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:31.516738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58c658-e0cb-4554-94a5-5b8a2fade831 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:31.517037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58c658-e0cb-4554-94a5-5b8a2fade831 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:31.518407 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58c658-e0cb-4554-94a5-5b8a2fade831 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:31.523791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 480/1000] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 12 06:32:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:31.529834 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c5374-0ef2-4e2a-996c-080b435deab9 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:31.630838 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c5374-0ef2-4e2a-996c-080b435deab9 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:31.662336 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c4fc6-0e3e-4a82-b6f9-8434250c5227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:31.662995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c4fc6-0e3e-4a82-b6f9-8434250c5227 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:31.663271 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c4fc6-0e3e-4a82-b6f9-8434250c5227 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:31.663541 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c4fc6-0e3e-4a82-b6f9-8434250c5227 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:31.664630 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c4fc6-0e3e-4a82-b6f9-8434250c5227 None admin] RBAC: Adding query filter params (interface=public, service_id=7ca15cd77cdc4747a5777973b5ef0891, region_id=RegionOne) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:31.664930 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c4fc6-0e3e-4a82-b6f9-8434250c5227 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:31.666290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c4fc6-0e3e-4a82-b6f9-8434250c5227 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:31.671222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 521/1001] 10.222.0.25 () {56 vars in 1251 bytes} [Thu May 12 06:32:31 2022] GET /identity/v3/endpoints?service_id=7ca15cd77cdc4747a5777973b5ef0891&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:31.677055 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58c658-e0cb-4554-94a5-5b8a2fade831 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:31.732082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599784f9-82ae-42b8-959d-1f3cc12ad67c None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:31.732372 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599784f9-82ae-42b8-959d-1f3cc12ad67c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:31.732654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599784f9-82ae-42b8-959d-1f3cc12ad67c None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:31.734151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 522/1002] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:32:31.738943 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ab195-29c7-4a3d-9346-36805ff5ce57 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:31.739242 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ab195-29c7-4a3d-9346-36805ff5ce57 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:31.739514 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ab195-29c7-4a3d-9346-36805ff5ce57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:31.756547 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d22ab195-29c7-4a3d-9346-36805ff5ce57 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:31.757735 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d22ab195-29c7-4a3d-9346-36805ff5ce57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:31.779472 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58c658-e0cb-4554-94a5-5b8a2fade831 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:31.812379 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a03d32-cc96-4f7f-8b67-21e81308bfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:31.813362 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a03d32-cc96-4f7f-8b67-21e81308bfe0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:31.813827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a03d32-cc96-4f7f-8b67-21e81308bfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:31.814253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a03d32-cc96-4f7f-8b67-21e81308bfe0 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:31.815084 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a03d32-cc96-4f7f-8b67-21e81308bfe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:31.817232 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a03d32-cc96-4f7f-8b67-21e81308bfe0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:31.823356 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 481/1003] 10.222.0.25 () {56 vars in 1087 bytes} [Thu May 12 06:32:31 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:32:31.826188 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 523/1004] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:31 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:31.849178 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a03d32-cc96-4f7f-8b67-21e81308bfe0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:31.952868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a03d32-cc96-4f7f-8b67-21e81308bfe0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:31.989486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac51c83-64f0-429d-9116-606e9c41a1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:31.990783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac51c83-64f0-429d-9116-606e9c41a1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:31.991286 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac51c83-64f0-429d-9116-606e9c41a1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:31.991803 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac51c83-64f0-429d-9116-606e9c41a1f2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:31.993199 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac51c83-64f0-429d-9116-606e9c41a1f2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:31.994820 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac51c83-64f0-429d-9116-606e9c41a1f2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:32.008391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-2ac51c83-64f0-429d-9116-606e9c41a1f2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 06:32:32.008391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:32.008391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:32:32.008391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:32:32.008391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:32:32.008391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:32:32.008391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:32:32.008391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:32.008391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 06:32:32.008391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:32.008391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:32.008391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:32.008391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:32.008391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:32.008391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:32.008391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:32.008391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:32.009500 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:32.009500 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:32.009500 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:32.009500 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:32.009500 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:32.009500 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:32.009500 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:32:32.009500 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:32:32.009500 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:32:32.009500 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:32:32.009500 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:32.009500 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:32.009500 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:32.009500 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:32.009500 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:32.009500 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:32.010370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:32.010370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:32.010370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:32.010370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:32.010370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:32.010370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:32.010370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:32.010370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:32.010370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:32.010370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:32.010370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:32:32.010370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:32.010370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 06:32:32.010370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:32.013116 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 482/1005] 10.222.0.25 () {56 vars in 1105 bytes} [Thu May 12 06:32:31 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:32.018964 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ab195-29c7-4a3d-9346-36805ff5ce57 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:32.115771 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ab195-29c7-4a3d-9346-36805ff5ce57 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:32.157479 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054496d0-0652-40ba-8f1f-ee2495cfb2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:32.158148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054496d0-0652-40ba-8f1f-ee2495cfb2dc None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:32.158429 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054496d0-0652-40ba-8f1f-ee2495cfb2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:32.158701 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054496d0-0652-40ba-8f1f-ee2495cfb2dc None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:32.159409 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054496d0-0652-40ba-8f1f-ee2495cfb2dc None admin] RBAC: Adding query filter params (name=image) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:32.159737 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054496d0-0652-40ba-8f1f-ee2495cfb2dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:32.161139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054496d0-0652-40ba-8f1f-ee2495cfb2dc None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:32.166370 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 524/1006] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:32.171594 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac51c83-64f0-429d-9116-606e9c41a1f2 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:32.269716 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac51c83-64f0-429d-9116-606e9c41a1f2 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:32.301794 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79c6dd-ed6a-4d2f-9836-557a584e66e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:32.302454 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79c6dd-ed6a-4d2f-9836-557a584e66e2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:32.302789 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79c6dd-ed6a-4d2f-9836-557a584e66e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:32.303068 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79c6dd-ed6a-4d2f-9836-557a584e66e2 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:32.303795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79c6dd-ed6a-4d2f-9836-557a584e66e2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:32.304102 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79c6dd-ed6a-4d2f-9836-557a584e66e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:32.305454 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79c6dd-ed6a-4d2f-9836-557a584e66e2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:32.315719 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 483/1007] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:32 2022] GET /identity/v3/services?type=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:33.553113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa00e3-d655-417f-a1e5-518312db2635 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:33.553635 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa00e3-d655-417f-a1e5-518312db2635 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:33.553635 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa00e3-d655-417f-a1e5-518312db2635 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:33.555025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 525/1008] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:33.560328 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dbae0-a720-4b09-ad6d-a2640971d4c0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:33.560706 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dbae0-a720-4b09-ad6d-a2640971d4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:33.560883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dbae0-a720-4b09-ad6d-a2640971d4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:33.577539 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2b4dbae0-a720-4b09-ad6d-a2640971d4c0 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:33.578728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2b4dbae0-a720-4b09-ad6d-a2640971d4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:33.643130 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 484/1009] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:33.666832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa00e3-d655-417f-a1e5-518312db2635 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:33.763172 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa00e3-d655-417f-a1e5-518312db2635 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:33.796308 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88576243-cd07-46df-8700-637c8336c767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:33.797103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88576243-cd07-46df-8700-637c8336c767 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:33.797386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88576243-cd07-46df-8700-637c8336c767 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:33.797660 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88576243-cd07-46df-8700-637c8336c767 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:33.798823 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88576243-cd07-46df-8700-637c8336c767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:33.800281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88576243-cd07-46df-8700-637c8336c767 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:33.802092 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 526/1010] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:33.807630 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4dbae0-a720-4b09-ad6d-a2640971d4c0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:33.906598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4dbae0-a720-4b09-ad6d-a2640971d4c0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:33.940094 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a80891-f9cf-423c-9e31-53a88848b9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:33.940759 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a80891-f9cf-423c-9e31-53a88848b9e1 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:33.944119 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a80891-f9cf-423c-9e31-53a88848b9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:33.944119 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a80891-f9cf-423c-9e31-53a88848b9e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:33.944119 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a80891-f9cf-423c-9e31-53a88848b9e1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:33.944119 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a80891-f9cf-423c-9e31-53a88848b9e1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:34.065944 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 485/1011] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 12 06:32:33 2022] POST /identity/v3/projects => generated 311 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:32:34.066128 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a057825-6a98-440b-815e-053ab96a5950 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:34.066128 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a057825-6a98-440b-815e-053ab96a5950 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:34.066128 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a057825-6a98-440b-815e-053ab96a5950 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:34.066128 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 527/1012] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:32:34.068358 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8994758-95c1-4c51-a7dd-a260ccefdaf4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:34.068657 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8994758-95c1-4c51-a7dd-a260ccefdaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:34.068940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8994758-95c1-4c51-a7dd-a260ccefdaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:34.087075 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f8994758-95c1-4c51-a7dd-a260ccefdaf4 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:34.088322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f8994758-95c1-4c51-a7dd-a260ccefdaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:34.165712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 486/1013] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:34 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:34.188414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a057825-6a98-440b-815e-053ab96a5950 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:34.291550 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a057825-6a98-440b-815e-053ab96a5950 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:34.325621 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61e5e1-28cc-41b6-a92d-e5db48fb921e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:34.326678 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61e5e1-28cc-41b6-a92d-e5db48fb921e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:34.327117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61e5e1-28cc-41b6-a92d-e5db48fb921e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:34.327568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61e5e1-28cc-41b6-a92d-e5db48fb921e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:34.328442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61e5e1-28cc-41b6-a92d-e5db48fb921e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:34.330007 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61e5e1-28cc-41b6-a92d-e5db48fb921e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:34.343627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-3f61e5e1-28cc-41b6-a92d-e5db48fb921e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 06:32:34.343627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:34.343627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:32:34.343627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:32:34.343627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:32:34.343627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:32:34.343627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:32:34.343627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:34.343627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 06:32:34.343627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:34.343627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:34.343627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:34.343627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:34.343627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:34.343627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:34.343627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:34.343627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:34.344984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:34.344984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:34.344984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:34.344984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:34.344984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:34.344984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:34.344984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:32:34.344984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:32:34.344984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:32:34.344984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:32:34.344984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:34.344984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:34.344984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:34.344984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:34.344984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:34.344984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:34.346082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:34.346082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:34.346082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:34.346082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:34.346082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:34.346082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:34.346082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:34.346082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:34.346082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:34.346082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:34.346082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:32:34.346082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:34.346082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 06:32:34.346082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:34.349126 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 528/1014] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:32:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:34.355462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8994758-95c1-4c51-a7dd-a260ccefdaf4 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:34.452263 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8994758-95c1-4c51-a7dd-a260ccefdaf4 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:34.485866 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaeee29-0845-48d2-9e1a-d5f1984d721b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:34.486898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaeee29-0845-48d2-9e1a-d5f1984d721b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:34.487387 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaeee29-0845-48d2-9e1a-d5f1984d721b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:34.487900 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaeee29-0845-48d2-9e1a-d5f1984d721b None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:34.489409 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaeee29-0845-48d2-9e1a-d5f1984d721b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:34.489945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaeee29-0845-48d2-9e1a-d5f1984d721b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:34.491510 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaeee29-0845-48d2-9e1a-d5f1984d721b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:34.496615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 487/1015] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 12 06:32:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:34.502359 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61e5e1-28cc-41b6-a92d-e5db48fb921e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:34.523839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6742ad-6da4-47ea-9ee1-835f8a946908 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:34.524178 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6742ad-6da4-47ea-9ee1-835f8a946908 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:34.524408 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6742ad-6da4-47ea-9ee1-835f8a946908 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:34.525920 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 488/1016] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:32:34.530655 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7811399-0f12-4804-9727-729c543233f7 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:34.530940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7811399-0f12-4804-9727-729c543233f7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:34.531215 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7811399-0f12-4804-9727-729c543233f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:34.548089 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a7811399-0f12-4804-9727-729c543233f7 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:34.549273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a7811399-0f12-4804-9727-729c543233f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:34.601805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61e5e1-28cc-41b6-a92d-e5db48fb921e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:34.614403 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 489/1017] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:34 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:32:34.634653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f3aa1-4501-4d95-811f-8ddf808694b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:34.635613 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f3aa1-4501-4d95-811f-8ddf808694b6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:34.636131 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f3aa1-4501-4d95-811f-8ddf808694b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:34.636616 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f3aa1-4501-4d95-811f-8ddf808694b6 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:34.637272 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7811399-0f12-4804-9727-729c543233f7 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:34.637771 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f3aa1-4501-4d95-811f-8ddf808694b6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:34.638282 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f3aa1-4501-4d95-811f-8ddf808694b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:34.639856 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f3aa1-4501-4d95-811f-8ddf808694b6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:34.645096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 529/1018] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 12 06:32:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:34.650716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f3aa1-4501-4d95-811f-8ddf808694b6 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:34.733873 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7811399-0f12-4804-9727-729c543233f7 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:34.746751 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f3aa1-4501-4d95-811f-8ddf808694b6 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:34.766762 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25fee6-972d-4382-88bb-ecbc71cca745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:34.767484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25fee6-972d-4382-88bb-ecbc71cca745 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:34.767812 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25fee6-972d-4382-88bb-ecbc71cca745 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:34.768087 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25fee6-972d-4382-88bb-ecbc71cca745 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:34.768807 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25fee6-972d-4382-88bb-ecbc71cca745 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:34.770222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25fee6-972d-4382-88bb-ecbc71cca745 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:34.779742 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c4dbc-cf69-43c6-b38d-dec3d52aee8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:34.780401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c4dbc-cf69-43c6-b38d-dec3d52aee8a None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:34.780684 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c4dbc-cf69-43c6-b38d-dec3d52aee8a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:34.780957 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c4dbc-cf69-43c6-b38d-dec3d52aee8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:34.781692 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c4dbc-cf69-43c6-b38d-dec3d52aee8a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:34.783026 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c4dbc-cf69-43c6-b38d-dec3d52aee8a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:34.893577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 490/1019] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 12 06:32:34 2022] POST /identity/v3/services => generated 242 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:32:34.911741 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 530/1020] 10.222.0.25 () {60 vars in 1144 bytes} [Thu May 12 06:32:34 2022] POST /identity/v3/endpoints => generated 334 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:32:36.320687 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda0302-c307-430e-ac88-090961ea5210 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:36.321193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda0302-c307-430e-ac88-090961ea5210 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:36.321193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda0302-c307-430e-ac88-090961ea5210 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:36.322673 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 491/1021] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:36.327704 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d784a9-6209-4d68-bd08-a0316649ed70 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:36.328080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d784a9-6209-4d68-bd08-a0316649ed70 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:36.328274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d784a9-6209-4d68-bd08-a0316649ed70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:36.344483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e8d784a9-6209-4d68-bd08-a0316649ed70 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:36.345667 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e8d784a9-6209-4d68-bd08-a0316649ed70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:36.415142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 531/1022] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:36.439259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda0302-c307-430e-ac88-090961ea5210 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:36.535269 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda0302-c307-430e-ac88-090961ea5210 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:36.568409 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d277d-020e-4510-a0ba-0d6cb0288a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:36.569200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d277d-020e-4510-a0ba-0d6cb0288a6b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:36.569479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d277d-020e-4510-a0ba-0d6cb0288a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:36.569748 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d277d-020e-4510-a0ba-0d6cb0288a6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:36.570961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d277d-020e-4510-a0ba-0d6cb0288a6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:36.572370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d277d-020e-4510-a0ba-0d6cb0288a6b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:36.574180 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 492/1023] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:36.579587 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d784a9-6209-4d68-bd08-a0316649ed70 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:36.682193 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d784a9-6209-4d68-bd08-a0316649ed70 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:36.714986 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f477b-5543-453d-92a9-30c90e8c7b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:36.715651 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f477b-5543-453d-92a9-30c90e8c7b22 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:36.715974 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f477b-5543-453d-92a9-30c90e8c7b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:36.716242 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f477b-5543-453d-92a9-30c90e8c7b22 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:36.716997 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f477b-5543-453d-92a9-30c90e8c7b22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:36.718393 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f477b-5543-453d-92a9-30c90e8c7b22 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:36.790535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 532/1024] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 12 06:32:36 2022] POST /identity/v3/users => generated 285 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:32:37.138137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55e5e9-df0e-4dd2-8981-db9bbbd0eb43 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:37.138544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55e5e9-df0e-4dd2-8981-db9bbbd0eb43 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:37.138743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55e5e9-df0e-4dd2-8981-db9bbbd0eb43 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:37.140120 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 493/1025] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:37.146106 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603fd6a-837f-423c-8fbe-bf260533cf05 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:37.146387 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603fd6a-837f-423c-8fbe-bf260533cf05 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:37.146658 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603fd6a-837f-423c-8fbe-bf260533cf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:37.163146 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-a603fd6a-837f-423c-8fbe-bf260533cf05 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:37.164617 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a603fd6a-837f-423c-8fbe-bf260533cf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:37.229436 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 533/1026] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:37.249931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fe73b-b19a-4902-86c3-de31ee16cd81 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:37.250205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fe73b-b19a-4902-86c3-de31ee16cd81 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:37.250420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fe73b-b19a-4902-86c3-de31ee16cd81 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:37.251815 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 494/1027] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:37.252321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603fd6a-837f-423c-8fbe-bf260533cf05 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:37.257126 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d04a87-8a8e-4473-95b1-7720fc12caf0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:37.257408 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d04a87-8a8e-4473-95b1-7720fc12caf0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:37.257680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d04a87-8a8e-4473-95b1-7720fc12caf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:37.274448 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b6d04a87-8a8e-4473-95b1-7720fc12caf0 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:37.275634 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b6d04a87-8a8e-4473-95b1-7720fc12caf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:37.350882 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 495/1028] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:32:37.353161 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603fd6a-837f-423c-8fbe-bf260533cf05 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:37.368952 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d04a87-8a8e-4473-95b1-7720fc12caf0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:37.388264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77cb22-e477-415a-add2-63451a5d1e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:37.389286 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77cb22-e477-415a-add2-63451a5d1e62 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:37.389563 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77cb22-e477-415a-add2-63451a5d1e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:37.389831 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77cb22-e477-415a-add2-63451a5d1e62 None admin] PATH_INFO: `/v3/services/image` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:37.390485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77cb22-e477-415a-add2-63451a5d1e62 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:37.391857 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77cb22-e477-415a-add2-63451a5d1e62 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:37.404671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-cd77cb22-e477-415a-add2-63451a5d1e62 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 06:32:37.404671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:37.404671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:32:37.404671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:32:37.404671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:32:37.404671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:32:37.404671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:32:37.404671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:37.404671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 06:32:37.404671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:37.404671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:37.404671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:37.404671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:37.404671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:37.404671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:37.404671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:37.404671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:37.405717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:37.405717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:37.405717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:37.405717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:37.405717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:37.405717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:37.405717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:32:37.405717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:32:37.405717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:32:37.405717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:32:37.405717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:37.405717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:37.405717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:37.405717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:37.405717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:37.405717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:37.406605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:37.406605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:37.406605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:37.406605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:37.406605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:37.406605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:37.406605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:37.406605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:37.406605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:37.406605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:37.406605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:32:37.406605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:37.406605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 06:32:37.406605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:37.406605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 534/1029] 10.222.0.25 () {56 vars in 1105 bytes} [Thu May 12 06:32:37 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:37.411930 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77cb22-e477-415a-add2-63451a5d1e62 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:37.469667 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d04a87-8a8e-4473-95b1-7720fc12caf0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:37.502116 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d5320-5ac2-46ff-9869-696dc656a923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:37.502851 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d5320-5ac2-46ff-9869-696dc656a923 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:37.503147 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d5320-5ac2-46ff-9869-696dc656a923 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:37.503449 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d5320-5ac2-46ff-9869-696dc656a923 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:37.511441 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77cb22-e477-415a-add2-63451a5d1e62 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:37.516227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d5320-5ac2-46ff-9869-696dc656a923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:32:37.525037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5f3d5320-5ac2-46ff-9869-696dc656a923 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 06:32:37.525037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:37.525037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:37.525037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:37.525037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:37.525037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:37.525037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:37.525037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:37.525037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:37.525037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:37.525037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:37.525037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:37.525037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:32:37.525037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:32:37.525037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:32:37.525037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:32:37.526000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:32:37.526000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:32:37.526000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:32:37.526000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:32:37.526000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:37.526000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:37.526000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:37.526000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:37.526000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:37.526000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:37.526000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:37.526000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:37.526000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:37.526000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:37.526000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:37.526000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:37.526874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:37.526874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:37.526874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:37.526874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:37.526874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:32:37.526874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:32:37.526874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:32:37.526874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:32:37.526874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:32:37.526874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:32:37.526874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 06:32:37.526874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:37.526874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 496/1030] 10.222.0.25 () {56 vars in 1120 bytes} [Thu May 12 06:32:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:37.532092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d5320-5ac2-46ff-9869-696dc656a923 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:37.547262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3767e58-e5fb-4b75-bc54-78fc1c889af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:37.547966 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3767e58-e5fb-4b75-bc54-78fc1c889af3 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:37.548249 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3767e58-e5fb-4b75-bc54-78fc1c889af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:37.548521 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3767e58-e5fb-4b75-bc54-78fc1c889af3 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:37.549230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3767e58-e5fb-4b75-bc54-78fc1c889af3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:37.549536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3767e58-e5fb-4b75-bc54-78fc1c889af3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:37.550898 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3767e58-e5fb-4b75-bc54-78fc1c889af3 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:37.560425 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 535/1031] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:37.561340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3767e58-e5fb-4b75-bc54-78fc1c889af3 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:37.634113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d5320-5ac2-46ff-9869-696dc656a923 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:37.659636 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3767e58-e5fb-4b75-bc54-78fc1c889af3 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:37.668426 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4f4b5-ba00-47ff-9a20-248c90e49c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:37.669096 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4f4b5-ba00-47ff-9a20-248c90e49c19 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:37.669375 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4f4b5-ba00-47ff-9a20-248c90e49c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:37.669644 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4f4b5-ba00-47ff-9a20-248c90e49c19 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:37.670390 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4f4b5-ba00-47ff-9a20-248c90e49c19 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:37.670692 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4f4b5-ba00-47ff-9a20-248c90e49c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:37.672080 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4f4b5-ba00-47ff-9a20-248c90e49c19 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:37.680184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 497/1032] 10.222.0.25 () {56 vars in 1115 bytes} [Thu May 12 06:32:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:37.685571 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4f4b5-ba00-47ff-9a20-248c90e49c19 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:37.693850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4d599-f6ea-4d65-8761-90c3bc1f3140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:37.694517 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4d599-f6ea-4d65-8761-90c3bc1f3140 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:37.694798 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4d599-f6ea-4d65-8761-90c3bc1f3140 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:37.695071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4d599-f6ea-4d65-8761-90c3bc1f3140 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:37.695797 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4d599-f6ea-4d65-8761-90c3bc1f3140 None admin] RBAC: Adding query filter params (type=image) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:37.696100 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4d599-f6ea-4d65-8761-90c3bc1f3140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:37.697451 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4d599-f6ea-4d65-8761-90c3bc1f3140 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:37.702139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 536/1033] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:37.707766 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4d599-f6ea-4d65-8761-90c3bc1f3140 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:37.786606 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4f4b5-ba00-47ff-9a20-248c90e49c19 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:37.802619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4d599-f6ea-4d65-8761-90c3bc1f3140 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:37.819137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6094b9-0e96-4d02-8d3e-ee306d3d705d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:37.819948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6094b9-0e96-4d02-8d3e-ee306d3d705d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:37.820232 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6094b9-0e96-4d02-8d3e-ee306d3d705d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:37.820503 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6094b9-0e96-4d02-8d3e-ee306d3d705d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:37.830597 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6094b9-0e96-4d02-8d3e-ee306d3d705d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:37.832153 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6094b9-0e96-4d02-8d3e-ee306d3d705d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:37.834726 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d22e96-cfcc-435b-afb3-38788967d13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:37.835373 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d22e96-cfcc-435b-afb3-38788967d13d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:37.835651 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d22e96-cfcc-435b-afb3-38788967d13d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:37.835965 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d22e96-cfcc-435b-afb3-38788967d13d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:37.836750 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d22e96-cfcc-435b-afb3-38788967d13d None admin] RBAC: Adding query filter params (interface=public, service_id=e1378194b80846c7a0de1d38e724563f, region_id=RegionOne) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:37.837056 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d22e96-cfcc-435b-afb3-38788967d13d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:37.838373 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d22e96-cfcc-435b-afb3-38788967d13d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:37.843785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 537/1034] 10.222.0.25 () {56 vars in 1251 bytes} [Thu May 12 06:32:37 2022] GET /identity/v3/endpoints?service_id=e1378194b80846c7a0de1d38e724563f&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:37.849211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-cb6094b9-0e96-4d02-8d3e-ee306d3d705d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:37.849211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:37.849211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:37.849211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:37.849211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:37.849211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:37.849211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:37.849211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:37.849211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:37.849211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:37.849211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:37.849211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:37.849211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:37.849211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:37.849211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:37.850098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:37.850098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:37.850098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:37.850098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:37.850098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:37.850098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:37.850098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:37.850098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:37.850098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:37.850098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:37.850098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:37.850098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:37.850098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:37.850098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:37.850098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:37.850098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:37.850098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:37.851035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:37.851035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:37.851035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:37.851035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:37.851262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d22e96-cfcc-435b-afb3-38788967d13d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:37.854902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 498/1035] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:37.855699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6094b9-0e96-4d02-8d3e-ee306d3d705d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:37.948798 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d22e96-cfcc-435b-afb3-38788967d13d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:37.951737 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6094b9-0e96-4d02-8d3e-ee306d3d705d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:37.986220 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422b4cf-3238-4cad-9707-ae8a15746d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:37.986884 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422b4cf-3238-4cad-9707-ae8a15746d1e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:37.987164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422b4cf-3238-4cad-9707-ae8a15746d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:37.987434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aeffa5-314c-4d55-914f-b1caae6342b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:37.987552 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422b4cf-3238-4cad-9707-ae8a15746d1e None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:37.993395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeffa5-314c-4d55-914f-b1caae6342b8 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:37.994046 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422b4cf-3238-4cad-9707-ae8a15746d1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:37.994141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeffa5-314c-4d55-914f-b1caae6342b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:37.994247 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422b4cf-3238-4cad-9707-ae8a15746d1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:37.994346 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeffa5-314c-4d55-914f-b1caae6342b8 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:37.994346 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aeffa5-314c-4d55-914f-b1caae6342b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:37.994508 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422b4cf-3238-4cad-9707-ae8a15746d1e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:37.994593 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aeffa5-314c-4d55-914f-b1caae6342b8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:38.000726 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 538/1036] 10.222.0.25 () {56 vars in 1087 bytes} [Thu May 12 06:32:37 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 06:32:38.007016 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 499/1037] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:38.008166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aeffa5-314c-4d55-914f-b1caae6342b8 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:38.112943 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aeffa5-314c-4d55-914f-b1caae6342b8 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:38.147017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8aca3-1972-4841-a5e8-b47abbc98988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:38.147911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8aca3-1972-4841-a5e8-b47abbc98988 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:38.148243 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8aca3-1972-4841-a5e8-b47abbc98988 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:38.148518 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8aca3-1972-4841-a5e8-b47abbc98988 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:38.156734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8aca3-1972-4841-a5e8-b47abbc98988 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:38.158190 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8aca3-1972-4841-a5e8-b47abbc98988 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:38.173830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-2db8aca3-1972-4841-a5e8-b47abbc98988 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 06:32:38.173830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:38.173830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:38.173830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:38.173830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:38.173830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:38.173830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:38.173830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:38.173830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:38.173830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:38.173830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:38.173830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:38.173830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:32:38.173830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:32:38.173830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:32:38.173830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:32:38.174876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:38.174876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:38.174876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:32:38.174876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:38.174876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:32:38.174876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:38.174876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:38.174876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:38.174876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:38.174876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:38.174876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:38.174876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:38.174876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:38.174876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:38.174876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:38.174876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:38.174876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:38.174876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:38.176353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:38.176353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:38.176353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:32:38.176353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:32:38.176353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:32:38.176353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:32:38.176353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:32:38.176353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:32:38.176353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 06:32:38.176353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:38.176353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 539/1038] 10.222.0.25 () {56 vars in 1093 bytes} [Thu May 12 06:32:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:38.181067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422b4cf-3238-4cad-9707-ae8a15746d1e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:38.280941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422b4cf-3238-4cad-9707-ae8a15746d1e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:38.314451 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ece51b-93e9-4a06-a3fc-31eb24a14190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:38.315417 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ece51b-93e9-4a06-a3fc-31eb24a14190 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:38.315904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ece51b-93e9-4a06-a3fc-31eb24a14190 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:38.316889 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ece51b-93e9-4a06-a3fc-31eb24a14190 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:38.317912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ece51b-93e9-4a06-a3fc-31eb24a14190 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:38.318397 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ece51b-93e9-4a06-a3fc-31eb24a14190 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:38.320008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ece51b-93e9-4a06-a3fc-31eb24a14190 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:38.337376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 500/1039] 10.222.0.25 () {56 vars in 1133 bytes} [Thu May 12 06:32:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:38.342933 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8aca3-1972-4841-a5e8-b47abbc98988 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:38.439083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8aca3-1972-4841-a5e8-b47abbc98988 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:38.471143 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0c8ae-2902-4e41-8866-19a96d14391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:38.472667 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0c8ae-2902-4e41-8866-19a96d14391a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:38.473131 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0c8ae-2902-4e41-8866-19a96d14391a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:38.473577 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0c8ae-2902-4e41-8866-19a96d14391a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:38.537647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0c8ae-2902-4e41-8866-19a96d14391a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:38.539654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0c8ae-2902-4e41-8866-19a96d14391a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:38.632499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 540/1040] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:32:38 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 06:32:38.637832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ece51b-93e9-4a06-a3fc-31eb24a14190 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:38.733315 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ece51b-93e9-4a06-a3fc-31eb24a14190 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:38.767010 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e71976-a186-4933-87ee-eefe2b4b2ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:38.767844 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e71976-a186-4933-87ee-eefe2b4b2ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:38.768130 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e71976-a186-4933-87ee-eefe2b4b2ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:38.768403 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e71976-a186-4933-87ee-eefe2b4b2ef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:38.778342 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e71976-a186-4933-87ee-eefe2b4b2ef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:38.780080 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e71976-a186-4933-87ee-eefe2b4b2ef6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:38.798857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-60e71976-a186-4933-87ee-eefe2b4b2ef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:38.798857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:38.798857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:38.798857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:38.798857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:38.798857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:38.798857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:38.798857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:38.798857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:38.798857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:38.798857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:38.798857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:38.798857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:38.798857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:38.798857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:38.799831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:38.799831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:38.799831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:38.799831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:38.799831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:38.799831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:38.799831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:38.799831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:38.799831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:38.799831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:38.799831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:38.799831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:38.799831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:38.799831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:38.799831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:38.799831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:38.799831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:38.801322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:38.801322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:38.801322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:38.801322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:38.802203 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 501/1041] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:38.807634 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0c8ae-2902-4e41-8866-19a96d14391a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:38.904618 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0c8ae-2902-4e41-8866-19a96d14391a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:38.938116 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9edbe1-7a2f-4777-a473-3520d917bbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:38.938776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9edbe1-7a2f-4777-a473-3520d917bbbf None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:38.939056 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9edbe1-7a2f-4777-a473-3520d917bbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:38.939329 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9edbe1-7a2f-4777-a473-3520d917bbbf None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:38.940078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9edbe1-7a2f-4777-a473-3520d917bbbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:38.940387 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9edbe1-7a2f-4777-a473-3520d917bbbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:38.941874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9edbe1-7a2f-4777-a473-3520d917bbbf None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:38.953187 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 541/1042] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:38.959823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e71976-a186-4933-87ee-eefe2b4b2ef6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:39.056359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e71976-a186-4933-87ee-eefe2b4b2ef6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:39.068783 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76981817-43e9-46e4-a4bf-aecc97b1168e None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:39.069070 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76981817-43e9-46e4-a4bf-aecc97b1168e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:39.069346 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76981817-43e9-46e4-a4bf-aecc97b1168e None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:39.070953 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 542/1043] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:32:39.075668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54df378-8bb8-4144-9e16-614c41582dce None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:39.076048 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54df378-8bb8-4144-9e16-614c41582dce None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:39.076326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54df378-8bb8-4144-9e16-614c41582dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:39.088869 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faa9f9-0028-4099-b7eb-9abefaf329f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:39.089663 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faa9f9-0028-4099-b7eb-9abefaf329f4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:39.089943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faa9f9-0028-4099-b7eb-9abefaf329f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:39.090212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faa9f9-0028-4099-b7eb-9abefaf329f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:39.092205 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d54df378-8bb8-4144-9e16-614c41582dce None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:39.093377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d54df378-8bb8-4144-9e16-614c41582dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:39.098171 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faa9f9-0028-4099-b7eb-9abefaf329f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:39.099607 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faa9f9-0028-4099-b7eb-9abefaf329f4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:39.114088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-48faa9f9-0028-4099-b7eb-9abefaf329f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:39.114088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:39.114088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:39.114088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:39.114088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:39.114088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:39.114088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:39.114088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:39.114088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:39.114088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:39.114088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:39.114088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:39.114088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:32:39.114088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:32:39.114088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:32:39.115205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:32:39.115205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:39.115205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:39.115205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:39.115205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:39.115205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:39.115205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:39.115205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:39.115205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:39.115205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:39.115205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:39.115205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:39.115205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:39.115205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:39.115205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:39.115205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:39.115205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:39.116455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:32:39.116455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:32:39.116455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:32:39.116455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:32:39.116455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:32:39.116455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:32:39.116455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:39.116455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:39.120303 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 502/1044] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:32:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:39.121279 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faa9f9-0028-4099-b7eb-9abefaf329f4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:39.162528 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 543/1045] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:32:39.185942 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54df378-8bb8-4144-9e16-614c41582dce None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:39.223110 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faa9f9-0028-4099-b7eb-9abefaf329f4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:39.255787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce4051-f057-4781-a7ff-520da9dfd6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:39.256369 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce4051-f057-4781-a7ff-520da9dfd6cd None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:39.256647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce4051-f057-4781-a7ff-520da9dfd6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:39.256918 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce4051-f057-4781-a7ff-520da9dfd6cd None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:39.257703 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce4051-f057-4781-a7ff-520da9dfd6cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:39.258006 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce4051-f057-4781-a7ff-520da9dfd6cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:39.259428 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce4051-f057-4781-a7ff-520da9dfd6cd None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:39.271230 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 503/1046] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:32:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:39.276801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce4051-f057-4781-a7ff-520da9dfd6cd None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:39.281675 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54df378-8bb8-4144-9e16-614c41582dce None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:39.314927 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b6166-7e8f-4607-bf3b-c42e30a27ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:39.315746 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b6166-7e8f-4607-bf3b-c42e30a27ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:39.316560 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b6166-7e8f-4607-bf3b-c42e30a27ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:39.316830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b6166-7e8f-4607-bf3b-c42e30a27ea9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:39.326912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b6166-7e8f-4607-bf3b-c42e30a27ea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:32:39.334671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-1b5b6166-7e8f-4607-bf3b-c42e30a27ea9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:32:39.334671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:39.334671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:39.334671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:39.334671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:39.334671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:39.334671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:39.334671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:39.334671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:39.334671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:39.334671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:39.334671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:39.334671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:32:39.334671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:32:39.334671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:32:39.334671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:32:39.335611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:32:39.335611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:32:39.335611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:32:39.335611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:32:39.335611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:39.335611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:39.335611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:39.335611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:39.335611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:39.335611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:39.335611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:39.335611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:39.335611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:39.335611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:39.335611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:39.335611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:39.336775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:39.336775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:39.336775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:39.336775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:39.336775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:32:39.336775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:32:39.336775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:32:39.336775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:32:39.336775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:32:39.336775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:32:39.336775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:32:39.336775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:39.336775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 544/1047] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:32:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:39.341623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b6166-7e8f-4607-bf3b-c42e30a27ea9 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:39.377654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce4051-f057-4781-a7ff-520da9dfd6cd None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:39.411371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db1c31-cced-4375-a3c1-3e8053242542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:39.412451 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db1c31-cced-4375-a3c1-3e8053242542 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:39.412901 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db1c31-cced-4375-a3c1-3e8053242542 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:39.413306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db1c31-cced-4375-a3c1-3e8053242542 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:39.414979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db1c31-cced-4375-a3c1-3e8053242542 None admin] RBAC: Adding query filter params (role.id=b675985f8bdd471ab51fb4fc2daff01e, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=bbcd54a927bf46f183b50fbda677868d) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:39.415380 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db1c31-cced-4375-a3c1-3e8053242542 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:39.416861 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db1c31-cced-4375-a3c1-3e8053242542 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:39.422483 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 504/1048] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:32:39 2022] GET /identity/v3/role_assignments?user.id=bbcd54a927bf46f183b50fbda677868d&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=b675985f8bdd471ab51fb4fc2daff01e => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:39.441230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b6166-7e8f-4607-bf3b-c42e30a27ea9 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:39.477447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c6ad6-b87f-4092-8751-db494c4b7ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:39.478398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c6ad6-b87f-4092-8751-db494c4b7ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:39.478830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c6ad6-b87f-4092-8751-db494c4b7ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:39.479251 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c6ad6-b87f-4092-8751-db494c4b7ab7 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:39.480224 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c6ad6-b87f-4092-8751-db494c4b7ab7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:39.480712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c6ad6-b87f-4092-8751-db494c4b7ab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:39.482282 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c6ad6-b87f-4092-8751-db494c4b7ab7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:39.493248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 545/1049] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:32:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:39.498796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db1c31-cced-4375-a3c1-3e8053242542 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:39.602969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db1c31-cced-4375-a3c1-3e8053242542 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:39.635114 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3436d4-fb74-4059-b4bf-700cb652425e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:39.636007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3436d4-fb74-4059-b4bf-700cb652425e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:39.636285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3436d4-fb74-4059-b4bf-700cb652425e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:39.636550 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3436d4-fb74-4059-b4bf-700cb652425e None admin] PATH_INFO: `/v3/users/7ff24b1d24054d94b99d4903e9d88be3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:39.649929 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3436d4-fb74-4059-b4bf-700cb652425e None admin] RBAC: Authorizing `identity:get_user(user_id=7ff24b1d24054d94b99d4903e9d88be3)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:39.651359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3436d4-fb74-4059-b4bf-700cb652425e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:39.653230 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 505/1050] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:32:39 2022] GET /identity/v3/users/7ff24b1d24054d94b99d4903e9d88be3 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:39.658622 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c6ad6-b87f-4092-8751-db494c4b7ab7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:39.753331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c6ad6-b87f-4092-8751-db494c4b7ab7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:39.787535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9ca45-133b-4005-b713-ba1832dd718c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:39.788227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9ca45-133b-4005-b713-ba1832dd718c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:39.788498 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9ca45-133b-4005-b713-ba1832dd718c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:39.789048 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9ca45-133b-4005-b713-ba1832dd718c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:39.852717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9ca45-133b-4005-b713-ba1832dd718c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:39.854202 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9ca45-133b-4005-b713-ba1832dd718c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:39.952758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 546/1051] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:32:39 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 06:32:39.954218 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3436d4-fb74-4059-b4bf-700cb652425e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:40.060604 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3436d4-fb74-4059-b4bf-700cb652425e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:40.094746 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c035c-df29-4eba-85a8-0d7cfc0dae0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:40.095987 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c035c-df29-4eba-85a8-0d7cfc0dae0d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:40.096476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c035c-df29-4eba-85a8-0d7cfc0dae0d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:40.096979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c035c-df29-4eba-85a8-0d7cfc0dae0d None admin] PATH_INFO: `/v3/projects/f5009c5b18db4047b11afad886e1619e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:40.098880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c035c-df29-4eba-85a8-0d7cfc0dae0d None admin] RBAC: Authorizing `identity:get_project(project_id=f5009c5b18db4047b11afad886e1619e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:40.100548 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c035c-df29-4eba-85a8-0d7cfc0dae0d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:40.107179 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 506/1052] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:32:39 2022] GET /identity/v3/projects/f5009c5b18db4047b11afad886e1619e => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:40.108440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9ca45-133b-4005-b713-ba1832dd718c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:40.200692 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9ca45-133b-4005-b713-ba1832dd718c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:40.215012 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279dfa0-b4bb-4d67-bee3-e76f448ee429 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:40.215306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279dfa0-b4bb-4d67-bee3-e76f448ee429 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:40.215565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279dfa0-b4bb-4d67-bee3-e76f448ee429 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:40.217081 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 507/1053] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:32:40.221930 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e574e-8664-4474-8209-e2b656829a45 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:40.222318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e574e-8664-4474-8209-e2b656829a45 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:40.222591 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e574e-8664-4474-8209-e2b656829a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:40.233399 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f2ab2-accb-4f2b-867d-183e5dfb4361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:40.234049 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f2ab2-accb-4f2b-867d-183e5dfb4361 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:40.234326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f2ab2-accb-4f2b-867d-183e5dfb4361 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:40.234592 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f2ab2-accb-4f2b-867d-183e5dfb4361 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:40.235421 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f2ab2-accb-4f2b-867d-183e5dfb4361 None admin] RBAC: Adding query filter params (role.id=5e6a73052f3b4ee7829ecb858925e5ca, scope.project.id=f5009c5b18db4047b11afad886e1619e, user.id=7ff24b1d24054d94b99d4903e9d88be3) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:40.235748 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f2ab2-accb-4f2b-867d-183e5dfb4361 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:40.237156 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f2ab2-accb-4f2b-867d-183e5dfb4361 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:40.239396 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e15e574e-8664-4474-8209-e2b656829a45 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:40.240609 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e15e574e-8664-4474-8209-e2b656829a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:40.243718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 547/1054] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:32:40 2022] GET /identity/v3/role_assignments?user.id=7ff24b1d24054d94b99d4903e9d88be3&scope.project.id=f5009c5b18db4047b11afad886e1619e&role.id=5e6a73052f3b4ee7829ecb858925e5ca => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:40.311405 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 508/1055] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:32:40.334464 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f2ab2-accb-4f2b-867d-183e5dfb4361 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:40.433772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f2ab2-accb-4f2b-867d-183e5dfb4361 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:40.466362 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434c6b5-8c2c-49a1-879d-fde50a9f7bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:40.467139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434c6b5-8c2c-49a1-879d-fde50a9f7bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:40.467418 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434c6b5-8c2c-49a1-879d-fde50a9f7bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:40.467717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434c6b5-8c2c-49a1-879d-fde50a9f7bc7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:40.468354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434c6b5-8c2c-49a1-879d-fde50a9f7bc7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:40.469704 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434c6b5-8c2c-49a1-879d-fde50a9f7bc7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:40.482203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-0434c6b5-8c2c-49a1-879d-fde50a9f7bc7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 06:32:40.482203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:40.482203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:32:40.482203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:32:40.482203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:32:40.482203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:32:40.482203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:32:40.482203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:40.482203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 06:32:40.482203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:40.482203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:32:40.482203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:40.482203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:40.482203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:40.482203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:40.482203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:40.482203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:40.483233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:40.483233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:40.483233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:40.483233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:40.483233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:40.483233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:40.483233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:32:40.483233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:32:40.483233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:32:40.483233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:32:40.483233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:40.483233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:40.483233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:40.483233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:40.483233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:40.483233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:40.484557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:40.484557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:40.484557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:40.484557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:40.484557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:40.484557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:40.484557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:40.484557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:40.484557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:40.484557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:40.484557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:32:40.484557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:32:40.484557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 06:32:40.484557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:40.487810 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 548/1056] 10.222.0.25 () {56 vars in 1105 bytes} [Thu May 12 06:32:40 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:40.489931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e574e-8664-4474-8209-e2b656829a45 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:40.584821 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e574e-8664-4474-8209-e2b656829a45 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:40.617419 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e93e2-458a-4a76-bf2f-b6cc9e36c67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:40.618084 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e93e2-458a-4a76-bf2f-b6cc9e36c67a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:40.618361 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e93e2-458a-4a76-bf2f-b6cc9e36c67a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:40.618625 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e93e2-458a-4a76-bf2f-b6cc9e36c67a None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:40.619326 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e93e2-458a-4a76-bf2f-b6cc9e36c67a None admin] RBAC: Adding query filter params (name=image) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:40.619624 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e93e2-458a-4a76-bf2f-b6cc9e36c67a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:40.620997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e93e2-458a-4a76-bf2f-b6cc9e36c67a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:40.630827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 509/1057] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:40.632072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434c6b5-8c2c-49a1-879d-fde50a9f7bc7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:40.728164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434c6b5-8c2c-49a1-879d-fde50a9f7bc7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:40.759740 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf11ae-a345-4a91-b6da-074e5da047dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:40.760401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf11ae-a345-4a91-b6da-074e5da047dc None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:40.760678 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf11ae-a345-4a91-b6da-074e5da047dc None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:40.760948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf11ae-a345-4a91-b6da-074e5da047dc None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:40.761647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf11ae-a345-4a91-b6da-074e5da047dc None admin] RBAC: Adding query filter params (type=image) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:40.761948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf11ae-a345-4a91-b6da-074e5da047dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:40.763288 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf11ae-a345-4a91-b6da-074e5da047dc None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:40.772056 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 549/1058] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:40.775154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e93e2-458a-4a76-bf2f-b6cc9e36c67a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:40.882242 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e93e2-458a-4a76-bf2f-b6cc9e36c67a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:40.916084 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7dc8c8-a0cc-4bda-8ba6-a36ccf8f39fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:40.916814 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dc8c8-a0cc-4bda-8ba6-a36ccf8f39fb None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:40.917094 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dc8c8-a0cc-4bda-8ba6-a36ccf8f39fb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:40.917364 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dc8c8-a0cc-4bda-8ba6-a36ccf8f39fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:40.918110 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7dc8c8-a0cc-4bda-8ba6-a36ccf8f39fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:40.919456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7dc8c8-a0cc-4bda-8ba6-a36ccf8f39fb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:41.015722 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 510/1059] 10.222.0.25 () {60 vars in 1144 bytes} [Thu May 12 06:32:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:32:41.624796 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed61f0-3e99-4ed3-a95f-628a23a34ca0 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:41.625357 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed61f0-3e99-4ed3-a95f-628a23a34ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:41.625357 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed61f0-3e99-4ed3-a95f-628a23a34ca0 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:41.626750 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 550/1060] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:41.631893 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e5bb8-5bff-40a3-9156-d4ce2606c0ef None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:41.632186 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e5bb8-5bff-40a3-9156-d4ce2606c0ef None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:41.632464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e5bb8-5bff-40a3-9156-d4ce2606c0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:41.649199 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-234e5bb8-5bff-40a3-9156-d4ce2606c0ef None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:41.650361 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-234e5bb8-5bff-40a3-9156-d4ce2606c0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:41.719271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 511/1061] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:32:41.741968 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed61f0-3e99-4ed3-a95f-628a23a34ca0 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:41.838679 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed61f0-3e99-4ed3-a95f-628a23a34ca0 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:41.870914 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2bc0e-3d68-43fe-98c1-7d35c1d74adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:41.871740 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2bc0e-3d68-43fe-98c1-7d35c1d74adf None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:41.872020 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2bc0e-3d68-43fe-98c1-7d35c1d74adf None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:41.872288 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2bc0e-3d68-43fe-98c1-7d35c1d74adf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:41.883219 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2bc0e-3d68-43fe-98c1-7d35c1d74adf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:32:41.891227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-21f2bc0e-3d68-43fe-98c1-7d35c1d74adf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 06:32:41.891227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:41.891227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:41.891227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:41.891227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:41.891227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:41.891227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:41.891227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:41.891227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:41.891227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:41.891227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:41.891227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:41.891227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:32:41.891227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:32:41.891227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:32:41.891227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:32:41.892291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:32:41.892291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:32:41.892291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:32:41.892291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:32:41.892291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:41.892291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:41.892291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:41.892291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:41.892291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:41.892291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:41.892291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:41.892291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:41.892291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:41.892291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:41.892291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:41.892291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:41.893222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:41.893222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:41.893222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:41.893222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:41.893222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:32:41.893222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:32:41.893222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:32:41.893222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:32:41.893222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:32:41.893222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:32:41.893222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 06:32:41.893222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:41.895206 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 551/1062] 10.222.0.25 () {56 vars in 1120 bytes} [Thu May 12 06:32:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:41.898849 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e5bb8-5bff-40a3-9156-d4ce2606c0ef None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:41.999566 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e5bb8-5bff-40a3-9156-d4ce2606c0ef None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:42.032577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6485f-5fc5-48c4-af1a-b808f1ac8534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:42.033239 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6485f-5fc5-48c4-af1a-b808f1ac8534 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:42.033518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6485f-5fc5-48c4-af1a-b808f1ac8534 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:42.033785 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6485f-5fc5-48c4-af1a-b808f1ac8534 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:42.034556 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6485f-5fc5-48c4-af1a-b808f1ac8534 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:42.034858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6485f-5fc5-48c4-af1a-b808f1ac8534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:42.036243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6485f-5fc5-48c4-af1a-b808f1ac8534 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:42.044369 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 512/1063] 10.222.0.25 () {56 vars in 1115 bytes} [Thu May 12 06:32:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:42.049863 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2bc0e-3d68-43fe-98c1-7d35c1d74adf None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:42.143118 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2bc0e-3d68-43fe-98c1-7d35c1d74adf None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:42.177138 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce65624-dcaa-42eb-8a8b-c78665f53ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:42.177926 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce65624-dcaa-42eb-8a8b-c78665f53ccb None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:42.178202 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce65624-dcaa-42eb-8a8b-c78665f53ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:42.178468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce65624-dcaa-42eb-8a8b-c78665f53ccb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:42.188023 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce65624-dcaa-42eb-8a8b-c78665f53ccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:42.189446 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce65624-dcaa-42eb-8a8b-c78665f53ccb None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:42.206840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-5ce65624-dcaa-42eb-8a8b-c78665f53ccb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:42.206840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:42.206840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:42.206840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:42.206840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:42.206840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:42.206840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:42.206840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:42.206840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:42.206840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:42.206840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:42.206840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:42.206840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:42.206840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:42.206840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:42.207819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:42.207819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:42.207819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:42.207819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:42.207819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:42.207819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:42.207819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:42.207819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:42.207819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:42.207819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:42.207819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:42.207819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:42.207819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:42.207819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:42.207819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:42.207819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:42.207819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:42.208748 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:42.208748 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:42.208748 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:42.208748 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:42.211767 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 552/1064] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:42.213919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6485f-5fc5-48c4-af1a-b808f1ac8534 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:42.317668 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6485f-5fc5-48c4-af1a-b808f1ac8534 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:42.349809 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b8067-7a61-4922-9670-20a86d98ccc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:42.350466 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b8067-7a61-4922-9670-20a86d98ccc0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:42.350746 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b8067-7a61-4922-9670-20a86d98ccc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:42.351016 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b8067-7a61-4922-9670-20a86d98ccc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:42.351756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b8067-7a61-4922-9670-20a86d98ccc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:42.352064 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b8067-7a61-4922-9670-20a86d98ccc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:42.353470 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b8067-7a61-4922-9670-20a86d98ccc0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:42.369565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 513/1065] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:42.370785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce65624-dcaa-42eb-8a8b-c78665f53ccb None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:42.429936 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c022c5-981b-4f99-a016-80903a12b431 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:42.430122 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c022c5-981b-4f99-a016-80903a12b431 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:42.430397 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c022c5-981b-4f99-a016-80903a12b431 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:42.431887 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 514/1066] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:32:42.436556 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ae48a-4a02-445d-b3bc-dffebbb98bf1 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:42.436841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ae48a-4a02-445d-b3bc-dffebbb98bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:42.437119 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ae48a-4a02-445d-b3bc-dffebbb98bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:42.453522 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b68ae48a-4a02-445d-b3bc-dffebbb98bf1 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:42.454685 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b68ae48a-4a02-445d-b3bc-dffebbb98bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:42.466092 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce65624-dcaa-42eb-8a8b-c78665f53ccb None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:42.499774 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140a9d9-7085-45ab-af8e-f28581be88b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:42.500566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140a9d9-7085-45ab-af8e-f28581be88b0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:42.500844 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140a9d9-7085-45ab-af8e-f28581be88b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:42.501120 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140a9d9-7085-45ab-af8e-f28581be88b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:42.509207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140a9d9-7085-45ab-af8e-f28581be88b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:42.510622 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140a9d9-7085-45ab-af8e-f28581be88b0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:42.518490 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 515/1067] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:32:42.524374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-7140a9d9-7085-45ab-af8e-f28581be88b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 06:32:42.524374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:42.524374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:42.524374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:42.524374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:42.524374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:42.524374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:42.524374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:42.524374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:42.524374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:42.524374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:42.524374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:42.524374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:32:42.524374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:32:42.524374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:32:42.524374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:32:42.525358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:42.525358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:42.525358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:32:42.525358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:42.525358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:32:42.525358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:42.525358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:42.525358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:42.525358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:42.525358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:42.525358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:42.525358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:42.525358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:42.525358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:42.525358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:42.525358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:42.525358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:42.525358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:42.526334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:42.526334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:42.526334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:32:42.526334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:32:42.526334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:32:42.526334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:32:42.526334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:32:42.526334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:32:42.526334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 06:32:42.526334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:42.528044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 553/1068] 10.222.0.25 () {56 vars in 1093 bytes} [Thu May 12 06:32:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:42.531668 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ae48a-4a02-445d-b3bc-dffebbb98bf1 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:42.542482 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140a9d9-7085-45ab-af8e-f28581be88b0 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:42.636509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ae48a-4a02-445d-b3bc-dffebbb98bf1 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:42.637109 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140a9d9-7085-45ab-af8e-f28581be88b0 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:42.669645 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcaf81-a2df-4cd4-a175-c397cb7ae45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:42.670005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8c838-232d-40bb-901e-b4121caec7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:42.670313 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcaf81-a2df-4cd4-a175-c397cb7ae45a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:42.670590 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcaf81-a2df-4cd4-a175-c397cb7ae45a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:42.670693 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8c838-232d-40bb-901e-b4121caec7dc None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:42.670860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcaf81-a2df-4cd4-a175-c397cb7ae45a None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:42.670964 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8c838-232d-40bb-901e-b4121caec7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:42.671223 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8c838-232d-40bb-901e-b4121caec7dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:42.671733 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcaf81-a2df-4cd4-a175-c397cb7ae45a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:42.672024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcaf81-a2df-4cd4-a175-c397cb7ae45a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:42.673435 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcaf81-a2df-4cd4-a175-c397cb7ae45a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:42.681872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8c838-232d-40bb-901e-b4121caec7dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:32:42.689493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-abc8c838-232d-40bb-901e-b4121caec7dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:32:42.689493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:42.689493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:42.689493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:42.689493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:42.689493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:42.689493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:42.689493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:42.689493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:42.689493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:42.689493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:42.689493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:42.689493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:32:42.689493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:32:42.689493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:32:42.689493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:32:42.690448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:32:42.690448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:32:42.690448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:32:42.690448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:32:42.690448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:42.690448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:42.690448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:42.690448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:42.690448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:42.690448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:42.690448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:42.690448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:42.690448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:42.690448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:42.690448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:42.690448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:42.692032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:42.692032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:42.692032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:42.692032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:42.692032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:32:42.692032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:32:42.692032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:32:42.692032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:32:42.692032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:32:42.692032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:32:42.692032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:32:42.692032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:42.692032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 554/1069] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:32:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:42.695203 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 516/1070] 10.222.0.25 () {56 vars in 1133 bytes} [Thu May 12 06:32:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:42.696722 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8c838-232d-40bb-901e-b4121caec7dc None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:42.697408 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcaf81-a2df-4cd4-a175-c397cb7ae45a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:42.792993 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8c838-232d-40bb-901e-b4121caec7dc None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:42.796840 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcaf81-a2df-4cd4-a175-c397cb7ae45a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:42.827293 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbf4c7-7c0f-4472-b584-c522571de0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:42.828203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbf4c7-7c0f-4472-b584-c522571de0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:42.828495 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbf4c7-7c0f-4472-b584-c522571de0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:42.828867 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbf4c7-7c0f-4472-b584-c522571de0a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:42.829788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3b37f-e180-4270-aa77-c7ff2d021231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:42.830446 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3b37f-e180-4270-aa77-c7ff2d021231 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:42.830728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3b37f-e180-4270-aa77-c7ff2d021231 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:42.830993 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3b37f-e180-4270-aa77-c7ff2d021231 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:42.831861 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3b37f-e180-4270-aa77-c7ff2d021231 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:42.832162 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3b37f-e180-4270-aa77-c7ff2d021231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:42.833511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3b37f-e180-4270-aa77-c7ff2d021231 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:42.839587 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbf4c7-7c0f-4472-b584-c522571de0a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:42.841033 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbf4c7-7c0f-4472-b584-c522571de0a5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:42.841706 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 517/1071] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:32:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:42.847785 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3b37f-e180-4270-aa77-c7ff2d021231 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:42.859598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-9edbf4c7-7c0f-4472-b584-c522571de0a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:42.859598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:42.859598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:42.859598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:42.859598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:42.859598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:42.859598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:42.859598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:42.859598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:42.859598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:42.859598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:42.859598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:42.859598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:42.859598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:42.859598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:42.860601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:42.860601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:42.860601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:42.860601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:42.860601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:42.860601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:42.860601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:42.860601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:42.860601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:42.860601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:42.860601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:42.860601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:42.860601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:42.860601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:42.860601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:42.860601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:42.860601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:42.861532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:42.861532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:42.861532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:42.861532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:42.861532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 555/1072] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:42.866765 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbf4c7-7c0f-4472-b584-c522571de0a5 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:42.946024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3b37f-e180-4270-aa77-c7ff2d021231 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:42.968105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbf4c7-7c0f-4472-b584-c522571de0a5 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:42.979764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a19731-6543-4a0e-bff7-171af6f8aa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:42.980799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a19731-6543-4a0e-bff7-171af6f8aa55 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:42.981078 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a19731-6543-4a0e-bff7-171af6f8aa55 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:42.981347 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a19731-6543-4a0e-bff7-171af6f8aa55 None admin] PATH_INFO: `/v3/users/7ff24b1d24054d94b99d4903e9d88be3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:42.982550 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a19731-6543-4a0e-bff7-171af6f8aa55 None admin] RBAC: Authorizing `identity:get_user(user_id=7ff24b1d24054d94b99d4903e9d88be3)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:42.984088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a19731-6543-4a0e-bff7-171af6f8aa55 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:42.985900 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 518/1073] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:32:42 2022] GET /identity/v3/users/7ff24b1d24054d94b99d4903e9d88be3 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:42.991425 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a19731-6543-4a0e-bff7-171af6f8aa55 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:43.002967 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02564151-f5ad-433e-bc2e-31d42e797394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:43.004211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02564151-f5ad-433e-bc2e-31d42e797394 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:43.004518 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02564151-f5ad-433e-bc2e-31d42e797394 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:43.004837 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02564151-f5ad-433e-bc2e-31d42e797394 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:43.005574 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02564151-f5ad-433e-bc2e-31d42e797394 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:43.005873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02564151-f5ad-433e-bc2e-31d42e797394 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:43.007238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02564151-f5ad-433e-bc2e-31d42e797394 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:43.018922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 556/1074] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:43.024347 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02564151-f5ad-433e-bc2e-31d42e797394 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:43.101672 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a19731-6543-4a0e-bff7-171af6f8aa55 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:43.128764 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02564151-f5ad-433e-bc2e-31d42e797394 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:43.138979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d159ef-685b-41c4-bf64-2b0c2fdbfdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:43.140165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d159ef-685b-41c4-bf64-2b0c2fdbfdb1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:43.140446 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d159ef-685b-41c4-bf64-2b0c2fdbfdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:43.140716 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d159ef-685b-41c4-bf64-2b0c2fdbfdb1 None admin] PATH_INFO: `/v3/projects/f5009c5b18db4047b11afad886e1619e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:43.142011 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d159ef-685b-41c4-bf64-2b0c2fdbfdb1 None admin] RBAC: Authorizing `identity:get_project(project_id=f5009c5b18db4047b11afad886e1619e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:43.143439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d159ef-685b-41c4-bf64-2b0c2fdbfdb1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:43.150322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 519/1075] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:32:42 2022] GET /identity/v3/projects/f5009c5b18db4047b11afad886e1619e => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:43.150921 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d159ef-685b-41c4-bf64-2b0c2fdbfdb1 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:43.164724 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab518b-8399-4001-9694-62a7ac0d944a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:43.165525 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab518b-8399-4001-9694-62a7ac0d944a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:43.165804 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab518b-8399-4001-9694-62a7ac0d944a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:43.166074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab518b-8399-4001-9694-62a7ac0d944a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:43.172844 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab518b-8399-4001-9694-62a7ac0d944a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:43.174306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab518b-8399-4001-9694-62a7ac0d944a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:43.188459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-e9ab518b-8399-4001-9694-62a7ac0d944a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:43.188459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:43.188459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:43.188459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:43.188459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:43.188459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:43.188459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:43.188459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:43.188459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:43.188459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:43.188459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:43.188459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:43.188459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:32:43.188459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:32:43.188459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:32:43.189407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:32:43.189407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:43.189407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:43.189407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:43.189407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:43.189407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:43.189407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:43.189407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:43.189407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:43.189407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:43.189407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:43.189407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:43.189407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:43.189407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:43.189407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:43.189407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:43.189407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:43.190948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:32:43.190948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:32:43.190948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:32:43.190948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:32:43.190948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:32:43.190948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:32:43.190948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:43.190948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:43.190948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 557/1076] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:32:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:43.195327 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab518b-8399-4001-9694-62a7ac0d944a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:43.252067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d159ef-685b-41c4-bf64-2b0c2fdbfdb1 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:43.286033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721f155-f006-4dec-855c-4b5af74d53b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:43.286915 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721f155-f006-4dec-855c-4b5af74d53b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:43.287197 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721f155-f006-4dec-855c-4b5af74d53b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:43.287467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721f155-f006-4dec-855c-4b5af74d53b0 None admin] PATH_INFO: `/v3/projects/f5009c5b18db4047b11afad886e1619e/users/7ff24b1d24054d94b99d4903e9d88be3/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:43.289736 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c721f155-f006-4dec-855c-4b5af74d53b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5009c5b18db4047b11afad886e1619e, user_id=7ff24b1d24054d94b99d4903e9d88be3, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:43.290956 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab518b-8399-4001-9694-62a7ac0d944a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:43.291169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c721f155-f006-4dec-855c-4b5af74d53b0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:43.322081 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ed738-8654-4b8d-b9c3-5d62537144e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:43.322756 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ed738-8654-4b8d-b9c3-5d62537144e9 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:43.323037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ed738-8654-4b8d-b9c3-5d62537144e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:43.323306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ed738-8654-4b8d-b9c3-5d62537144e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:43.324125 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ed738-8654-4b8d-b9c3-5d62537144e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:43.324431 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ed738-8654-4b8d-b9c3-5d62537144e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:43.325827 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ed738-8654-4b8d-b9c3-5d62537144e9 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:43.337707 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 558/1077] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:32:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:43.338926 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdabb79-5f31-441a-959b-d1fa5f7d8094 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:43.339212 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdabb79-5f31-441a-959b-d1fa5f7d8094 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:43.339488 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdabb79-5f31-441a-959b-d1fa5f7d8094 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:43.340735 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 559/1078] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:43.343418 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdabb79-5f31-441a-959b-d1fa5f7d8094 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:43.390122 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 520/1079] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:32:43 2022] PUT /identity/v3/projects/f5009c5b18db4047b11afad886e1619e/users/7ff24b1d24054d94b99d4903e9d88be3/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:32:43.391392 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf6098-f3c0-4cd6-8d82-aea7a9d18132 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:43.391677 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf6098-f3c0-4cd6-8d82-aea7a9d18132 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:43.394368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf6098-f3c0-4cd6-8d82-aea7a9d18132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:43.410302 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-11cf6098-f3c0-4cd6-8d82-aea7a9d18132 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:43.411536 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-11cf6098-f3c0-4cd6-8d82-aea7a9d18132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:43.447925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdabb79-5f31-441a-959b-d1fa5f7d8094 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:43.483740 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 521/1080] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:43.490011 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ea56b-d431-4b36-b050-b9aff5003d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:43.491008 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ea56b-d431-4b36-b050-b9aff5003d9f None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:43.491353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ea56b-d431-4b36-b050-b9aff5003d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:43.491718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ea56b-d431-4b36-b050-b9aff5003d9f None admin] PATH_INFO: `/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/bbcd54a927bf46f183b50fbda677868d/roles/b675985f8bdd471ab51fb4fc2daff01e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:43.494009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ea56b-d431-4b36-b050-b9aff5003d9f None admin] RBAC: Authorizing `identity:create_grant(project_id=57e1a8b143974111b0ba09d041b331d5, user_id=bbcd54a927bf46f183b50fbda677868d, role_id=b675985f8bdd471ab51fb4fc2daff01e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:43.495505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ea56b-d431-4b36-b050-b9aff5003d9f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:43.513640 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf6098-f3c0-4cd6-8d82-aea7a9d18132 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:43.606023 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf6098-f3c0-4cd6-8d82-aea7a9d18132 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:43.614192 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 560/1081] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:32:43 2022] PUT /identity/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/bbcd54a927bf46f183b50fbda677868d/roles/b675985f8bdd471ab51fb4fc2daff01e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:32:43.642311 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc524515-2a81-474d-97d9-4adab255284b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:43.642994 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc524515-2a81-474d-97d9-4adab255284b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:43.643276 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc524515-2a81-474d-97d9-4adab255284b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:43.643550 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc524515-2a81-474d-97d9-4adab255284b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:43.716482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc524515-2a81-474d-97d9-4adab255284b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:43.717958 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc524515-2a81-474d-97d9-4adab255284b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:43.819719 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 522/1082] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:32:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 06:32:43.826047 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ea56b-d431-4b36-b050-b9aff5003d9f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:43.922203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ea56b-d431-4b36-b050-b9aff5003d9f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:43.955178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb844eed-49d8-4b0e-814f-ecdc3ec2ac0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:43.956013 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb844eed-49d8-4b0e-814f-ecdc3ec2ac0d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:43.956795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb844eed-49d8-4b0e-814f-ecdc3ec2ac0d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:43.957065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb844eed-49d8-4b0e-814f-ecdc3ec2ac0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:43.973072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb844eed-49d8-4b0e-814f-ecdc3ec2ac0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:43.974568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb844eed-49d8-4b0e-814f-ecdc3ec2ac0d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:43.992582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-fb844eed-49d8-4b0e-814f-ecdc3ec2ac0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:43.992582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:43.992582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:43.992582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:43.992582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:43.992582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:43.992582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:43.992582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:43.992582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:43.992582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:43.992582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:43.992582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:43.992582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:43.992582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:43.992582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:43.993499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:43.993499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:43.993499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:43.993499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:43.993499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:43.993499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:43.993499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:43.993499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:43.993499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:43.993499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:43.993499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:43.993499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:43.993499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:43.993499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:43.993499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:43.993499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:43.993499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:43.999234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:43.999234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:43.999234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:43.999234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:43.999234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 561/1083] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:44.001054 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc524515-2a81-474d-97d9-4adab255284b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:44.101225 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc524515-2a81-474d-97d9-4adab255284b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:44.134648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488edbc2-a409-4747-9c18-1255bc710473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:44.135370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488edbc2-a409-4747-9c18-1255bc710473 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:44.135649 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488edbc2-a409-4747-9c18-1255bc710473 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:44.135947 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488edbc2-a409-4747-9c18-1255bc710473 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:44.136667 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488edbc2-a409-4747-9c18-1255bc710473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:44.136966 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488edbc2-a409-4747-9c18-1255bc710473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:44.138324 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488edbc2-a409-4747-9c18-1255bc710473 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:44.150134 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 523/1084] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:45.591028 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b29d0e-964e-4094-ab91-66b6aba20b8c None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:45.591588 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b29d0e-964e-4094-ab91-66b6aba20b8c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:45.591699 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b29d0e-964e-4094-ab91-66b6aba20b8c None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:45.593146 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 562/1085] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:45.598923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e17bd-f457-4eda-bf10-ca7d9f065dee None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:45.599354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e17bd-f457-4eda-bf10-ca7d9f065dee None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:45.599463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e17bd-f457-4eda-bf10-ca7d9f065dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:45.616288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-080e17bd-f457-4eda-bf10-ca7d9f065dee None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:45.617441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-080e17bd-f457-4eda-bf10-ca7d9f065dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:45.690694 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 524/1086] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:32:45.714016 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b29d0e-964e-4094-ab91-66b6aba20b8c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:45.810177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b29d0e-964e-4094-ab91-66b6aba20b8c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:45.827576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1e69d-02db-4b59-a963-58dff8c6c2ce None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:45.827890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1e69d-02db-4b59-a963-58dff8c6c2ce None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:45.828164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1e69d-02db-4b59-a963-58dff8c6c2ce None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:45.829518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 525/1087] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:32:45.834945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e56450-a4b2-40a8-9cd2-3bdcba192a63 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:45.835232 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e56450-a4b2-40a8-9cd2-3bdcba192a63 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:45.835503 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e56450-a4b2-40a8-9cd2-3bdcba192a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:45.843147 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262fa2a-9aba-4818-a9e9-e4dcd98c23f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:45.843990 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262fa2a-9aba-4818-a9e9-e4dcd98c23f1 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:45.844303 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262fa2a-9aba-4818-a9e9-e4dcd98c23f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:45.844605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262fa2a-9aba-4818-a9e9-e4dcd98c23f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:45.851495 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a0e56450-a4b2-40a8-9cd2-3bdcba192a63 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:45.852693 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a0e56450-a4b2-40a8-9cd2-3bdcba192a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:45.854362 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262fa2a-9aba-4818-a9e9-e4dcd98c23f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:32:45.862159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-9262fa2a-9aba-4818-a9e9-e4dcd98c23f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:32:45.862159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:45.862159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:45.862159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:45.862159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:45.862159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:45.862159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:45.862159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:45.862159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:45.862159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:45.862159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:45.862159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:45.862159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:32:45.862159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:32:45.862159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:32:45.862159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:32:45.863115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:32:45.863115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:32:45.863115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:32:45.863115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:32:45.863115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:45.863115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:45.863115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:45.863115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:45.863115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:45.863115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:45.863115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:45.863115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:32:45.863115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:45.863115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:45.863115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:45.863115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:45.864061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:45.864061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:45.864061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:45.864061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:45.864061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:32:45.864061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:32:45.864061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:32:45.864061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:32:45.864061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:32:45.864061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:32:45.864061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:32:45.864061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:32:45.864061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 563/1088] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:32:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:45.869139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262fa2a-9aba-4818-a9e9-e4dcd98c23f1 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:45.915970 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 526/1089] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:32:45.938949 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e56450-a4b2-40a8-9cd2-3bdcba192a63 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:45.965557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262fa2a-9aba-4818-a9e9-e4dcd98c23f1 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:45.998739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4669d5-2416-4421-a1b2-1d0b46b6a4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:45.999433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4669d5-2416-4421-a1b2-1d0b46b6a4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:45.999776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4669d5-2416-4421-a1b2-1d0b46b6a4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:46.000089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4669d5-2416-4421-a1b2-1d0b46b6a4f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:46.000871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4669d5-2416-4421-a1b2-1d0b46b6a4f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:46.001220 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4669d5-2416-4421-a1b2-1d0b46b6a4f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:46.002780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4669d5-2416-4421-a1b2-1d0b46b6a4f8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:46.011137 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 564/1090] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:32:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:46.016585 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4669d5-2416-4421-a1b2-1d0b46b6a4f8 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:46.033526 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e56450-a4b2-40a8-9cd2-3bdcba192a63 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:46.066730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29c17a-1594-4a83-8155-6209f0e09bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:46.067548 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29c17a-1594-4a83-8155-6209f0e09bed None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:46.067863 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29c17a-1594-4a83-8155-6209f0e09bed None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:46.068136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29c17a-1594-4a83-8155-6209f0e09bed None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:46.077840 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29c17a-1594-4a83-8155-6209f0e09bed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:32:46.086004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5c29c17a-1594-4a83-8155-6209f0e09bed None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 06:32:46.086004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:46.086004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:46.086004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:46.086004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:46.086004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:46.086004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:46.086004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:46.086004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:46.086004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:46.086004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:46.086004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:46.086004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:32:46.086004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:32:46.086004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:32:46.086004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:32:46.087121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:32:46.087121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:32:46.087121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:32:46.087121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:32:46.087121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:46.087121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:46.087121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:46.087121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:46.087121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:46.087121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:46.087121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:46.087121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:46.087121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:46.087121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:46.087121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:46.087121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:46.088346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:46.088346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:46.088346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:46.088346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:46.088346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:32:46.088346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:32:46.088346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:32:46.088346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:32:46.088346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:32:46.088346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:32:46.088346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 06:32:46.088346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:46.088346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 527/1091] 10.222.0.25 () {56 vars in 1120 bytes} [Thu May 12 06:32:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:46.092953 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29c17a-1594-4a83-8155-6209f0e09bed None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:46.113581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4669d5-2416-4421-a1b2-1d0b46b6a4f8 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:46.145180 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd32a9b-b71c-4497-9251-f8325322dcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:46.146049 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd32a9b-b71c-4497-9251-f8325322dcd1 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:46.146331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd32a9b-b71c-4497-9251-f8325322dcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:46.146605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd32a9b-b71c-4497-9251-f8325322dcd1 None admin] PATH_INFO: `/v3/users/7ff24b1d24054d94b99d4903e9d88be3` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:46.147996 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd32a9b-b71c-4497-9251-f8325322dcd1 None admin] RBAC: Authorizing `identity:get_user(user_id=7ff24b1d24054d94b99d4903e9d88be3)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:46.149258 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd32a9b-b71c-4497-9251-f8325322dcd1 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:46.151045 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 565/1092] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:32:46 2022] GET /identity/v3/users/7ff24b1d24054d94b99d4903e9d88be3 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:46.156668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd32a9b-b71c-4497-9251-f8325322dcd1 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:46.187589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29c17a-1594-4a83-8155-6209f0e09bed None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:46.219499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff06c4b-a833-4412-babd-677dabf665cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:46.220381 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff06c4b-a833-4412-babd-677dabf665cf None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:46.220665 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff06c4b-a833-4412-babd-677dabf665cf None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:46.220938 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff06c4b-a833-4412-babd-677dabf665cf None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:46.221706 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff06c4b-a833-4412-babd-677dabf665cf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:46.222560 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff06c4b-a833-4412-babd-677dabf665cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:46.223943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff06c4b-a833-4412-babd-677dabf665cf None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:46.231633 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 528/1093] 10.222.0.25 () {56 vars in 1115 bytes} [Thu May 12 06:32:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:46.237217 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff06c4b-a833-4412-babd-677dabf665cf None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:46.254591 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd32a9b-b71c-4497-9251-f8325322dcd1 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:46.286569 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b51ea-ff9d-44d3-bed3-1f697ca8c5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:46.287207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b51ea-ff9d-44d3-bed3-1f697ca8c5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:46.287487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b51ea-ff9d-44d3-bed3-1f697ca8c5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:46.287787 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b51ea-ff9d-44d3-bed3-1f697ca8c5b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:46.330701 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff06c4b-a833-4412-babd-677dabf665cf None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:46.350414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b51ea-ff9d-44d3-bed3-1f697ca8c5b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:46.351928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b51ea-ff9d-44d3-bed3-1f697ca8c5b0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:46.364231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159eb764-8e2c-44a1-b164-01ea5a1a9a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:46.364953 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159eb764-8e2c-44a1-b164-01ea5a1a9a36 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:46.365235 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159eb764-8e2c-44a1-b164-01ea5a1a9a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:46.365510 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159eb764-8e2c-44a1-b164-01ea5a1a9a36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:46.375490 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159eb764-8e2c-44a1-b164-01ea5a1a9a36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:46.376948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159eb764-8e2c-44a1-b164-01ea5a1a9a36 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:46.393285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-159eb764-8e2c-44a1-b164-01ea5a1a9a36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:46.393285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:46.393285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:46.393285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:46.393285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:46.393285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:46.393285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:46.393285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:46.393285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:46.393285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:46.393285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:46.393285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:46.393285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:46.393285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:46.393285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:46.394787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:46.394787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:46.394787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:46.394787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:46.394787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:46.394787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:46.394787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:46.394787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:46.394787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:46.394787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:46.394787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:46.394787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:46.394787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:46.394787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:46.394787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:46.394787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:46.394787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:46.395731 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:46.395731 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:46.395731 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:46.395731 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:46.395731 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 529/1094] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:46.400498 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159eb764-8e2c-44a1-b164-01ea5a1a9a36 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:46.444842 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 566/1095] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:32:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 06:32:46.450494 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b51ea-ff9d-44d3-bed3-1f697ca8c5b0 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:46.495027 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159eb764-8e2c-44a1-b164-01ea5a1a9a36 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:46.527007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38d585-c285-49f5-b6ff-c5f3bcaab35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:46.527654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38d585-c285-49f5-b6ff-c5f3bcaab35a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:46.527965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38d585-c285-49f5-b6ff-c5f3bcaab35a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:46.528236 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38d585-c285-49f5-b6ff-c5f3bcaab35a None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:46.528954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38d585-c285-49f5-b6ff-c5f3bcaab35a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:46.529255 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38d585-c285-49f5-b6ff-c5f3bcaab35a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:46.530602 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38d585-c285-49f5-b6ff-c5f3bcaab35a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:46.542019 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 530/1096] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:46.546621 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b51ea-ff9d-44d3-bed3-1f697ca8c5b0 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:46.547520 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38d585-c285-49f5-b6ff-c5f3bcaab35a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:46.575268 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513be761-9d7d-4842-8bdf-e56821055c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:46.576276 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513be761-9d7d-4842-8bdf-e56821055c46 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:46.576556 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513be761-9d7d-4842-8bdf-e56821055c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:46.576826 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513be761-9d7d-4842-8bdf-e56821055c46 None admin] PATH_INFO: `/v3/projects/f5009c5b18db4047b11afad886e1619e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:46.578006 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513be761-9d7d-4842-8bdf-e56821055c46 None admin] RBAC: Authorizing `identity:get_project(project_id=f5009c5b18db4047b11afad886e1619e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:46.579427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513be761-9d7d-4842-8bdf-e56821055c46 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:46.586619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 567/1097] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:32:46 2022] GET /identity/v3/projects/f5009c5b18db4047b11afad886e1619e => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:46.587530 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513be761-9d7d-4842-8bdf-e56821055c46 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:46.639530 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38d585-c285-49f5-b6ff-c5f3bcaab35a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:46.671843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dac9f2-20f7-45e6-9f8b-3aada0267554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:46.672616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dac9f2-20f7-45e6-9f8b-3aada0267554 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:46.672892 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dac9f2-20f7-45e6-9f8b-3aada0267554 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:46.673158 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dac9f2-20f7-45e6-9f8b-3aada0267554 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:46.678715 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513be761-9d7d-4842-8bdf-e56821055c46 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:46.679862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dac9f2-20f7-45e6-9f8b-3aada0267554 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:46.681285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dac9f2-20f7-45e6-9f8b-3aada0267554 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:46.695738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-62dac9f2-20f7-45e6-9f8b-3aada0267554 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 06:32:46.695738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:46.695738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:46.695738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:46.695738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:46.695738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:46.695738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:46.695738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:46.695738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:46.695738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:46.695738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:46.695738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:46.695738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:32:46.695738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:32:46.695738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:32:46.695738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:32:46.696699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:46.696699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:46.696699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:32:46.696699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:46.696699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:32:46.696699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:32:46.696699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:46.696699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:46.696699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:46.696699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:46.696699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:46.696699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:46.696699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:46.696699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:46.696699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:46.696699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:46.696699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:46.696699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:46.697788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:46.697788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:46.697788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:32:46.697788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:32:46.697788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:32:46.697788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:32:46.697788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:32:46.697788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:32:46.697788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 06:32:46.697788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:46.697788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 531/1098] 10.222.0.25 () {56 vars in 1093 bytes} [Thu May 12 06:32:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:46.703100 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dac9f2-20f7-45e6-9f8b-3aada0267554 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:46.718724 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e1c3f-23df-4b05-9ee7-2ba8dbf487c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:46.719376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e1c3f-23df-4b05-9ee7-2ba8dbf487c6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:46.719654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e1c3f-23df-4b05-9ee7-2ba8dbf487c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:46.719957 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e1c3f-23df-4b05-9ee7-2ba8dbf487c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:46.720783 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e1c3f-23df-4b05-9ee7-2ba8dbf487c6 None admin] RBAC: Adding query filter params (role.id=5e6a73052f3b4ee7829ecb858925e5ca, scope.project.id=f5009c5b18db4047b11afad886e1619e, user.id=7ff24b1d24054d94b99d4903e9d88be3) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:46.721089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e1c3f-23df-4b05-9ee7-2ba8dbf487c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:46.723028 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e1c3f-23df-4b05-9ee7-2ba8dbf487c6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:46.728629 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 568/1099] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:32:46 2022] GET /identity/v3/role_assignments?user.id=7ff24b1d24054d94b99d4903e9d88be3&scope.project.id=f5009c5b18db4047b11afad886e1619e&role.id=5e6a73052f3b4ee7829ecb858925e5ca => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:46.802109 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dac9f2-20f7-45e6-9f8b-3aada0267554 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:46.836079 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386f1bc-e6e6-4e8b-9f29-4d51c84f1274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:46.836755 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386f1bc-e6e6-4e8b-9f29-4d51c84f1274 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:46.837033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386f1bc-e6e6-4e8b-9f29-4d51c84f1274 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:46.837307 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386f1bc-e6e6-4e8b-9f29-4d51c84f1274 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:46.838155 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386f1bc-e6e6-4e8b-9f29-4d51c84f1274 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:46.838464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386f1bc-e6e6-4e8b-9f29-4d51c84f1274 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:46.839920 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386f1bc-e6e6-4e8b-9f29-4d51c84f1274 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:46.858816 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 532/1100] 10.222.0.25 () {56 vars in 1133 bytes} [Thu May 12 06:32:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:32:46.865312 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e1c3f-23df-4b05-9ee7-2ba8dbf487c6 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:46.965072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e1c3f-23df-4b05-9ee7-2ba8dbf487c6 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:46.997919 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb654655-7289-41ef-9a28-623390c5c269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:46.998577 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb654655-7289-41ef-9a28-623390c5c269 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:46.998860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb654655-7289-41ef-9a28-623390c5c269 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:46.999132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb654655-7289-41ef-9a28-623390c5c269 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:47.062911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb654655-7289-41ef-9a28-623390c5c269 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:47.064381 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb654655-7289-41ef-9a28-623390c5c269 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:47.155841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 569/1101] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:32:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 06:32:47.162409 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386f1bc-e6e6-4e8b-9f29-4d51c84f1274 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:47.255947 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386f1bc-e6e6-4e8b-9f29-4d51c84f1274 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:47.290310 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097049a4-c821-4796-acf5-0566424cfb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:47.291100 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097049a4-c821-4796-acf5-0566424cfb83 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:47.291379 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097049a4-c821-4796-acf5-0566424cfb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:47.291650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097049a4-c821-4796-acf5-0566424cfb83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:47.301250 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097049a4-c821-4796-acf5-0566424cfb83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:47.302690 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097049a4-c821-4796-acf5-0566424cfb83 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:47.319956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-097049a4-c821-4796-acf5-0566424cfb83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:47.319956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:47.319956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:47.319956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:47.319956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:47.319956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:47.319956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:47.319956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:47.319956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:47.319956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:47.319956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:47.319956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:47.319956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:32:47.319956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:32:47.319956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:32:47.321002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:32:47.321002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:47.321002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:47.321002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:47.321002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:47.321002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:47.321002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:47.321002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:47.321002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:47.321002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:47.321002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:47.321002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:47.321002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:47.321002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:47.321002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:47.321002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:47.321002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:47.321940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:32:47.321940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:32:47.321940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:32:47.321940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:47.321940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 533/1102] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:32:47.326690 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb654655-7289-41ef-9a28-623390c5c269 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:47.418197 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb654655-7289-41ef-9a28-623390c5c269 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:47.451858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907362d-9c11-499c-a262-313f77ff0a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:47.452531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907362d-9c11-499c-a262-313f77ff0a2a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:47.452814 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907362d-9c11-499c-a262-313f77ff0a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:47.453090 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907362d-9c11-499c-a262-313f77ff0a2a None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:47.453840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907362d-9c11-499c-a262-313f77ff0a2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:47.454146 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907362d-9c11-499c-a262-313f77ff0a2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:47.455517 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907362d-9c11-499c-a262-313f77ff0a2a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:47.467064 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 570/1103] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:47.472608 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097049a4-c821-4796-acf5-0566424cfb83 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:47.566812 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097049a4-c821-4796-acf5-0566424cfb83 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:47.599993 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f6133-ff21-49ef-85c3-ec130baae1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:47.600767 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f6133-ff21-49ef-85c3-ec130baae1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:47.601043 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f6133-ff21-49ef-85c3-ec130baae1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:47.601310 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f6133-ff21-49ef-85c3-ec130baae1f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:47.607762 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f6133-ff21-49ef-85c3-ec130baae1f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:47.609166 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f6133-ff21-49ef-85c3-ec130baae1f5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:47.625371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-ba9f6133-ff21-49ef-85c3-ec130baae1f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:47.625371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:32:47.625371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:32:47.625371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:32:47.625371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:32:47.625371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:32:47.625371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:32:47.625371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:32:47.625371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:32:47.625371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:32:47.625371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:32:47.625371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:32:47.625371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:32:47.625371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:32:47.625371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:32:47.626351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:32:47.626351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:32:47.626351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:32:47.626351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:32:47.626351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:32:47.626351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:32:47.626351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:32:47.626351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:32:47.626351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:32:47.626351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:32:47.626351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:32:47.626351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:32:47.626351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:32:47.626351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:32:47.626351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:32:47.626351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:32:47.626351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:32:47.627453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:32:47.627453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:32:47.627453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:32:47.627453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:32:47.627453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:32:47.627453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:32:47.627453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:32:47.627453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:32:47.627453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 534/1104] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:32:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:32:47.632886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907362d-9c11-499c-a262-313f77ff0a2a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:47.728135 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907362d-9c11-499c-a262-313f77ff0a2a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:47.759663 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19eb174-cc2c-42fe-9b78-7767917bc911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:47.760334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19eb174-cc2c-42fe-9b78-7767917bc911 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:47.760609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19eb174-cc2c-42fe-9b78-7767917bc911 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:47.760876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19eb174-cc2c-42fe-9b78-7767917bc911 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:47.761649 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19eb174-cc2c-42fe-9b78-7767917bc911 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:47.761950 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19eb174-cc2c-42fe-9b78-7767917bc911 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:47.763352 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19eb174-cc2c-42fe-9b78-7767917bc911 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:47.774867 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 571/1105] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:32:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:47.780706 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f6133-ff21-49ef-85c3-ec130baae1f5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:47.877595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f6133-ff21-49ef-85c3-ec130baae1f5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:47.909482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ba84c-7917-4a67-96e5-c16297daa4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:47.910124 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ba84c-7917-4a67-96e5-c16297daa4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:47.910403 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ba84c-7917-4a67-96e5-c16297daa4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:47.910676 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ba84c-7917-4a67-96e5-c16297daa4e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:47.911504 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ba84c-7917-4a67-96e5-c16297daa4e5 None admin] RBAC: Adding query filter params (role.id=b675985f8bdd471ab51fb4fc2daff01e, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=bbcd54a927bf46f183b50fbda677868d) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:47.911913 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ba84c-7917-4a67-96e5-c16297daa4e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:47.913392 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ba84c-7917-4a67-96e5-c16297daa4e5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:47.919518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 535/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:32:47 2022] GET /identity/v3/role_assignments?user.id=bbcd54a927bf46f183b50fbda677868d&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=b675985f8bdd471ab51fb4fc2daff01e => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:48.949674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d2a27-730b-450a-b2f0-42fa9e545131 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:48.950210 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d2a27-730b-450a-b2f0-42fa9e545131 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:48.950210 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d2a27-730b-450a-b2f0-42fa9e545131 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:48.951568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 572/1107] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:48.956678 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dbada-5e6b-4a5c-8ee4-73c17483a09d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:48.957049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dbada-5e6b-4a5c-8ee4-73c17483a09d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:48.957226 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dbada-5e6b-4a5c-8ee4-73c17483a09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:48.973959 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-cf9dbada-5e6b-4a5c-8ee4-73c17483a09d None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:48.975126 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cf9dbada-5e6b-4a5c-8ee4-73c17483a09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:49.038451 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 536/1108] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:49.063067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d2a27-730b-450a-b2f0-42fa9e545131 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:49.157815 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d2a27-730b-450a-b2f0-42fa9e545131 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:49.189918 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a3e6d-451b-40bf-9fb0-90e2802cdfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:49.190757 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a3e6d-451b-40bf-9fb0-90e2802cdfb0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:49.191035 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a3e6d-451b-40bf-9fb0-90e2802cdfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:49.191301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a3e6d-451b-40bf-9fb0-90e2802cdfb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:49.192487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a3e6d-451b-40bf-9fb0-90e2802cdfb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:49.193894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a3e6d-451b-40bf-9fb0-90e2802cdfb0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:49.195480 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 573/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:32:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:49.201156 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dbada-5e6b-4a5c-8ee4-73c17483a09d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:49.294259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dbada-5e6b-4a5c-8ee4-73c17483a09d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:49.325526 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666035d-e857-4e4c-ab1e-740985ee0a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:49.326177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666035d-e857-4e4c-ab1e-740985ee0a7f None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:49.326460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666035d-e857-4e4c-ab1e-740985ee0a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:49.326734 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666035d-e857-4e4c-ab1e-740985ee0a7f None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:49.327430 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666035d-e857-4e4c-ab1e-740985ee0a7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:49.328873 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666035d-e857-4e4c-ab1e-740985ee0a7f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:49.429487 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 537/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 12 06:32:49 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:32:51.670264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab1c60-e07a-473f-b72c-c6bf2ae1d16a None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:51.670828 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab1c60-e07a-473f-b72c-c6bf2ae1d16a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:51.670828 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab1c60-e07a-473f-b72c-c6bf2ae1d16a None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:51.672216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 574/1111] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:51.677335 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ee48f-228b-4584-9ae5-1aae7d810979 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:51.677718 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ee48f-228b-4584-9ae5-1aae7d810979 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:51.677877 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ee48f-228b-4584-9ae5-1aae7d810979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:51.693927 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-106ee48f-228b-4584-9ae5-1aae7d810979 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:51.695099 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-106ee48f-228b-4584-9ae5-1aae7d810979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:51.757847 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 538/1112] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:51.781529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab1c60-e07a-473f-b72c-c6bf2ae1d16a None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:51.874449 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab1c60-e07a-473f-b72c-c6bf2ae1d16a None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:51.907100 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446c798-13c9-4862-8890-393c196b8e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:51.907966 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446c798-13c9-4862-8890-393c196b8e83 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:51.908246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446c798-13c9-4862-8890-393c196b8e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:51.908513 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446c798-13c9-4862-8890-393c196b8e83 None admin] PATH_INFO: `/v3/roles/cba01848eb624bfaaeeb1244e02e5bd7` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:51.909993 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446c798-13c9-4862-8890-393c196b8e83 None admin] RBAC: Authorizing `identity:get_role(role_id=cba01848eb624bfaaeeb1244e02e5bd7)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:51.911330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446c798-13c9-4862-8890-393c196b8e83 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:51.912715 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 575/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:32:51 2022] GET /identity/v3/roles/cba01848eb624bfaaeeb1244e02e5bd7 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:51.918712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ee48f-228b-4584-9ae5-1aae7d810979 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:52.011465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ee48f-228b-4584-9ae5-1aae7d810979 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:52.043265 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1084fb-ba16-43cb-8016-744d9f9db012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:52.044300 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1084fb-ba16-43cb-8016-744d9f9db012 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:52.044578 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1084fb-ba16-43cb-8016-744d9f9db012 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:52.044853 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1084fb-ba16-43cb-8016-744d9f9db012 None admin] PATH_INFO: `/v3/users/f8ddceb95bc542f9a8d773c4e180ad0e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:52.056926 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1084fb-ba16-43cb-8016-744d9f9db012 None admin] RBAC: Authorizing `identity:get_user(user_id=f8ddceb95bc542f9a8d773c4e180ad0e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:52.058346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1084fb-ba16-43cb-8016-744d9f9db012 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:52.059988 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 539/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:32:51 2022] GET /identity/v3/users/f8ddceb95bc542f9a8d773c4e180ad0e => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:52.066171 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446c798-13c9-4862-8890-393c196b8e83 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:52.157839 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446c798-13c9-4862-8890-393c196b8e83 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:52.189571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee3bdb-a6bc-474b-9d7d-7d65faf673fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:52.190815 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee3bdb-a6bc-474b-9d7d-7d65faf673fc None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:52.191097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee3bdb-a6bc-474b-9d7d-7d65faf673fc None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:52.191369 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee3bdb-a6bc-474b-9d7d-7d65faf673fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:52.253280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee3bdb-a6bc-474b-9d7d-7d65faf673fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:52.254638 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee3bdb-a6bc-474b-9d7d-7d65faf673fc None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:52.343625 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 576/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:32:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 06:32:52.349577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1084fb-ba16-43cb-8016-744d9f9db012 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:52.442584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1084fb-ba16-43cb-8016-744d9f9db012 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:52.473754 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9f596-552c-4db9-9a39-9255f95ef714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:52.474575 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9f596-552c-4db9-9a39-9255f95ef714 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:52.474847 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9f596-552c-4db9-9a39-9255f95ef714 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:52.475112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9f596-552c-4db9-9a39-9255f95ef714 None admin] PATH_INFO: `/v3/projects/f5009c5b18db4047b11afad886e1619e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:52.476297 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9f596-552c-4db9-9a39-9255f95ef714 None admin] RBAC: Authorizing `identity:get_project(project_id=f5009c5b18db4047b11afad886e1619e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:52.477698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9f596-552c-4db9-9a39-9255f95ef714 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:52.479328 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 540/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:32:52 2022] GET /identity/v3/projects/f5009c5b18db4047b11afad886e1619e => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:52.485332 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee3bdb-a6bc-474b-9d7d-7d65faf673fc None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:52.576452 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee3bdb-a6bc-474b-9d7d-7d65faf673fc None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:52.608228 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828aeb71-ee7d-4405-b158-a2ad629d9f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:52.608861 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828aeb71-ee7d-4405-b158-a2ad629d9f00 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:52.609136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828aeb71-ee7d-4405-b158-a2ad629d9f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:52.609402 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828aeb71-ee7d-4405-b158-a2ad629d9f00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:52.610220 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828aeb71-ee7d-4405-b158-a2ad629d9f00 None admin] RBAC: Adding query filter params (role.id=cba01848eb624bfaaeeb1244e02e5bd7, scope.project.id=f5009c5b18db4047b11afad886e1619e, user.id=f8ddceb95bc542f9a8d773c4e180ad0e) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:52.610524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828aeb71-ee7d-4405-b158-a2ad629d9f00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:52.611977 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828aeb71-ee7d-4405-b158-a2ad629d9f00 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:52.617071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 577/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:32:52 2022] GET /identity/v3/role_assignments?user.id=f8ddceb95bc542f9a8d773c4e180ad0e&scope.project.id=f5009c5b18db4047b11afad886e1619e&role.id=cba01848eb624bfaaeeb1244e02e5bd7 => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:54.774967 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a637d34-58d6-4794-aae8-33df0bca0eab None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:54.775495 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a637d34-58d6-4794-aae8-33df0bca0eab None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:54.775495 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a637d34-58d6-4794-aae8-33df0bca0eab None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:54.777017 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 541/1118] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:54.782213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453e42f-c9a8-4568-955b-7e43526375df None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:54.782629 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453e42f-c9a8-4568-955b-7e43526375df None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:54.782762 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453e42f-c9a8-4568-955b-7e43526375df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:54.800170 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-a453e42f-c9a8-4568-955b-7e43526375df None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:54.801349 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a453e42f-c9a8-4568-955b-7e43526375df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:54.862902 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 578/1119] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:54.884910 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a637d34-58d6-4794-aae8-33df0bca0eab None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:54.978799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a637d34-58d6-4794-aae8-33df0bca0eab None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:55.011472 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc5d30-f790-42f5-842d-db1c81a8a83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:55.012351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc5d30-f790-42f5-842d-db1c81a8a83a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:55.012627 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc5d30-f790-42f5-842d-db1c81a8a83a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:55.012893 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc5d30-f790-42f5-842d-db1c81a8a83a None admin] PATH_INFO: `/v3/roles/cba01848eb624bfaaeeb1244e02e5bd7` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:55.014337 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc5d30-f790-42f5-842d-db1c81a8a83a None admin] RBAC: Authorizing `identity:get_role(role_id=cba01848eb624bfaaeeb1244e02e5bd7)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:55.015701 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc5d30-f790-42f5-842d-db1c81a8a83a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:55.017057 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 542/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:32:54 2022] GET /identity/v3/roles/cba01848eb624bfaaeeb1244e02e5bd7 => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:55.022734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453e42f-c9a8-4568-955b-7e43526375df None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:55.114276 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453e42f-c9a8-4568-955b-7e43526375df None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:55.145135 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d51e8a-76c0-4fa1-a300-d5a332d2d5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:55.145987 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d51e8a-76c0-4fa1-a300-d5a332d2d5de None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:55.146264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d51e8a-76c0-4fa1-a300-d5a332d2d5de None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:55.146532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d51e8a-76c0-4fa1-a300-d5a332d2d5de None admin] PATH_INFO: `/v3/users/f8ddceb95bc542f9a8d773c4e180ad0e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:55.147716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d51e8a-76c0-4fa1-a300-d5a332d2d5de None admin] RBAC: Authorizing `identity:get_user(user_id=f8ddceb95bc542f9a8d773c4e180ad0e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:55.149121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d51e8a-76c0-4fa1-a300-d5a332d2d5de None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:55.150708 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 579/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:32:55 2022] GET /identity/v3/users/f8ddceb95bc542f9a8d773c4e180ad0e => generated 286 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:55.156271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc5d30-f790-42f5-842d-db1c81a8a83a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:55.250282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc5d30-f790-42f5-842d-db1c81a8a83a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:55.281765 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f0b4d-bd5d-44dd-bc95-2720572b4b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:55.282597 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f0b4d-bd5d-44dd-bc95-2720572b4b94 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:55.282870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f0b4d-bd5d-44dd-bc95-2720572b4b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:55.283136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f0b4d-bd5d-44dd-bc95-2720572b4b94 None admin] PATH_INFO: `/v3/projects/f5009c5b18db4047b11afad886e1619e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:55.284824 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f0b4d-bd5d-44dd-bc95-2720572b4b94 None admin] RBAC: Authorizing `identity:get_project(project_id=f5009c5b18db4047b11afad886e1619e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:55.286232 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f0b4d-bd5d-44dd-bc95-2720572b4b94 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:55.287931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 543/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:32:55 2022] GET /identity/v3/projects/f5009c5b18db4047b11afad886e1619e => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:55.294185 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d51e8a-76c0-4fa1-a300-d5a332d2d5de None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:55.384904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d51e8a-76c0-4fa1-a300-d5a332d2d5de None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:55.416142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68cbeb-397e-4d04-87c5-5118dcd7f8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:55.417001 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68cbeb-397e-4d04-87c5-5118dcd7f8ef None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:55.417280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68cbeb-397e-4d04-87c5-5118dcd7f8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:55.417547 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68cbeb-397e-4d04-87c5-5118dcd7f8ef None admin] PATH_INFO: `/v3/projects/f5009c5b18db4047b11afad886e1619e/users/f8ddceb95bc542f9a8d773c4e180ad0e/roles/cba01848eb624bfaaeeb1244e02e5bd7` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:55.419712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68cbeb-397e-4d04-87c5-5118dcd7f8ef None admin] RBAC: Authorizing `identity:create_grant(project_id=f5009c5b18db4047b11afad886e1619e, user_id=f8ddceb95bc542f9a8d773c4e180ad0e, role_id=cba01848eb624bfaaeeb1244e02e5bd7)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:55.421110 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68cbeb-397e-4d04-87c5-5118dcd7f8ef None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:55.480535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 580/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:32:55 2022] PUT /identity/v3/projects/f5009c5b18db4047b11afad886e1619e/users/f8ddceb95bc542f9a8d773c4e180ad0e/roles/cba01848eb624bfaaeeb1244e02e5bd7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:32:57.634113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf6f77-f783-4f43-b38a-576de350e16d None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:57.634646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf6f77-f783-4f43-b38a-576de350e16d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:57.634646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf6f77-f783-4f43-b38a-576de350e16d None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:57.636057 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 544/1124] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:32:57.641255 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa27643-f304-4279-a7b9-c85e648d0fd1 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:57.641646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa27643-f304-4279-a7b9-c85e648d0fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:57.641798 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa27643-f304-4279-a7b9-c85e648d0fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:57.658224 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-caa27643-f304-4279-a7b9-c85e648d0fd1 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:32:57.660062 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-caa27643-f304-4279-a7b9-c85e648d0fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:32:57.720910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 581/1125] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:32:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:32:57.744111 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf6f77-f783-4f43-b38a-576de350e16d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:57.840949 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf6f77-f783-4f43-b38a-576de350e16d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:57.872844 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d3847-6af3-411e-aec3-324464997c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:57.873679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d3847-6af3-411e-aec3-324464997c7f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:57.873957 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d3847-6af3-411e-aec3-324464997c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:57.874228 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d3847-6af3-411e-aec3-324464997c7f None admin] PATH_INFO: `/v3/roles/cba01848eb624bfaaeeb1244e02e5bd7` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:57.875677 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d3847-6af3-411e-aec3-324464997c7f None admin] RBAC: Authorizing `identity:get_role(role_id=cba01848eb624bfaaeeb1244e02e5bd7)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:57.877053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d3847-6af3-411e-aec3-324464997c7f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:57.878913 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 545/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:32:57 2022] GET /identity/v3/roles/cba01848eb624bfaaeeb1244e02e5bd7 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:57.884612 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa27643-f304-4279-a7b9-c85e648d0fd1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:57.975271 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa27643-f304-4279-a7b9-c85e648d0fd1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:58.006576 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b76d0d-7c99-461c-8a7d-e61b4500e384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:58.007428 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b76d0d-7c99-461c-8a7d-e61b4500e384 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:58.007728 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b76d0d-7c99-461c-8a7d-e61b4500e384 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:58.008004 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b76d0d-7c99-461c-8a7d-e61b4500e384 None admin] PATH_INFO: `/v3/users/f8ddceb95bc542f9a8d773c4e180ad0e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:58.009172 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b76d0d-7c99-461c-8a7d-e61b4500e384 None admin] RBAC: Authorizing `identity:get_user(user_id=f8ddceb95bc542f9a8d773c4e180ad0e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:58.010573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b76d0d-7c99-461c-8a7d-e61b4500e384 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:58.012215 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 582/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:32:57 2022] GET /identity/v3/users/f8ddceb95bc542f9a8d773c4e180ad0e => generated 286 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:58.018451 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d3847-6af3-411e-aec3-324464997c7f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:58.110542 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d3847-6af3-411e-aec3-324464997c7f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:58.142920 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356754b8-c1b9-4967-9023-11ec441c632a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:58.143526 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356754b8-c1b9-4967-9023-11ec441c632a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:58.143890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356754b8-c1b9-4967-9023-11ec441c632a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:58.144243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356754b8-c1b9-4967-9023-11ec441c632a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:58.206891 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356754b8-c1b9-4967-9023-11ec441c632a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:58.208345 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356754b8-c1b9-4967-9023-11ec441c632a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:58.298986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 546/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:32:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 06:32:58.305349 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b76d0d-7c99-461c-8a7d-e61b4500e384 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:58.396552 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b76d0d-7c99-461c-8a7d-e61b4500e384 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:58.428359 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110b24e-0c9b-4953-897e-eb649cb29617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:58.429196 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110b24e-0c9b-4953-897e-eb649cb29617 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:58.429473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110b24e-0c9b-4953-897e-eb649cb29617 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:58.429739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110b24e-0c9b-4953-897e-eb649cb29617 None admin] PATH_INFO: `/v3/projects/f5009c5b18db4047b11afad886e1619e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:58.430888 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110b24e-0c9b-4953-897e-eb649cb29617 None admin] RBAC: Authorizing `identity:get_project(project_id=f5009c5b18db4047b11afad886e1619e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:58.432325 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110b24e-0c9b-4953-897e-eb649cb29617 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:58.433961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 583/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:32:58 2022] GET /identity/v3/projects/f5009c5b18db4047b11afad886e1619e => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:32:58.442178 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356754b8-c1b9-4967-9023-11ec441c632a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:32:58.532953 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356754b8-c1b9-4967-9023-11ec441c632a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:32:58.565419 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcbfa2-1666-4585-a370-dc9c36ec6756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:32:58.566048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcbfa2-1666-4585-a370-dc9c36ec6756 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:32:58.566328 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcbfa2-1666-4585-a370-dc9c36ec6756 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:32:58.566596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcbfa2-1666-4585-a370-dc9c36ec6756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:32:58.567412 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcbfa2-1666-4585-a370-dc9c36ec6756 None admin] RBAC: Adding query filter params (role.id=cba01848eb624bfaaeeb1244e02e5bd7, scope.project.id=f5009c5b18db4047b11afad886e1619e, user.id=f8ddceb95bc542f9a8d773c4e180ad0e) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:32:58.567740 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcbfa2-1666-4585-a370-dc9c36ec6756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:32:58.569148 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcbfa2-1666-4585-a370-dc9c36ec6756 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:32:58.574660 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 547/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:32:58 2022] GET /identity/v3/role_assignments?user.id=f8ddceb95bc542f9a8d773c4e180ad0e&scope.project.id=f5009c5b18db4047b11afad886e1619e&role.id=cba01848eb624bfaaeeb1244e02e5bd7 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:00.767410 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367200a8-f5ba-412a-b7cc-8a63cc6d54d6 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:00.768043 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367200a8-f5ba-412a-b7cc-8a63cc6d54d6 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:00.768043 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367200a8-f5ba-412a-b7cc-8a63cc6d54d6 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:00.769366 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 584/1131] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:33:00.774494 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620b238-b6a0-4aa3-ae40-7e52710f5727 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:00.774924 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620b238-b6a0-4aa3-ae40-7e52710f5727 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:00.775050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620b238-b6a0-4aa3-ae40-7e52710f5727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:00.792048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d620b238-b6a0-4aa3-ae40-7e52710f5727 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:33:00.793222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d620b238-b6a0-4aa3-ae40-7e52710f5727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:33:00.856011 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 548/1132] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:33:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:33:00.879190 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367200a8-f5ba-412a-b7cc-8a63cc6d54d6 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:00.973706 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367200a8-f5ba-412a-b7cc-8a63cc6d54d6 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:01.005989 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afd17b-2f4b-4580-9d2d-66d10cd24369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:01.006776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afd17b-2f4b-4580-9d2d-66d10cd24369 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:01.007062 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afd17b-2f4b-4580-9d2d-66d10cd24369 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:01.007331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afd17b-2f4b-4580-9d2d-66d10cd24369 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:01.008532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afd17b-2f4b-4580-9d2d-66d10cd24369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:01.009941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afd17b-2f4b-4580-9d2d-66d10cd24369 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:01.011552 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 585/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:33:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:01.017262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620b238-b6a0-4aa3-ae40-7e52710f5727 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:01.110640 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620b238-b6a0-4aa3-ae40-7e52710f5727 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:01.142479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbeeb7-26cd-4dd0-80a6-c4ae9311c256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:01.143661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbeeb7-26cd-4dd0-80a6-c4ae9311c256 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:01.143974 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbeeb7-26cd-4dd0-80a6-c4ae9311c256 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:01.144242 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbeeb7-26cd-4dd0-80a6-c4ae9311c256 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:01.144941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbeeb7-26cd-4dd0-80a6-c4ae9311c256 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:01.146358 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbeeb7-26cd-4dd0-80a6-c4ae9311c256 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:01.241682 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 549/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 12 06:33:01 2022] POST /identity/v3/projects => generated 311 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:33:03.445751 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c066384-9161-4307-9933-206693f7dc8d None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:03.446250 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c066384-9161-4307-9933-206693f7dc8d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:03.446250 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c066384-9161-4307-9933-206693f7dc8d None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:03.447583 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 586/1135] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:33:03.452926 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f96b5a-195d-44e7-9c88-3940b8c1a808 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:03.453318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f96b5a-195d-44e7-9c88-3940b8c1a808 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:03.453484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f96b5a-195d-44e7-9c88-3940b8c1a808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:03.469694 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-73f96b5a-195d-44e7-9c88-3940b8c1a808 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:33:03.470869 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-73f96b5a-195d-44e7-9c88-3940b8c1a808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:33:03.533652 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 550/1136] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:33:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:33:03.558605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c066384-9161-4307-9933-206693f7dc8d None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:03.653015 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c066384-9161-4307-9933-206693f7dc8d None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:03.684705 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f112492-147f-434d-8513-9db7ed615b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:03.685475 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f112492-147f-434d-8513-9db7ed615b00 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:03.685755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f112492-147f-434d-8513-9db7ed615b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:03.686024 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f112492-147f-434d-8513-9db7ed615b00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:03.687185 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f112492-147f-434d-8513-9db7ed615b00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:03.688619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f112492-147f-434d-8513-9db7ed615b00 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:03.690802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 587/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:33:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:03.696439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f96b5a-195d-44e7-9c88-3940b8c1a808 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:03.788396 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f96b5a-195d-44e7-9c88-3940b8c1a808 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:03.820715 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ae383-682e-49bc-82db-062b86962516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:03.821370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ae383-682e-49bc-82db-062b86962516 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:03.821653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ae383-682e-49bc-82db-062b86962516 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:03.821949 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ae383-682e-49bc-82db-062b86962516 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:03.822659 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ae383-682e-49bc-82db-062b86962516 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:03.824115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ae383-682e-49bc-82db-062b86962516 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:03.909607 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 551/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 12 06:33:03 2022] POST /identity/v3/users => generated 286 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:33:06.121897 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb5b78-aabb-47ae-aac7-8e4183d2db65 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:06.122390 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb5b78-aabb-47ae-aac7-8e4183d2db65 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:06.122475 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb5b78-aabb-47ae-aac7-8e4183d2db65 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:06.123885 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 588/1139] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:33:06.128948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bf021-125a-4d01-8198-e72945bb1eeb None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:06.129378 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bf021-125a-4d01-8198-e72945bb1eeb None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:06.129512 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bf021-125a-4d01-8198-e72945bb1eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:06.145875 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-fc1bf021-125a-4d01-8198-e72945bb1eeb None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:33:06.147044 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fc1bf021-125a-4d01-8198-e72945bb1eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:33:06.209334 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 552/1140] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:33:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:33:06.232788 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb5b78-aabb-47ae-aac7-8e4183d2db65 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:06.330672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb5b78-aabb-47ae-aac7-8e4183d2db65 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:06.361957 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12956d42-73c0-459d-bc6b-6e0e19164c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:06.362783 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12956d42-73c0-459d-bc6b-6e0e19164c2a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:06.363062 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12956d42-73c0-459d-bc6b-6e0e19164c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:06.363331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12956d42-73c0-459d-bc6b-6e0e19164c2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:06.373003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12956d42-73c0-459d-bc6b-6e0e19164c2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:33:06.381417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-12956d42-73c0-459d-bc6b-6e0e19164c2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:33:06.381417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:33:06.381417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:33:06.381417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:33:06.381417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:33:06.381417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:33:06.381417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:33:06.381417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:33:06.381417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:33:06.381417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:33:06.381417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:33:06.381417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:33:06.381417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:33:06.381417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:33:06.381417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:33:06.381417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:33:06.382544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:33:06.382544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:33:06.382544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:33:06.382544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:33:06.382544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:33:06.382544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:33:06.382544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:33:06.382544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:33:06.382544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:33:06.382544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:33:06.382544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:33:06.382544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:33:06.382544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:33:06.382544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:33:06.382544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:33:06.382544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:33:06.383620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:33:06.383620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:33:06.383620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:33:06.383620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:33:06.383620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:33:06.383620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:33:06.383620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:33:06.383620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:33:06.383620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:33:06.383620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:33:06.383620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:33:06.383620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:33:06.383620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 589/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:33:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:33:06.388592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bf021-125a-4d01-8198-e72945bb1eeb None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:06.480377 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bf021-125a-4d01-8198-e72945bb1eeb None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:06.518507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67685ed1-8e49-45ae-9249-cf2d3698320c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:06.519158 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67685ed1-8e49-45ae-9249-cf2d3698320c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:06.519438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67685ed1-8e49-45ae-9249-cf2d3698320c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:06.519739 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67685ed1-8e49-45ae-9249-cf2d3698320c None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:06.520481 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67685ed1-8e49-45ae-9249-cf2d3698320c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:33:06.520783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67685ed1-8e49-45ae-9249-cf2d3698320c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:06.522144 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67685ed1-8e49-45ae-9249-cf2d3698320c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:06.529734 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 553/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:33:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:06.535455 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12956d42-73c0-459d-bc6b-6e0e19164c2a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:06.628831 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12956d42-73c0-459d-bc6b-6e0e19164c2a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:06.658989 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84c003-bbda-4519-9237-5f3cee9fc7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:06.659867 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84c003-bbda-4519-9237-5f3cee9fc7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:06.660145 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84c003-bbda-4519-9237-5f3cee9fc7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:06.660415 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84c003-bbda-4519-9237-5f3cee9fc7f2 None admin] PATH_INFO: `/v3/users/3296c0fb7fd84b44b12fd1ff6d0e0dcf` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:06.672937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84c003-bbda-4519-9237-5f3cee9fc7f2 None admin] RBAC: Authorizing `identity:get_user(user_id=3296c0fb7fd84b44b12fd1ff6d0e0dcf)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:06.674837 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84c003-bbda-4519-9237-5f3cee9fc7f2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:06.676473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 590/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:33:06 2022] GET /identity/v3/users/3296c0fb7fd84b44b12fd1ff6d0e0dcf => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:06.682033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67685ed1-8e49-45ae-9249-cf2d3698320c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:06.775559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67685ed1-8e49-45ae-9249-cf2d3698320c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:06.806726 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9238fc-7d42-49d3-afb6-c74f5b977785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:06.807350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9238fc-7d42-49d3-afb6-c74f5b977785 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:06.807633 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9238fc-7d42-49d3-afb6-c74f5b977785 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:06.807948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9238fc-7d42-49d3-afb6-c74f5b977785 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:06.869877 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9238fc-7d42-49d3-afb6-c74f5b977785 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:06.871293 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9238fc-7d42-49d3-afb6-c74f5b977785 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:06.962147 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 554/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:33:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 06:33:06.967722 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84c003-bbda-4519-9237-5f3cee9fc7f2 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:07.060272 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84c003-bbda-4519-9237-5f3cee9fc7f2 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:07.091125 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ad9ba-9eab-43e8-8daf-7db5ec211266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:07.091995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ad9ba-9eab-43e8-8daf-7db5ec211266 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:07.092273 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ad9ba-9eab-43e8-8daf-7db5ec211266 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:07.092541 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ad9ba-9eab-43e8-8daf-7db5ec211266 None admin] PATH_INFO: `/v3/projects/ea4b8fa8987843ba9ff41de6b4652a99` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:07.093697 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ad9ba-9eab-43e8-8daf-7db5ec211266 None admin] RBAC: Authorizing `identity:get_project(project_id=ea4b8fa8987843ba9ff41de6b4652a99)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:07.095101 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ad9ba-9eab-43e8-8daf-7db5ec211266 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:07.097327 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 591/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:33:06 2022] GET /identity/v3/projects/ea4b8fa8987843ba9ff41de6b4652a99 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:07.103216 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9238fc-7d42-49d3-afb6-c74f5b977785 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:07.195950 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9238fc-7d42-49d3-afb6-c74f5b977785 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:07.228446 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff30a91-4c14-4671-8a59-ee91ea4e545b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:07.229021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff30a91-4c14-4671-8a59-ee91ea4e545b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:07.229302 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff30a91-4c14-4671-8a59-ee91ea4e545b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:07.229577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff30a91-4c14-4671-8a59-ee91ea4e545b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:07.230401 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff30a91-4c14-4671-8a59-ee91ea4e545b None admin] RBAC: Adding query filter params (role.id=5e6a73052f3b4ee7829ecb858925e5ca, scope.project.id=ea4b8fa8987843ba9ff41de6b4652a99, user.id=3296c0fb7fd84b44b12fd1ff6d0e0dcf) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:33:07.230713 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff30a91-4c14-4671-8a59-ee91ea4e545b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:07.232159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff30a91-4c14-4671-8a59-ee91ea4e545b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:07.237363 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 555/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:33:07 2022] GET /identity/v3/role_assignments?user.id=3296c0fb7fd84b44b12fd1ff6d0e0dcf&scope.project.id=ea4b8fa8987843ba9ff41de6b4652a99&role.id=5e6a73052f3b4ee7829ecb858925e5ca => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:09.404547 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce00453-5457-408f-be2f-ee8386bc23a2 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:09.405084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce00453-5457-408f-be2f-ee8386bc23a2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:09.405084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce00453-5457-408f-be2f-ee8386bc23a2 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:09.406441 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 592/1147] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:33:09.412397 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6206603-3791-4308-8058-a0a2f67dc6f6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:09.412790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6206603-3791-4308-8058-a0a2f67dc6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:09.412940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6206603-3791-4308-8058-a0a2f67dc6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:09.429378 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e6206603-3791-4308-8058-a0a2f67dc6f6 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:33:09.430548 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e6206603-3791-4308-8058-a0a2f67dc6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:33:09.492561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 556/1148] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:33:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:33:09.514547 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce00453-5457-408f-be2f-ee8386bc23a2 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:09.609879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce00453-5457-408f-be2f-ee8386bc23a2 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:09.640781 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2081fa9-7a23-494d-8cf5-5d4082d39af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:09.641591 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2081fa9-7a23-494d-8cf5-5d4082d39af4 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:09.641871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2081fa9-7a23-494d-8cf5-5d4082d39af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:09.642657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2081fa9-7a23-494d-8cf5-5d4082d39af4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:09.652133 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2081fa9-7a23-494d-8cf5-5d4082d39af4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:33:09.660523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-c2081fa9-7a23-494d-8cf5-5d4082d39af4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:33:09.660523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:33:09.660523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:33:09.660523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:33:09.660523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:33:09.660523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:33:09.660523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:33:09.660523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:33:09.660523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:33:09.660523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:33:09.660523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:33:09.660523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:33:09.660523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:33:09.660523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:33:09.660523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:33:09.660523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:33:09.661646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:33:09.661646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:33:09.661646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:33:09.661646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:33:09.661646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:33:09.661646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:33:09.661646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:33:09.661646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:33:09.661646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:33:09.661646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:33:09.661646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:33:09.661646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:33:09.661646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:33:09.661646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:33:09.661646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:33:09.661646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:33:09.662872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:33:09.662872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:33:09.662872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:33:09.662872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:33:09.662872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:33:09.662872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:33:09.662872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:33:09.662872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:33:09.662872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:33:09.662872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:33:09.662872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:33:09.662872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:33:09.662872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 593/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:33:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:33:09.667811 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6206603-3791-4308-8058-a0a2f67dc6f6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:09.760135 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6206603-3791-4308-8058-a0a2f67dc6f6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:09.792028 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6797a7-307d-4d0c-9b24-a84f9ae6272d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:09.792683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6797a7-307d-4d0c-9b24-a84f9ae6272d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:09.792964 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6797a7-307d-4d0c-9b24-a84f9ae6272d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:09.793237 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6797a7-307d-4d0c-9b24-a84f9ae6272d None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:09.793982 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6797a7-307d-4d0c-9b24-a84f9ae6272d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:33:09.794284 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6797a7-307d-4d0c-9b24-a84f9ae6272d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:09.795634 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6797a7-307d-4d0c-9b24-a84f9ae6272d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:09.803412 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 557/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:33:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:09.809109 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2081fa9-7a23-494d-8cf5-5d4082d39af4 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:09.902872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2081fa9-7a23-494d-8cf5-5d4082d39af4 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:09.933900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b89086-867f-4960-b64b-17d574ee2696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:09.934692 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b89086-867f-4960-b64b-17d574ee2696 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:09.934974 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b89086-867f-4960-b64b-17d574ee2696 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:09.935246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b89086-867f-4960-b64b-17d574ee2696 None admin] PATH_INFO: `/v3/users/3296c0fb7fd84b44b12fd1ff6d0e0dcf` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:09.936448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b89086-867f-4960-b64b-17d574ee2696 None admin] RBAC: Authorizing `identity:get_user(user_id=3296c0fb7fd84b44b12fd1ff6d0e0dcf)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:09.937874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b89086-867f-4960-b64b-17d574ee2696 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:09.940028 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 594/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:33:09 2022] GET /identity/v3/users/3296c0fb7fd84b44b12fd1ff6d0e0dcf => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:09.945384 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6797a7-307d-4d0c-9b24-a84f9ae6272d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:10.038669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6797a7-307d-4d0c-9b24-a84f9ae6272d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:10.069681 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5651dd1-b2cd-414e-a703-72359f471c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:10.070515 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5651dd1-b2cd-414e-a703-72359f471c5d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:10.070791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5651dd1-b2cd-414e-a703-72359f471c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:10.071057 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5651dd1-b2cd-414e-a703-72359f471c5d None admin] PATH_INFO: `/v3/projects/ea4b8fa8987843ba9ff41de6b4652a99` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:10.072230 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5651dd1-b2cd-414e-a703-72359f471c5d None admin] RBAC: Authorizing `identity:get_project(project_id=ea4b8fa8987843ba9ff41de6b4652a99)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:10.073635 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5651dd1-b2cd-414e-a703-72359f471c5d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:10.075288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 558/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:33:09 2022] GET /identity/v3/projects/ea4b8fa8987843ba9ff41de6b4652a99 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:10.081667 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b89086-867f-4960-b64b-17d574ee2696 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:10.174615 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b89086-867f-4960-b64b-17d574ee2696 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:10.206154 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ae38b-bac9-47b2-9859-59f782f5ca1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:10.206998 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ae38b-bac9-47b2-9859-59f782f5ca1e None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:10.207278 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ae38b-bac9-47b2-9859-59f782f5ca1e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:10.207550 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ae38b-bac9-47b2-9859-59f782f5ca1e None admin] PATH_INFO: `/v3/projects/ea4b8fa8987843ba9ff41de6b4652a99/users/3296c0fb7fd84b44b12fd1ff6d0e0dcf/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:10.209512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ae38b-bac9-47b2-9859-59f782f5ca1e None admin] RBAC: Authorizing `identity:create_grant(project_id=ea4b8fa8987843ba9ff41de6b4652a99, user_id=3296c0fb7fd84b44b12fd1ff6d0e0dcf, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:10.211011 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ae38b-bac9-47b2-9859-59f782f5ca1e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:10.290365 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 595/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:33:10 2022] PUT /identity/v3/projects/ea4b8fa8987843ba9ff41de6b4652a99/users/3296c0fb7fd84b44b12fd1ff6d0e0dcf/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:33:12.443617 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee5731-805f-4480-a349-1a2218dc54a6 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:12.444214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee5731-805f-4480-a349-1a2218dc54a6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:12.444214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee5731-805f-4480-a349-1a2218dc54a6 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:12.445524 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 559/1154] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:33:12.450735 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79168fe1-b1ee-4dc6-a2ea-301bc41ae2f4 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:12.451156 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79168fe1-b1ee-4dc6-a2ea-301bc41ae2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:12.451289 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79168fe1-b1ee-4dc6-a2ea-301bc41ae2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:12.468050 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-79168fe1-b1ee-4dc6-a2ea-301bc41ae2f4 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:33:12.469212 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-79168fe1-b1ee-4dc6-a2ea-301bc41ae2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:33:12.530103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 596/1155] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:33:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:33:12.554683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee5731-805f-4480-a349-1a2218dc54a6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:12.649254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee5731-805f-4480-a349-1a2218dc54a6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:12.680510 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b2880-d929-4ff7-b594-25419449d924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:12.681272 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b2880-d929-4ff7-b594-25419449d924 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:12.681550 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b2880-d929-4ff7-b594-25419449d924 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:12.681816 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b2880-d929-4ff7-b594-25419449d924 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:12.691643 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b2880-d929-4ff7-b594-25419449d924 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:33:12.699259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-220b2880-d929-4ff7-b594-25419449d924 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:33:12.699259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:33:12.699259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:33:12.699259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:33:12.699259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:33:12.699259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:33:12.699259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:33:12.699259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:33:12.699259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:33:12.699259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:33:12.699259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:33:12.699259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:33:12.699259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:33:12.699259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:33:12.699259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:33:12.699259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:33:12.700479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:33:12.700479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:33:12.700479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:33:12.700479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:33:12.700479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:33:12.700479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:33:12.700479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:33:12.700479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:33:12.700479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:33:12.700479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:33:12.700479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:33:12.700479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:33:12.700479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:33:12.700479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:33:12.700479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:33:12.700479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:33:12.701503 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:33:12.701503 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:33:12.701503 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:33:12.701503 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:33:12.701503 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:33:12.701503 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:33:12.701503 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:33:12.701503 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:33:12.701503 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:33:12.701503 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:33:12.701503 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:33:12.701503 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:33:12.701503 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 560/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:33:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:33:12.706750 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79168fe1-b1ee-4dc6-a2ea-301bc41ae2f4 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:12.798066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79168fe1-b1ee-4dc6-a2ea-301bc41ae2f4 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:12.829288 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4631847-13c1-4965-af06-6c6678b44d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:12.830510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4631847-13c1-4965-af06-6c6678b44d03 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:12.830786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4631847-13c1-4965-af06-6c6678b44d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:12.831051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4631847-13c1-4965-af06-6c6678b44d03 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:12.831816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4631847-13c1-4965-af06-6c6678b44d03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:33:12.832119 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4631847-13c1-4965-af06-6c6678b44d03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:12.833451 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4631847-13c1-4965-af06-6c6678b44d03 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:12.841049 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 597/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:33:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:12.846780 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b2880-d929-4ff7-b594-25419449d924 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:12.939852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b2880-d929-4ff7-b594-25419449d924 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:12.972091 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e4cd7-8ce3-4083-9a14-fb4c5f6ef354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:12.972884 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e4cd7-8ce3-4083-9a14-fb4c5f6ef354 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:12.973160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e4cd7-8ce3-4083-9a14-fb4c5f6ef354 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:12.973426 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e4cd7-8ce3-4083-9a14-fb4c5f6ef354 None admin] PATH_INFO: `/v3/users/3296c0fb7fd84b44b12fd1ff6d0e0dcf` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:12.974603 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e4cd7-8ce3-4083-9a14-fb4c5f6ef354 None admin] RBAC: Authorizing `identity:get_user(user_id=3296c0fb7fd84b44b12fd1ff6d0e0dcf)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:12.976055 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e4cd7-8ce3-4083-9a14-fb4c5f6ef354 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:12.977649 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 561/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:33:12 2022] GET /identity/v3/users/3296c0fb7fd84b44b12fd1ff6d0e0dcf => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:12.983165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4631847-13c1-4965-af06-6c6678b44d03 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:13.076259 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4631847-13c1-4965-af06-6c6678b44d03 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:13.107167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8f2f0-c07b-459f-9da7-9d2076025898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:13.107838 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8f2f0-c07b-459f-9da7-9d2076025898 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:13.108121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8f2f0-c07b-459f-9da7-9d2076025898 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:13.108394 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8f2f0-c07b-459f-9da7-9d2076025898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:13.171216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8f2f0-c07b-459f-9da7-9d2076025898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:13.172673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8f2f0-c07b-459f-9da7-9d2076025898 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:13.262420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 598/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:33:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 06:33:13.268611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e4cd7-8ce3-4083-9a14-fb4c5f6ef354 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:13.360765 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e4cd7-8ce3-4083-9a14-fb4c5f6ef354 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:13.391679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2ec17-5a75-43d7-9c31-5782f2066132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:13.393075 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2ec17-5a75-43d7-9c31-5782f2066132 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:13.393356 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2ec17-5a75-43d7-9c31-5782f2066132 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:13.393627 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2ec17-5a75-43d7-9c31-5782f2066132 None admin] PATH_INFO: `/v3/projects/ea4b8fa8987843ba9ff41de6b4652a99` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:13.394789 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2ec17-5a75-43d7-9c31-5782f2066132 None admin] RBAC: Authorizing `identity:get_project(project_id=ea4b8fa8987843ba9ff41de6b4652a99)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:13.396253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2ec17-5a75-43d7-9c31-5782f2066132 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:13.397909 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 562/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:33:13 2022] GET /identity/v3/projects/ea4b8fa8987843ba9ff41de6b4652a99 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:13.403785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8f2f0-c07b-459f-9da7-9d2076025898 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:13.494877 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8f2f0-c07b-459f-9da7-9d2076025898 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:13.526627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b2657-da1b-4813-be65-195fdeb98ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:13.527209 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b2657-da1b-4813-be65-195fdeb98ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:13.527485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b2657-da1b-4813-be65-195fdeb98ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:13.527783 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b2657-da1b-4813-be65-195fdeb98ec8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:13.528610 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b2657-da1b-4813-be65-195fdeb98ec8 None admin] RBAC: Adding query filter params (role.id=5e6a73052f3b4ee7829ecb858925e5ca, scope.project.id=ea4b8fa8987843ba9ff41de6b4652a99, user.id=3296c0fb7fd84b44b12fd1ff6d0e0dcf) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:33:13.528915 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b2657-da1b-4813-be65-195fdeb98ec8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:13.530307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b2657-da1b-4813-be65-195fdeb98ec8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:13.536341 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 599/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:33:13 2022] GET /identity/v3/role_assignments?user.id=3296c0fb7fd84b44b12fd1ff6d0e0dcf&scope.project.id=ea4b8fa8987843ba9ff41de6b4652a99&role.id=5e6a73052f3b4ee7829ecb858925e5ca => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:15.723094 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398fb1a-e986-464f-be4b-1e7fa2bc520f None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:15.723650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398fb1a-e986-464f-be4b-1e7fa2bc520f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:15.723650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398fb1a-e986-464f-be4b-1e7fa2bc520f None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:15.725038 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 563/1162] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:33:15.730110 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a3f72-addd-4116-b44e-63faf9466669 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:15.730519 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a3f72-addd-4116-b44e-63faf9466669 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:15.730664 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a3f72-addd-4116-b44e-63faf9466669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:15.746667 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-bd3a3f72-addd-4116-b44e-63faf9466669 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:33:15.747869 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-bd3a3f72-addd-4116-b44e-63faf9466669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:33:15.810152 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 600/1163] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:33:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:33:15.833225 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398fb1a-e986-464f-be4b-1e7fa2bc520f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:15.930697 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398fb1a-e986-464f-be4b-1e7fa2bc520f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:15.963705 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48580a87-3948-4091-a1a2-0df00c484ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:15.964355 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48580a87-3948-4091-a1a2-0df00c484ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:15.964635 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48580a87-3948-4091-a1a2-0df00c484ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:15.964907 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48580a87-3948-4091-a1a2-0df00c484ef0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:16.033502 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48580a87-3948-4091-a1a2-0df00c484ef0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:16.034946 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48580a87-3948-4091-a1a2-0df00c484ef0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:16.127087 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 564/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:33:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 06:33:16.133021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a3f72-addd-4116-b44e-63faf9466669 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:16.224108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a3f72-addd-4116-b44e-63faf9466669 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:16.255265 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c988a3-eb15-46c1-af3e-51dea9c6d51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:16.256030 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c988a3-eb15-46c1-af3e-51dea9c6d51b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:16.256310 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c988a3-eb15-46c1-af3e-51dea9c6d51b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:16.256576 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c988a3-eb15-46c1-af3e-51dea9c6d51b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:16.262983 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c988a3-eb15-46c1-af3e-51dea9c6d51b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:16.264447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c988a3-eb15-46c1-af3e-51dea9c6d51b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:16.278754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-a3c988a3-eb15-46c1-af3e-51dea9c6d51b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 12 06:33:16.278754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:33:16.278754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 12 06:33:16.278754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 12 06:33:16.278754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:33:16.278754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:33:16.278754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:33:16.278754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:33:16.278754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 12 06:33:16.278754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:33:16.278754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:33:16.278754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:33:16.278754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:33:16.278754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:33:16.278754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:33:16.278754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:33:16.278754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:33:16.279982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:33:16.279982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:33:16.279982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:33:16.279982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:33:16.279982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:33:16.279982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:33:16.279982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:33:16.279982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:33:16.279982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:33:16.279982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:33:16.279982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:33:16.279982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:33:16.279982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:33:16.279982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:33:16.279982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:33:16.279982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:33:16.281279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:33:16.281279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:33:16.281279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:33:16.281279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:33:16.281279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:33:16.281279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:33:16.281279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:33:16.281279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:33:16.281279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:33:16.281279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:33:16.281279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 12 06:33:16.281279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:33:16.281279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 12 06:33:16.281279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:33:16.281279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 601/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Thu May 12 06:33:16 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:33:16.286289 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48580a87-3948-4091-a1a2-0df00c484ef0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:16.379334 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48580a87-3948-4091-a1a2-0df00c484ef0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:16.411996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9f18c-8e1f-4f12-b2e7-8f2387e64a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:16.412641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9f18c-8e1f-4f12-b2e7-8f2387e64a86 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:16.412924 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9f18c-8e1f-4f12-b2e7-8f2387e64a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:16.413445 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9f18c-8e1f-4f12-b2e7-8f2387e64a86 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:16.414170 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9f18c-8e1f-4f12-b2e7-8f2387e64a86 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:33:16.414475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9f18c-8e1f-4f12-b2e7-8f2387e64a86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:16.415865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9f18c-8e1f-4f12-b2e7-8f2387e64a86 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:16.422720 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 565/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Thu May 12 06:33:16 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:18.575954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8270e-1a22-4ad5-995a-7c2ffc0d1bd7 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:18.576479 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8270e-1a22-4ad5-995a-7c2ffc0d1bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:18.576479 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8270e-1a22-4ad5-995a-7c2ffc0d1bd7 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:18.577847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 602/1167] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:33:18.583461 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acfc64-4d6a-487b-ab1d-2a210d471379 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:18.583877 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acfc64-4d6a-487b-ab1d-2a210d471379 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:18.584040 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acfc64-4d6a-487b-ab1d-2a210d471379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:18.602011 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-21acfc64-4d6a-487b-ab1d-2a210d471379 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:33:18.602527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-21acfc64-4d6a-487b-ab1d-2a210d471379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:33:18.664698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 566/1168] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:33:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 06:33:18.686374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8270e-1a22-4ad5-995a-7c2ffc0d1bd7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:18.781851 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8270e-1a22-4ad5-995a-7c2ffc0d1bd7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:18.814209 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6b408-2bf7-4bf0-a9f8-8fefc6665d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:18.814845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6b408-2bf7-4bf0-a9f8-8fefc6665d04 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:18.815120 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6b408-2bf7-4bf0-a9f8-8fefc6665d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:18.815383 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6b408-2bf7-4bf0-a9f8-8fefc6665d04 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:18.816140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6b408-2bf7-4bf0-a9f8-8fefc6665d04 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:18.817472 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6b408-2bf7-4bf0-a9f8-8fefc6665d04 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:18.898154 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 603/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Thu May 12 06:33:18 2022] POST /identity/v3/domains => generated 267 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:33:21.113566 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1977e-2df7-4f41-a82a-21e2ec7a1466 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:21.114058 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1977e-2df7-4f41-a82a-21e2ec7a1466 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:21.114175 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1977e-2df7-4f41-a82a-21e2ec7a1466 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:21.115477 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 567/1170] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:33:21.124746 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571508ea-da24-4af6-ab71-b3be0c16e7cc None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:21.125156 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571508ea-da24-4af6-ab71-b3be0c16e7cc None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:21.125297 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571508ea-da24-4af6-ab71-b3be0c16e7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:21.142893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-571508ea-da24-4af6-ab71-b3be0c16e7cc None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:33:21.144095 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-571508ea-da24-4af6-ab71-b3be0c16e7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:33:21.206922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 604/1171] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:33:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:33:21.229555 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1977e-2df7-4f41-a82a-21e2ec7a1466 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:21.324639 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1977e-2df7-4f41-a82a-21e2ec7a1466 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:21.356417 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60034189-8703-45e0-8edb-9d4741015907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:21.357251 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60034189-8703-45e0-8edb-9d4741015907 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:21.357534 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60034189-8703-45e0-8edb-9d4741015907 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:21.357808 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60034189-8703-45e0-8edb-9d4741015907 None admin] PATH_INFO: `/v3/domains/c511f9bb190c41de85bb1a9749b8c5a9` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:21.368256 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60034189-8703-45e0-8edb-9d4741015907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c511f9bb190c41de85bb1a9749b8c5a9)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:21.369684 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60034189-8703-45e0-8edb-9d4741015907 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:21.371290 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 568/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Thu May 12 06:33:21 2022] GET /identity/v3/domains/c511f9bb190c41de85bb1a9749b8c5a9 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:21.377431 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571508ea-da24-4af6-ab71-b3be0c16e7cc None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:21.468274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571508ea-da24-4af6-ab71-b3be0c16e7cc None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:21.499826 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4a500-80b4-4b74-8f9c-912fc2e6d83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:21.500466 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4a500-80b4-4b74-8f9c-912fc2e6d83b None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:21.501364 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4a500-80b4-4b74-8f9c-912fc2e6d83b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:21.501636 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4a500-80b4-4b74-8f9c-912fc2e6d83b None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:21.502344 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b4a500-80b4-4b74-8f9c-912fc2e6d83b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:21.503745 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b4a500-80b4-4b74-8f9c-912fc2e6d83b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:21.613092 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 605/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 12 06:33:21 2022] POST /identity/v3/projects => generated 361 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:33:23.823279 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c94f4b-3688-4f80-8f59-5ba8d5c8ceb6 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:23.823830 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c94f4b-3688-4f80-8f59-5ba8d5c8ceb6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:23.823921 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c94f4b-3688-4f80-8f59-5ba8d5c8ceb6 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:23.825244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 569/1174] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:33:23.831049 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ba4f3-9ed7-45fd-85b1-5e485bcbd1b5 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:23.831454 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ba4f3-9ed7-45fd-85b1-5e485bcbd1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:23.831609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ba4f3-9ed7-45fd-85b1-5e485bcbd1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:23.848317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-cf0ba4f3-9ed7-45fd-85b1-5e485bcbd1b5 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:33:23.849491 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-cf0ba4f3-9ed7-45fd-85b1-5e485bcbd1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:33:23.911270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 606/1175] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:33:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:33:23.935248 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c94f4b-3688-4f80-8f59-5ba8d5c8ceb6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:24.031539 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c94f4b-3688-4f80-8f59-5ba8d5c8ceb6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:24.062415 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ef312-babe-4ec9-9ebb-742b74fc7653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:24.063810 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ef312-babe-4ec9-9ebb-742b74fc7653 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:24.064090 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ef312-babe-4ec9-9ebb-742b74fc7653 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:24.064359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ef312-babe-4ec9-9ebb-742b74fc7653 None admin] PATH_INFO: `/v3/domains/c511f9bb190c41de85bb1a9749b8c5a9` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:24.065521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ef312-babe-4ec9-9ebb-742b74fc7653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c511f9bb190c41de85bb1a9749b8c5a9)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:24.066930 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ef312-babe-4ec9-9ebb-742b74fc7653 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:24.068709 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 570/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Thu May 12 06:33:23 2022] GET /identity/v3/domains/c511f9bb190c41de85bb1a9749b8c5a9 => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:24.074351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ba4f3-9ed7-45fd-85b1-5e485bcbd1b5 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:24.164850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ba4f3-9ed7-45fd-85b1-5e485bcbd1b5 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:24.196101 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943944f9-2d0f-4bec-bb34-7f4bde96ba1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:24.196748 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943944f9-2d0f-4bec-bb34-7f4bde96ba1b None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:24.197029 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943944f9-2d0f-4bec-bb34-7f4bde96ba1b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:24.197300 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943944f9-2d0f-4bec-bb34-7f4bde96ba1b None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:24.198012 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943944f9-2d0f-4bec-bb34-7f4bde96ba1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:24.199413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943944f9-2d0f-4bec-bb34-7f4bde96ba1b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:24.285451 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 607/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 12 06:33:24 2022] POST /identity/v3/users => generated 311 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:33:26.485548 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138b79a-2123-43dd-8e7a-4234d938eed9 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:26.486101 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138b79a-2123-43dd-8e7a-4234d938eed9 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:26.486101 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138b79a-2123-43dd-8e7a-4234d938eed9 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:26.487428 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 571/1178] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:33:26.492645 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e4add-3521-4724-98a9-acafb49502dd None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:26.493059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e4add-3521-4724-98a9-acafb49502dd None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:26.493192 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e4add-3521-4724-98a9-acafb49502dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:26.509675 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-916e4add-3521-4724-98a9-acafb49502dd None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:33:26.510832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-916e4add-3521-4724-98a9-acafb49502dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:33:26.572277 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 608/1179] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:33:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:33:26.595004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138b79a-2123-43dd-8e7a-4234d938eed9 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:26.693195 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138b79a-2123-43dd-8e7a-4234d938eed9 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:26.724984 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e4904-1e61-476d-8c29-b84d784a9057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:26.725758 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e4904-1e61-476d-8c29-b84d784a9057 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:26.726036 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e4904-1e61-476d-8c29-b84d784a9057 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:26.726303 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e4904-1e61-476d-8c29-b84d784a9057 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:26.736277 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e4904-1e61-476d-8c29-b84d784a9057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:33:26.743723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-479e4904-1e61-476d-8c29-b84d784a9057 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:33:26.743723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:33:26.743723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:33:26.743723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:33:26.743723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:33:26.743723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:33:26.743723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:33:26.743723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:33:26.743723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:33:26.743723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:33:26.743723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:33:26.743723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:33:26.743723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:33:26.743723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:33:26.743723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:33:26.743723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:33:26.744832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:33:26.744832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:33:26.744832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:33:26.744832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:33:26.744832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:33:26.744832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:33:26.744832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:33:26.744832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:33:26.744832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:33:26.744832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:33:26.744832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:33:26.744832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:33:26.744832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:33:26.744832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:33:26.744832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:33:26.744832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:33:26.745902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:33:26.745902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:33:26.745902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:33:26.745902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:33:26.745902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:33:26.745902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:33:26.745902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:33:26.745902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:33:26.745902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:33:26.745902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:33:26.745902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:33:26.745902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:33:26.745902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 572/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:33:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:33:26.751182 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e4add-3521-4724-98a9-acafb49502dd None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:26.841674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e4add-3521-4724-98a9-acafb49502dd None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:26.872707 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa18ed-9483-4382-9c74-1fdfb52358d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:26.873353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa18ed-9483-4382-9c74-1fdfb52358d3 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:26.873630 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa18ed-9483-4382-9c74-1fdfb52358d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:26.873897 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa18ed-9483-4382-9c74-1fdfb52358d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:26.874660 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa18ed-9483-4382-9c74-1fdfb52358d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:33:26.874959 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa18ed-9483-4382-9c74-1fdfb52358d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:26.876404 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa18ed-9483-4382-9c74-1fdfb52358d3 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:26.883928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 609/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:33:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:26.889432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e4904-1e61-476d-8c29-b84d784a9057 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:26.982741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e4904-1e61-476d-8c29-b84d784a9057 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:27.014814 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2c0c4-140f-4701-8cc6-391c70b8638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:27.015808 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2c0c4-140f-4701-8cc6-391c70b8638a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:27.016675 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2c0c4-140f-4701-8cc6-391c70b8638a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:27.016944 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2c0c4-140f-4701-8cc6-391c70b8638a None admin] PATH_INFO: `/v3/users/bd6a78917bfd4cbc951b56c8ba724cc8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:27.029347 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2c0c4-140f-4701-8cc6-391c70b8638a None admin] RBAC: Authorizing `identity:get_user(user_id=bd6a78917bfd4cbc951b56c8ba724cc8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:27.030763 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2c0c4-140f-4701-8cc6-391c70b8638a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:27.032464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 573/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:33:26 2022] GET /identity/v3/users/bd6a78917bfd4cbc951b56c8ba724cc8 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:27.038466 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa18ed-9483-4382-9c74-1fdfb52358d3 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:27.130802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa18ed-9483-4382-9c74-1fdfb52358d3 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:27.163773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfce37d-1ee2-44b3-8547-b526d007af98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:27.164402 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfce37d-1ee2-44b3-8547-b526d007af98 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:27.164679 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfce37d-1ee2-44b3-8547-b526d007af98 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:27.164947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfce37d-1ee2-44b3-8547-b526d007af98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:27.226154 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfce37d-1ee2-44b3-8547-b526d007af98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:27.227571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfce37d-1ee2-44b3-8547-b526d007af98 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:27.316843 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 610/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:33:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 06:33:27.322767 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2c0c4-140f-4701-8cc6-391c70b8638a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:27.415229 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2c0c4-140f-4701-8cc6-391c70b8638a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:27.446701 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1a1de-92b5-46ea-af64-cc6a8761e557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:27.447527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1a1de-92b5-46ea-af64-cc6a8761e557 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:27.447853 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1a1de-92b5-46ea-af64-cc6a8761e557 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:27.448127 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1a1de-92b5-46ea-af64-cc6a8761e557 None admin] PATH_INFO: `/v3/projects/e9d35a26afb54d5b98d6203635d4c6a3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:27.449287 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1a1de-92b5-46ea-af64-cc6a8761e557 None admin] RBAC: Authorizing `identity:get_project(project_id=e9d35a26afb54d5b98d6203635d4c6a3)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:27.450685 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1a1de-92b5-46ea-af64-cc6a8761e557 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:27.452345 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 574/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:33:27 2022] GET /identity/v3/projects/e9d35a26afb54d5b98d6203635d4c6a3 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:27.458773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfce37d-1ee2-44b3-8547-b526d007af98 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:27.551140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfce37d-1ee2-44b3-8547-b526d007af98 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:27.582937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988daf6-3c53-4845-a65a-6b066a1029b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:27.583527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988daf6-3c53-4845-a65a-6b066a1029b7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:27.583847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988daf6-3c53-4845-a65a-6b066a1029b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:27.584122 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988daf6-3c53-4845-a65a-6b066a1029b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:27.584949 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988daf6-3c53-4845-a65a-6b066a1029b7 None admin] RBAC: Adding query filter params (role.id=5e6a73052f3b4ee7829ecb858925e5ca, scope.project.id=e9d35a26afb54d5b98d6203635d4c6a3, user.id=bd6a78917bfd4cbc951b56c8ba724cc8) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:33:27.585258 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988daf6-3c53-4845-a65a-6b066a1029b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:27.586666 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988daf6-3c53-4845-a65a-6b066a1029b7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:27.591891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 611/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:33:27 2022] GET /identity/v3/role_assignments?user.id=bd6a78917bfd4cbc951b56c8ba724cc8&scope.project.id=e9d35a26afb54d5b98d6203635d4c6a3&role.id=5e6a73052f3b4ee7829ecb858925e5ca => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:29.732061 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b42e2-cf84-4c93-8fbd-1d09c6a7451c None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:29.732627 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b42e2-cf84-4c93-8fbd-1d09c6a7451c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:29.732627 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b42e2-cf84-4c93-8fbd-1d09c6a7451c None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:29.733955 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 575/1186] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:33:29.739515 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d58b5-ceaa-4781-945a-dcd467aa7187 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:29.739979 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d58b5-ceaa-4781-945a-dcd467aa7187 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:29.740098 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d58b5-ceaa-4781-945a-dcd467aa7187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:29.756816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-a47d58b5-ceaa-4781-945a-dcd467aa7187 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:33:29.757983 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a47d58b5-ceaa-4781-945a-dcd467aa7187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:33:29.820521 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 612/1187] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:33:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:33:29.842569 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b42e2-cf84-4c93-8fbd-1d09c6a7451c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:29.938629 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b42e2-cf84-4c93-8fbd-1d09c6a7451c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:29.970861 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b704b-4ab3-4ac2-85bf-b0d6474dc712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:29.971643 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b704b-4ab3-4ac2-85bf-b0d6474dc712 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:29.971956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b704b-4ab3-4ac2-85bf-b0d6474dc712 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:29.972228 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b704b-4ab3-4ac2-85bf-b0d6474dc712 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:29.981939 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b704b-4ab3-4ac2-85bf-b0d6474dc712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:33:29.990257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-c77b704b-4ab3-4ac2-85bf-b0d6474dc712 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:33:29.990257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:33:29.990257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:33:29.990257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:33:29.990257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:33:29.990257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:33:29.990257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:33:29.990257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:33:29.990257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:33:29.990257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:33:29.990257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:33:29.990257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:33:29.990257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:33:29.990257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:33:29.990257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:33:29.990257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:33:29.991441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:33:29.991441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:33:29.991441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:33:29.991441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:33:29.991441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:33:29.991441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:33:29.991441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:33:29.991441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:33:29.991441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:33:29.991441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:33:29.991441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:33:29.991441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:33:29.991441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:33:29.991441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:33:29.991441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:33:29.991441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:33:29.992424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:33:29.992424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:33:29.992424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:33:29.992424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:33:29.992424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:33:29.992424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:33:29.992424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:33:29.992424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:33:29.992424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:33:29.992424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:33:29.992424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:33:29.992424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:33:29.992424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 576/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:33:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:33:29.997247 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d58b5-ceaa-4781-945a-dcd467aa7187 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:30.087896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d58b5-ceaa-4781-945a-dcd467aa7187 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:30.119521 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82125c0f-1688-47a9-98e6-5339290b1297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:30.120196 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82125c0f-1688-47a9-98e6-5339290b1297 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:30.120476 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82125c0f-1688-47a9-98e6-5339290b1297 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:30.120745 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82125c0f-1688-47a9-98e6-5339290b1297 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:30.121478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82125c0f-1688-47a9-98e6-5339290b1297 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:33:30.121777 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82125c0f-1688-47a9-98e6-5339290b1297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:30.123116 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82125c0f-1688-47a9-98e6-5339290b1297 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:30.130587 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 613/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:33:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:30.136255 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b704b-4ab3-4ac2-85bf-b0d6474dc712 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:30.230439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b704b-4ab3-4ac2-85bf-b0d6474dc712 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:30.261788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b20431-3e9e-4dd7-a8b5-62b5a325bfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:30.262631 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b20431-3e9e-4dd7-a8b5-62b5a325bfb7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:30.262915 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b20431-3e9e-4dd7-a8b5-62b5a325bfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:30.263191 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b20431-3e9e-4dd7-a8b5-62b5a325bfb7 None admin] PATH_INFO: `/v3/users/bd6a78917bfd4cbc951b56c8ba724cc8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:30.264397 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b20431-3e9e-4dd7-a8b5-62b5a325bfb7 None admin] RBAC: Authorizing `identity:get_user(user_id=bd6a78917bfd4cbc951b56c8ba724cc8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:30.265847 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b20431-3e9e-4dd7-a8b5-62b5a325bfb7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:30.267442 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 577/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:33:30 2022] GET /identity/v3/users/bd6a78917bfd4cbc951b56c8ba724cc8 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:30.272864 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82125c0f-1688-47a9-98e6-5339290b1297 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:30.365376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82125c0f-1688-47a9-98e6-5339290b1297 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:30.395907 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825123c-4de0-46d6-9c43-f803b64207a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:30.396736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825123c-4de0-46d6-9c43-f803b64207a5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:30.397010 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825123c-4de0-46d6-9c43-f803b64207a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:30.397273 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825123c-4de0-46d6-9c43-f803b64207a5 None admin] PATH_INFO: `/v3/projects/e9d35a26afb54d5b98d6203635d4c6a3` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:30.398423 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825123c-4de0-46d6-9c43-f803b64207a5 None admin] RBAC: Authorizing `identity:get_project(project_id=e9d35a26afb54d5b98d6203635d4c6a3)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:30.399852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825123c-4de0-46d6-9c43-f803b64207a5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:30.401493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 614/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:33:30 2022] GET /identity/v3/projects/e9d35a26afb54d5b98d6203635d4c6a3 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:30.407583 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b20431-3e9e-4dd7-a8b5-62b5a325bfb7 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:30.502333 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b20431-3e9e-4dd7-a8b5-62b5a325bfb7 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:30.534127 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2058201-102e-4e4d-87a8-2a440335f870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:30.534930 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2058201-102e-4e4d-87a8-2a440335f870 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:30.535218 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2058201-102e-4e4d-87a8-2a440335f870 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:30.535493 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2058201-102e-4e4d-87a8-2a440335f870 None admin] PATH_INFO: `/v3/projects/e9d35a26afb54d5b98d6203635d4c6a3/users/bd6a78917bfd4cbc951b56c8ba724cc8/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:30.537464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2058201-102e-4e4d-87a8-2a440335f870 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9d35a26afb54d5b98d6203635d4c6a3, user_id=bd6a78917bfd4cbc951b56c8ba724cc8, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:30.539128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2058201-102e-4e4d-87a8-2a440335f870 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:30.614974 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 578/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:33:30 2022] PUT /identity/v3/projects/e9d35a26afb54d5b98d6203635d4c6a3/users/bd6a78917bfd4cbc951b56c8ba724cc8/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:33:32.760111 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74609e25-200c-46f8-88be-c69d5bfa9c2c None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:32.760683 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74609e25-200c-46f8-88be-c69d5bfa9c2c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:32.760683 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74609e25-200c-46f8-88be-c69d5bfa9c2c None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:32.762012 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 615/1193] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:33:32.767143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffe12e-320e-4187-889f-8e5fe9e77f64 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:32.767548 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffe12e-320e-4187-889f-8e5fe9e77f64 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:32.767714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffe12e-320e-4187-889f-8e5fe9e77f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:32.783856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-04ffe12e-320e-4187-889f-8e5fe9e77f64 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:33:32.785026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-04ffe12e-320e-4187-889f-8e5fe9e77f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:33:32.847985 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 579/1194] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:33:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:33:32.871533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74609e25-200c-46f8-88be-c69d5bfa9c2c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:32.967900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74609e25-200c-46f8-88be-c69d5bfa9c2c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:33.000082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9131e-7a97-4a7b-9724-bae5862031af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:33.000873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9131e-7a97-4a7b-9724-bae5862031af None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:33.001155 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9131e-7a97-4a7b-9724-bae5862031af None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:33.001431 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9131e-7a97-4a7b-9724-bae5862031af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:33.011632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9131e-7a97-4a7b-9724-bae5862031af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:33:33.019301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-4eb9131e-7a97-4a7b-9724-bae5862031af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:33:33.019301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:33:33.019301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:33:33.019301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:33:33.019301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:33:33.019301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:33:33.019301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:33:33.019301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:33:33.019301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:33:33.019301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:33:33.019301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:33:33.019301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:33:33.019301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:33:33.019301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:33:33.019301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:33:33.019301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:33:33.020442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:33:33.020442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:33:33.020442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:33:33.020442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:33:33.020442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:33:33.020442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:33:33.020442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:33:33.020442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:33:33.020442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:33:33.020442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:33:33.020442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:33:33.020442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:33:33.020442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:33:33.020442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:33:33.020442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:33:33.020442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:33:33.021485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:33:33.021485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:33:33.021485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:33:33.021485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:33:33.021485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:33:33.021485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:33:33.021485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:33:33.021485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:33:33.021485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:33:33.021485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:33:33.021485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:33:33.021485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:33:33.021485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 616/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:33:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:33:33.026522 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffe12e-320e-4187-889f-8e5fe9e77f64 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:33.117914 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffe12e-320e-4187-889f-8e5fe9e77f64 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:33.148622 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd9284-48de-4d02-8377-703f7c11596f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:33.149268 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd9284-48de-4d02-8377-703f7c11596f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:33.149543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd9284-48de-4d02-8377-703f7c11596f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:33.149809 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd9284-48de-4d02-8377-703f7c11596f None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:33.150544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd9284-48de-4d02-8377-703f7c11596f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:33:33.150841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd9284-48de-4d02-8377-703f7c11596f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:33.152225 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd9284-48de-4d02-8377-703f7c11596f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:33.160309 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 580/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:33:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:33.166207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9131e-7a97-4a7b-9724-bae5862031af None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:33.257783 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9131e-7a97-4a7b-9724-bae5862031af None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:33.289232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12923592-1177-4a62-8446-6b4fd5166ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:33.290017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12923592-1177-4a62-8446-6b4fd5166ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:33.290290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12923592-1177-4a62-8446-6b4fd5166ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:33.290562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12923592-1177-4a62-8446-6b4fd5166ac4 None admin] PATH_INFO: `/v3/users/bd6a78917bfd4cbc951b56c8ba724cc8` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:33.291866 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12923592-1177-4a62-8446-6b4fd5166ac4 None admin] RBAC: Authorizing `identity:get_user(user_id=bd6a78917bfd4cbc951b56c8ba724cc8)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:33.293659 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12923592-1177-4a62-8446-6b4fd5166ac4 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:33.295238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 617/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 12 06:33:33 2022] GET /identity/v3/users/bd6a78917bfd4cbc951b56c8ba724cc8 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:33.300859 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd9284-48de-4d02-8377-703f7c11596f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:33.394714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd9284-48de-4d02-8377-703f7c11596f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:33.426215 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834cafc-496a-4507-bff0-38393ddf283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:33.426841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834cafc-496a-4507-bff0-38393ddf283f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:33.427121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834cafc-496a-4507-bff0-38393ddf283f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:33.427395 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834cafc-496a-4507-bff0-38393ddf283f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:33.491538 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834cafc-496a-4507-bff0-38393ddf283f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:33.493000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834cafc-496a-4507-bff0-38393ddf283f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:33.589460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 581/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:33:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 06:33:33.595165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12923592-1177-4a62-8446-6b4fd5166ac4 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:33.686243 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12923592-1177-4a62-8446-6b4fd5166ac4 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:33.717040 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df15d8-59a3-4b3d-8839-3918e94fe8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:33.717877 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df15d8-59a3-4b3d-8839-3918e94fe8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:33.718155 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df15d8-59a3-4b3d-8839-3918e94fe8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:33.718425 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df15d8-59a3-4b3d-8839-3918e94fe8b7 None admin] PATH_INFO: `/v3/projects/e9d35a26afb54d5b98d6203635d4c6a3` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:33.720182 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df15d8-59a3-4b3d-8839-3918e94fe8b7 None admin] RBAC: Authorizing `identity:get_project(project_id=e9d35a26afb54d5b98d6203635d4c6a3)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:33.721574 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df15d8-59a3-4b3d-8839-3918e94fe8b7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:33.723205 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 618/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 12 06:33:33 2022] GET /identity/v3/projects/e9d35a26afb54d5b98d6203635d4c6a3 => generated 361 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:33:33.729137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834cafc-496a-4507-bff0-38393ddf283f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:33:33.822664 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834cafc-496a-4507-bff0-38393ddf283f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:33:33.855572 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aab4fd-6152-4870-9614-b6eafaf5b93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:33:33.856178 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aab4fd-6152-4870-9614-b6eafaf5b93e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:33:33.856454 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aab4fd-6152-4870-9614-b6eafaf5b93e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:33:33.856720 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aab4fd-6152-4870-9614-b6eafaf5b93e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:33:33.857541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aab4fd-6152-4870-9614-b6eafaf5b93e None admin] RBAC: Adding query filter params (role.id=5e6a73052f3b4ee7829ecb858925e5ca, scope.project.id=e9d35a26afb54d5b98d6203635d4c6a3, user.id=bd6a78917bfd4cbc951b56c8ba724cc8) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:33:33.857843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aab4fd-6152-4870-9614-b6eafaf5b93e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:33:33.859256 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aab4fd-6152-4870-9614-b6eafaf5b93e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:33:33.864764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 582/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:33:33 2022] GET /identity/v3/role_assignments?user.id=bd6a78917bfd4cbc951b56c8ba724cc8&scope.project.id=e9d35a26afb54d5b98d6203635d4c6a3&role.id=5e6a73052f3b4ee7829ecb858925e5ca => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:34:54.324359 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb939b-862c-4fb8-8c03-b52bd21cefd6 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:34:54.324940 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb939b-862c-4fb8-8c03-b52bd21cefd6 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:34:54.324940 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb939b-862c-4fb8-8c03-b52bd21cefd6 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:34:54.326258 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 619/1201] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:34:54.331353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fca11f-ad03-4a61-ada6-d4910da93313 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:34:54.331796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fca11f-ad03-4a61-ada6-d4910da93313 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:34:54.331945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fca11f-ad03-4a61-ada6-d4910da93313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:34:54.348599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f4fca11f-ad03-4a61-ada6-d4910da93313 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:34:54.349803 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f4fca11f-ad03-4a61-ada6-d4910da93313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:34:54.413294 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 583/1202] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:34:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:34:54.438675 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb939b-862c-4fb8-8c03-b52bd21cefd6 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:34:54.533110 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb939b-862c-4fb8-8c03-b52bd21cefd6 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:34:54.565496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c7394-7a81-4898-9382-07e5da436a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:34:54.566267 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c7394-7a81-4898-9382-07e5da436a5e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:34:54.566639 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c7394-7a81-4898-9382-07e5da436a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:34:54.566910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c7394-7a81-4898-9382-07e5da436a5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:34:54.576962 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c7394-7a81-4898-9382-07e5da436a5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:34:54.578368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c7394-7a81-4898-9382-07e5da436a5e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:34:54.595853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-457c7394-7a81-4898-9382-07e5da436a5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:34:54.595853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:34:54.595853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:34:54.595853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:34:54.595853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:34:54.595853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:34:54.595853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:34:54.595853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:34:54.595853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:34:54.595853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:34:54.595853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:34:54.595853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:34:54.595853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:34:54.595853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:34:54.595853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:34:54.597003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:34:54.597003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:34:54.597003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:34:54.597003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:34:54.597003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:34:54.597003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:34:54.597003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:34:54.597003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:34:54.597003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:34:54.597003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:34:54.597003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:34:54.597003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:34:54.597003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:34:54.597003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:34:54.597003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:34:54.597003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:34:54.597003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:34:54.598180 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:34:54.598180 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:34:54.598180 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:34:54.598180 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:34:54.598180 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 620/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:34:54.603059 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fca11f-ad03-4a61-ada6-d4910da93313 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:34:54.698887 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fca11f-ad03-4a61-ada6-d4910da93313 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:34:54.731329 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3ea87-8684-4399-a8bf-12b7bc0f07e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:34:54.733613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3ea87-8684-4399-a8bf-12b7bc0f07e1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:34:54.733613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3ea87-8684-4399-a8bf-12b7bc0f07e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:34:54.733613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3ea87-8684-4399-a8bf-12b7bc0f07e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:34:54.733932 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3ea87-8684-4399-a8bf-12b7bc0f07e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:34:54.734232 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3ea87-8684-4399-a8bf-12b7bc0f07e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:34:54.735574 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3ea87-8684-4399-a8bf-12b7bc0f07e1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:34:54.746272 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 584/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:34:54.751991 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c7394-7a81-4898-9382-07e5da436a5e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:34:54.850400 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c7394-7a81-4898-9382-07e5da436a5e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:34:54.882306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd5f6b-2b13-4bac-84b3-7d6620b72bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:34:54.882971 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd5f6b-2b13-4bac-84b3-7d6620b72bc6 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:34:54.883252 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd5f6b-2b13-4bac-84b3-7d6620b72bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:34:54.883522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd5f6b-2b13-4bac-84b3-7d6620b72bc6 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:34:54.884272 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd5f6b-2b13-4bac-84b3-7d6620b72bc6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:34:54.885783 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd5f6b-2b13-4bac-84b3-7d6620b72bc6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:34:54.996913 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 621/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 12 06:34:54 2022] POST /identity/v3/users => generated 251 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:34:57.214646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e9c5a-42df-4513-98c9-ad76232f1c54 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:34:57.215188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e9c5a-42df-4513-98c9-ad76232f1c54 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:34:57.215188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e9c5a-42df-4513-98c9-ad76232f1c54 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:34:57.216599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 585/1206] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:34:57.222506 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5be11-3412-4fb0-92a1-81bdf695372e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:34:57.222924 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5be11-3412-4fb0-92a1-81bdf695372e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:34:57.223062 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5be11-3412-4fb0-92a1-81bdf695372e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:34:57.240944 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-93b5be11-3412-4fb0-92a1-81bdf695372e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:34:57.242130 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-93b5be11-3412-4fb0-92a1-81bdf695372e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:34:57.304566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 622/1207] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:34:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:34:57.327653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e9c5a-42df-4513-98c9-ad76232f1c54 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:34:57.424513 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e9c5a-42df-4513-98c9-ad76232f1c54 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:34:57.455626 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb597901-627f-4316-803d-b01419a9123e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:34:57.456441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb597901-627f-4316-803d-b01419a9123e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:34:57.456719 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb597901-627f-4316-803d-b01419a9123e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:34:57.456987 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb597901-627f-4316-803d-b01419a9123e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:34:57.467551 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb597901-627f-4316-803d-b01419a9123e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:34:57.475082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-fb597901-627f-4316-803d-b01419a9123e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 06:34:57.475082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:34:57.475082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:34:57.475082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:34:57.475082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:34:57.475082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:34:57.475082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:34:57.475082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:34:57.475082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:34:57.475082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:34:57.475082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:34:57.475082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:34:57.475082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:34:57.475082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:34:57.475082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:34:57.475082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:34:57.476271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:34:57.476271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:34:57.476271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:34:57.476271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:34:57.476271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:34:57.476271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:34:57.476271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:34:57.476271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:34:57.476271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:34:57.476271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:34:57.476271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:34:57.476271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:34:57.476271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:34:57.476271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:34:57.476271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:34:57.476271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:34:57.477343 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:34:57.477343 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:34:57.477343 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:34:57.477343 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:34:57.477343 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:34:57.477343 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:34:57.477343 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:34:57.477343 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:34:57.477343 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:34:57.477343 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:34:57.477343 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 06:34:57.477343 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:34:57.477343 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 586/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:34:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:34:57.482599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5be11-3412-4fb0-92a1-81bdf695372e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:34:57.577099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5be11-3412-4fb0-92a1-81bdf695372e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:34:57.608916 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d2306-d887-47de-b9ef-5bed866bc22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:34:57.609572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d2306-d887-47de-b9ef-5bed866bc22b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:34:57.618330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d2306-d887-47de-b9ef-5bed866bc22b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:34:57.618330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d2306-d887-47de-b9ef-5bed866bc22b None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:34:57.618330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d2306-d887-47de-b9ef-5bed866bc22b None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:34:57.618330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d2306-d887-47de-b9ef-5bed866bc22b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:34:57.618330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d2306-d887-47de-b9ef-5bed866bc22b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:34:57.619962 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 623/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 12 06:34:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:34:57.626132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb597901-627f-4316-803d-b01419a9123e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:34:57.720323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb597901-627f-4316-803d-b01419a9123e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:34:57.752390 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295eab6-35ca-45ce-973c-032f3edbae16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:34:57.753164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295eab6-35ca-45ce-973c-032f3edbae16 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:34:57.753451 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295eab6-35ca-45ce-973c-032f3edbae16 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:34:57.753718 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295eab6-35ca-45ce-973c-032f3edbae16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:34:57.763159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295eab6-35ca-45ce-973c-032f3edbae16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:34:57.765220 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295eab6-35ca-45ce-973c-032f3edbae16 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:34:57.781890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-8295eab6-35ca-45ce-973c-032f3edbae16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:34:57.781890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:34:57.781890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:34:57.781890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:34:57.781890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:34:57.781890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:34:57.781890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:34:57.781890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:34:57.781890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:34:57.781890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:34:57.781890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:34:57.781890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:34:57.781890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:34:57.781890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:34:57.781890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:34:57.782942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:34:57.782942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:34:57.782942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:34:57.782942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:34:57.782942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:34:57.782942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:34:57.782942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:34:57.782942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:34:57.782942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:34:57.782942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:34:57.782942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:34:57.782942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:34:57.782942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:34:57.782942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:34:57.782942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:34:57.782942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:34:57.782942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:34:57.783969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:34:57.783969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:34:57.783969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:34:57.783969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:34:57.783969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 587/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:34:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 06:34:57.789038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d2306-d887-47de-b9ef-5bed866bc22b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:34:57.883812 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d2306-d887-47de-b9ef-5bed866bc22b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:34:57.917581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0bdf3-d9d9-4e50-9477-608e098afcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:34:57.918231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0bdf3-d9d9-4e50-9477-608e098afcb1 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:34:57.918508 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0bdf3-d9d9-4e50-9477-608e098afcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:34:57.918773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0bdf3-d9d9-4e50-9477-608e098afcb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:34:57.919480 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0bdf3-d9d9-4e50-9477-608e098afcb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:34:57.919836 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0bdf3-d9d9-4e50-9477-608e098afcb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:34:57.921177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0bdf3-d9d9-4e50-9477-608e098afcb1 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:34:57.932333 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 624/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:34:57.938585 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295eab6-35ca-45ce-973c-032f3edbae16 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:34:58.034739 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295eab6-35ca-45ce-973c-032f3edbae16 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:34:58.068858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066eb64-6e79-4120-b223-a8cdc8a8299a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:34:58.069728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066eb64-6e79-4120-b223-a8cdc8a8299a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:34:58.070002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066eb64-6e79-4120-b223-a8cdc8a8299a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:34:58.070270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066eb64-6e79-4120-b223-a8cdc8a8299a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:34:58.077360 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066eb64-6e79-4120-b223-a8cdc8a8299a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:34:58.078804 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066eb64-6e79-4120-b223-a8cdc8a8299a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:34:58.093164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-1066eb64-6e79-4120-b223-a8cdc8a8299a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 06:34:58.093164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:34:58.093164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:34:58.093164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:34:58.093164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:34:58.093164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:34:58.093164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:34:58.093164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:34:58.093164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:34:58.093164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:34:58.093164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:34:58.093164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:34:58.093164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:34:58.093164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:34:58.093164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:34:58.093164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:34:58.094350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:34:58.094350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:34:58.094350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:34:58.094350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:34:58.094350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:34:58.094350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:34:58.094350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:34:58.094350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:34:58.094350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:34:58.094350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:34:58.094350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:34:58.094350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:34:58.094350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:34:58.094350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:34:58.094350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:34:58.094350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:34:58.094350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:34:58.094350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:34:58.095485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:34:58.095485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:34:58.095485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:34:58.095485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:34:58.095485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:34:58.095485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:34:58.095485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:34:58.095485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:34:58.095485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 06:34:58.095485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:34:58.095485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 588/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:34:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:34:58.100038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0bdf3-d9d9-4e50-9477-608e098afcb1 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:34:58.195020 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0bdf3-d9d9-4e50-9477-608e098afcb1 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:34:58.226705 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9526549-ccd7-44c8-9f6d-0c1353253134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:34:58.227373 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9526549-ccd7-44c8-9f6d-0c1353253134 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:34:58.227661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9526549-ccd7-44c8-9f6d-0c1353253134 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:34:58.227968 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9526549-ccd7-44c8-9f6d-0c1353253134 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:34:58.228804 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9526549-ccd7-44c8-9f6d-0c1353253134 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:34:58.229110 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9526549-ccd7-44c8-9f6d-0c1353253134 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:34:58.230516 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9526549-ccd7-44c8-9f6d-0c1353253134 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:34:58.247383 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 625/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Thu May 12 06:34:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:34:58.253782 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066eb64-6e79-4120-b223-a8cdc8a8299a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:34:58.347671 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066eb64-6e79-4120-b223-a8cdc8a8299a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:34:58.380331 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1949aee-c144-4ac2-864b-5d915d03bde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:34:58.380969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1949aee-c144-4ac2-864b-5d915d03bde6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:34:58.381247 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1949aee-c144-4ac2-864b-5d915d03bde6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:34:58.381517 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1949aee-c144-4ac2-864b-5d915d03bde6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:34:58.444624 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1949aee-c144-4ac2-864b-5d915d03bde6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:34:58.446095 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1949aee-c144-4ac2-864b-5d915d03bde6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:34:58.538034 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 589/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:34:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 06:34:58.543932 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9526549-ccd7-44c8-9f6d-0c1353253134 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:34:58.636972 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9526549-ccd7-44c8-9f6d-0c1353253134 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:34:58.668826 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6092b5-96e8-48dc-8ae6-4a24f91db0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:34:58.669613 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6092b5-96e8-48dc-8ae6-4a24f91db0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:34:58.669964 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6092b5-96e8-48dc-8ae6-4a24f91db0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:34:58.670240 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6092b5-96e8-48dc-8ae6-4a24f91db0b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:34:58.679710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6092b5-96e8-48dc-8ae6-4a24f91db0b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:34:58.681146 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6092b5-96e8-48dc-8ae6-4a24f91db0b7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:34:58.699246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-7d6092b5-96e8-48dc-8ae6-4a24f91db0b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:34:58.699246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:34:58.699246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:34:58.699246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:34:58.699246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:34:58.699246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:34:58.699246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:34:58.699246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:34:58.699246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:34:58.699246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:34:58.699246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:34:58.699246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:34:58.699246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:34:58.699246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:34:58.699246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:34:58.700463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:34:58.700463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:34:58.700463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:34:58.700463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:34:58.700463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:34:58.700463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:34:58.700463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:34:58.700463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:34:58.700463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:34:58.700463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:34:58.700463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:34:58.700463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:34:58.700463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:34:58.700463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:34:58.700463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:34:58.700463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:34:58.700463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:34:58.702046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:34:58.702046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:34:58.702046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:34:58.702046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:34:58.702046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 626/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:34:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:34:58.706870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1949aee-c144-4ac2-864b-5d915d03bde6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:34:58.800228 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1949aee-c144-4ac2-864b-5d915d03bde6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:34:58.833594 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68c32c-0ca8-43d4-bccf-b628a3dd67d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:34:58.834273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68c32c-0ca8-43d4-bccf-b628a3dd67d4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:34:58.834556 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68c32c-0ca8-43d4-bccf-b628a3dd67d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:34:58.834831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68c32c-0ca8-43d4-bccf-b628a3dd67d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:34:58.835550 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68c32c-0ca8-43d4-bccf-b628a3dd67d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:34:58.835888 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68c32c-0ca8-43d4-bccf-b628a3dd67d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:34:58.837264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68c32c-0ca8-43d4-bccf-b628a3dd67d4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:34:58.848070 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 590/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:34:58.853604 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6092b5-96e8-48dc-8ae6-4a24f91db0b7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:34:58.957470 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6092b5-96e8-48dc-8ae6-4a24f91db0b7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:34:58.991853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf73cd3-76fd-4cfa-b075-e6a8ea76b5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:34:58.992339 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf73cd3-76fd-4cfa-b075-e6a8ea76b5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:34:58.992617 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf73cd3-76fd-4cfa-b075-e6a8ea76b5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:34:58.992886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf73cd3-76fd-4cfa-b075-e6a8ea76b5e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:34:59.000099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf73cd3-76fd-4cfa-b075-e6a8ea76b5e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:34:59.001576 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf73cd3-76fd-4cfa-b075-e6a8ea76b5e5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:34:59.015175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-acf73cd3-76fd-4cfa-b075-e6a8ea76b5e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:34:59.015175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:34:59.015175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:34:59.015175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:34:59.015175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:34:59.015175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:34:59.015175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:34:59.015175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:34:59.015175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:34:59.015175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:34:59.015175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:34:59.015175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:34:59.015175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:34:59.015175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:34:59.015175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:34:59.016257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:34:59.016257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:34:59.016257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:34:59.016257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:34:59.016257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:34:59.016257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:34:59.016257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:34:59.016257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:34:59.016257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:34:59.016257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:34:59.016257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:34:59.016257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:34:59.016257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:34:59.016257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:34:59.016257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:34:59.016257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:34:59.016257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:34:59.017442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:34:59.017442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:34:59.017442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:34:59.017442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:34:59.017442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:34:59.017442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:34:59.017442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:34:59.017442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:34:59.017442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 627/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:34:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:34:59.022264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68c32c-0ca8-43d4-bccf-b628a3dd67d4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:34:59.118177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68c32c-0ca8-43d4-bccf-b628a3dd67d4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:34:59.149292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db527217-58ad-4ba7-84c3-67d19e7c59bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:34:59.149934 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db527217-58ad-4ba7-84c3-67d19e7c59bc None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:34:59.150213 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db527217-58ad-4ba7-84c3-67d19e7c59bc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:34:59.150484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db527217-58ad-4ba7-84c3-67d19e7c59bc None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:34:59.151256 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db527217-58ad-4ba7-84c3-67d19e7c59bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:34:59.151561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db527217-58ad-4ba7-84c3-67d19e7c59bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:34:59.153016 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db527217-58ad-4ba7-84c3-67d19e7c59bc None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:34:59.165000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 591/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:34:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:34:59.171638 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf73cd3-76fd-4cfa-b075-e6a8ea76b5e5 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:34:59.263945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf73cd3-76fd-4cfa-b075-e6a8ea76b5e5 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:34:59.296045 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b055255-9b48-4062-97bb-0586da4930da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:34:59.296692 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b055255-9b48-4062-97bb-0586da4930da None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:34:59.296974 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b055255-9b48-4062-97bb-0586da4930da None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:34:59.297248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b055255-9b48-4062-97bb-0586da4930da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:34:59.298142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b055255-9b48-4062-97bb-0586da4930da None admin] RBAC: Adding query filter params (role.id=ed3e6c61b2d14364a605282f0f1488ba, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=61d2edf68b1b440097981097699bb307) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:34:59.298451 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b055255-9b48-4062-97bb-0586da4930da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:34:59.299951 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b055255-9b48-4062-97bb-0586da4930da None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:34:59.305308 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 628/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:34:59 2022] GET /identity/v3/role_assignments?user.id=61d2edf68b1b440097981097699bb307&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=ed3e6c61b2d14364a605282f0f1488ba => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:01.483154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc6cb7-bf1e-4266-aa08-941a8fe7a75a None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:01.483748 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc6cb7-bf1e-4266-aa08-941a8fe7a75a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:01.483748 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc6cb7-bf1e-4266-aa08-941a8fe7a75a None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:01.485060 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 592/1220] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:35:01.490053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e820e-d4f0-437d-9fbe-ac1533a6087a None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:01.490470 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e820e-d4f0-437d-9fbe-ac1533a6087a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:01.490609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e820e-d4f0-437d-9fbe-ac1533a6087a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:01.507503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-b40e820e-d4f0-437d-9fbe-ac1533a6087a None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:35:01.508727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b40e820e-d4f0-437d-9fbe-ac1533a6087a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:35:01.571975 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 629/1221] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:35:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:35:01.594948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc6cb7-bf1e-4266-aa08-941a8fe7a75a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:01.692724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc6cb7-bf1e-4266-aa08-941a8fe7a75a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:01.725105 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09475f5f-3653-4319-a610-d4f31d9fcea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:01.725938 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09475f5f-3653-4319-a610-d4f31d9fcea9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:01.726222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09475f5f-3653-4319-a610-d4f31d9fcea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:01.726489 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09475f5f-3653-4319-a610-d4f31d9fcea9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:01.736192 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09475f5f-3653-4319-a610-d4f31d9fcea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:35:01.743836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-09475f5f-3653-4319-a610-d4f31d9fcea9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 06:35:01.743836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:01.743836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:01.743836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:01.743836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:01.743836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:01.743836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:01.743836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:01.743836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:01.743836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:01.743836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:01.743836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:01.743836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:35:01.743836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:35:01.743836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:35:01.743836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:35:01.761365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:35:01.761365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:35:01.761365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:35:01.761365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:35:01.761365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:01.761365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:01.761365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:01.761365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:01.761365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:01.761365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:01.761365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:01.761365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:35:01.761365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:01.761365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:01.761365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:01.761365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:01.762273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:01.762273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:01.762273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:01.762273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:01.762273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:35:01.762273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:35:01.762273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:35:01.762273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:35:01.762273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:35:01.762273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:35:01.762273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 06:35:01.762273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:35:01.762273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 593/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:35:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:01.762979 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e820e-d4f0-437d-9fbe-ac1533a6087a None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:01.845433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e820e-d4f0-437d-9fbe-ac1533a6087a None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:01.879377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d58f6-5465-42b4-8db3-4ef615ca2cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:01.880065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d58f6-5465-42b4-8db3-4ef615ca2cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:01.880345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d58f6-5465-42b4-8db3-4ef615ca2cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:01.880613 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d58f6-5465-42b4-8db3-4ef615ca2cf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:01.881389 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d58f6-5465-42b4-8db3-4ef615ca2cf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:01.881691 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d58f6-5465-42b4-8db3-4ef615ca2cf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:01.883047 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d58f6-5465-42b4-8db3-4ef615ca2cf4 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:01.890799 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 630/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 12 06:35:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:01.896537 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09475f5f-3653-4319-a610-d4f31d9fcea9 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:01.990700 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09475f5f-3653-4319-a610-d4f31d9fcea9 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:02.022998 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92150c3b-0ee4-4efe-a8f6-d472d40c70f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:02.023805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92150c3b-0ee4-4efe-a8f6-d472d40c70f0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:02.024091 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92150c3b-0ee4-4efe-a8f6-d472d40c70f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:02.024359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92150c3b-0ee4-4efe-a8f6-d472d40c70f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:02.034420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92150c3b-0ee4-4efe-a8f6-d472d40c70f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:02.035897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92150c3b-0ee4-4efe-a8f6-d472d40c70f0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:02.053097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-92150c3b-0ee4-4efe-a8f6-d472d40c70f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:35:02.053097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:02.053097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:02.053097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:02.053097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:02.053097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:02.053097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:02.053097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:02.053097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:02.053097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:02.053097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:02.053097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:02.053097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:35:02.053097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:35:02.053097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:35:02.054165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:35:02.054165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:02.054165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:02.054165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:02.054165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:02.054165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:02.054165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:02.054165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:02.054165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:35:02.054165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:02.054165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:02.054165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:02.054165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:02.054165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:02.054165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:02.054165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:02.054165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:02.055290 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:35:02.055290 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:35:02.055290 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:35:02.055290 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:35:02.055290 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 594/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:02.060018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d58f6-5465-42b4-8db3-4ef615ca2cf4 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:02.163080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d58f6-5465-42b4-8db3-4ef615ca2cf4 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:02.194302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f36429-6ed6-429c-aff9-99421bbe2ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:02.194950 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f36429-6ed6-429c-aff9-99421bbe2ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:02.195226 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f36429-6ed6-429c-aff9-99421bbe2ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:02.195494 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f36429-6ed6-429c-aff9-99421bbe2ce3 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:02.196234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f36429-6ed6-429c-aff9-99421bbe2ce3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:02.196535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f36429-6ed6-429c-aff9-99421bbe2ce3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:02.197873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f36429-6ed6-429c-aff9-99421bbe2ce3 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:02.208819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 631/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:02.214527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92150c3b-0ee4-4efe-a8f6-d472d40c70f0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:02.311132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92150c3b-0ee4-4efe-a8f6-d472d40c70f0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:02.343063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c577154-cd51-4d02-8b27-51cc345af04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:02.347121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c577154-cd51-4d02-8b27-51cc345af04c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:02.347121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c577154-cd51-4d02-8b27-51cc345af04c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:02.347121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c577154-cd51-4d02-8b27-51cc345af04c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:02.351619 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c577154-cd51-4d02-8b27-51cc345af04c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:02.353064 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c577154-cd51-4d02-8b27-51cc345af04c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:02.367641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-9c577154-cd51-4d02-8b27-51cc345af04c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 06:35:02.367641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:02.367641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:02.367641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:02.367641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:02.367641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:02.367641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:02.367641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:02.367641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:02.367641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:02.367641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:02.367641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:02.367641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:35:02.367641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:35:02.367641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:35:02.367641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:35:02.368783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:02.368783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:02.368783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:35:02.368783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:35:02.368783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:35:02.368783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:35:02.368783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:02.368783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:02.368783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:02.368783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:02.368783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:02.368783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:35:02.368783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:02.368783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:02.368783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:02.368783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:02.368783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:02.368783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:02.369969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:02.369969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:02.369969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:35:02.369969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:35:02.369969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:35:02.369969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:35:02.369969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:35:02.369969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:35:02.369969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 06:35:02.369969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:35:02.369969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 595/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:35:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:02.374482 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f36429-6ed6-429c-aff9-99421bbe2ce3 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:02.468946 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f36429-6ed6-429c-aff9-99421bbe2ce3 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:02.500443 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4d2a7-012d-48ed-8248-a0a0573c6280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:02.501099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4d2a7-012d-48ed-8248-a0a0573c6280 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:02.501375 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4d2a7-012d-48ed-8248-a0a0573c6280 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:02.501645 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4d2a7-012d-48ed-8248-a0a0573c6280 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:02.502515 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4d2a7-012d-48ed-8248-a0a0573c6280 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:02.502814 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4d2a7-012d-48ed-8248-a0a0573c6280 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:02.504267 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4d2a7-012d-48ed-8248-a0a0573c6280 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:02.521229 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 632/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Thu May 12 06:35:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:02.526944 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c577154-cd51-4d02-8b27-51cc345af04c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:02.621651 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c577154-cd51-4d02-8b27-51cc345af04c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:02.653199 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ecd6e-312c-4d64-9abc-b6e8d8352422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:02.654592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ecd6e-312c-4d64-9abc-b6e8d8352422 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:02.654874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ecd6e-312c-4d64-9abc-b6e8d8352422 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:02.655146 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ecd6e-312c-4d64-9abc-b6e8d8352422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:02.665353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ecd6e-312c-4d64-9abc-b6e8d8352422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:02.666802 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ecd6e-312c-4d64-9abc-b6e8d8352422 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:02.683373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-2e0ecd6e-312c-4d64-9abc-b6e8d8352422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:35:02.683373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:02.683373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:02.683373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:02.683373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:02.683373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:02.683373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:02.683373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:02.683373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:02.683373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:02.683373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:02.683373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:02.683373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:35:02.683373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:35:02.683373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:35:02.684465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:35:02.684465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:02.684465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:02.684465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:02.684465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:02.684465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:02.684465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:02.684465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:02.684465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:35:02.684465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:02.684465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:02.684465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:02.684465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:02.684465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:02.684465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:02.684465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:02.684465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:02.690318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:35:02.690318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:35:02.690318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:35:02.690318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:35:02.690318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 596/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:02.690673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4d2a7-012d-48ed-8248-a0a0573c6280 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:02.783752 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4d2a7-012d-48ed-8248-a0a0573c6280 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:02.816110 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766e99f-91ce-4fb3-8a39-452cb65b5117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:02.816766 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766e99f-91ce-4fb3-8a39-452cb65b5117 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:02.817043 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766e99f-91ce-4fb3-8a39-452cb65b5117 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:02.817312 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766e99f-91ce-4fb3-8a39-452cb65b5117 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:02.818067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766e99f-91ce-4fb3-8a39-452cb65b5117 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:02.818367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766e99f-91ce-4fb3-8a39-452cb65b5117 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:02.819849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766e99f-91ce-4fb3-8a39-452cb65b5117 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:02.831219 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 633/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:02.837103 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ecd6e-312c-4d64-9abc-b6e8d8352422 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:02.932412 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ecd6e-312c-4d64-9abc-b6e8d8352422 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:02.964837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef71e9-372a-4228-a87c-196409a609f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:02.965620 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef71e9-372a-4228-a87c-196409a609f6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:02.965896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef71e9-372a-4228-a87c-196409a609f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:02.966163 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef71e9-372a-4228-a87c-196409a609f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:02.972583 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef71e9-372a-4228-a87c-196409a609f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:02.974024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef71e9-372a-4228-a87c-196409a609f6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:02.987670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-a9ef71e9-372a-4228-a87c-196409a609f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:35:02.987670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:02.987670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:02.987670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:02.987670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:02.987670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:02.987670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:02.987670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:02.987670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:02.987670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:02.987670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:02.987670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:02.987670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:35:02.987670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:35:02.987670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:35:02.988582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:35:02.988582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:02.988582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:02.988582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:02.988582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:02.988582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:02.988582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:02.988582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:02.988582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:35:02.988582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:02.988582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:02.988582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:02.988582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:02.988582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:02.988582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:02.988582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:02.988582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:02.989679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:35:02.989679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:35:02.989679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:35:02.989679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:35:02.989679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:35:02.989679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:35:02.989679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:35:02.989679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:35:02.989679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 597/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:35:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:02.994552 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766e99f-91ce-4fb3-8a39-452cb65b5117 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:03.089217 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766e99f-91ce-4fb3-8a39-452cb65b5117 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:03.121460 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d1eec-b293-4dfb-8d86-de262c786709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:03.122134 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d1eec-b293-4dfb-8d86-de262c786709 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:03.122419 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d1eec-b293-4dfb-8d86-de262c786709 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:03.123187 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d1eec-b293-4dfb-8d86-de262c786709 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:03.124008 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d1eec-b293-4dfb-8d86-de262c786709 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:03.124316 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d1eec-b293-4dfb-8d86-de262c786709 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:03.125904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d1eec-b293-4dfb-8d86-de262c786709 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:03.138894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 634/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:35:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:03.144901 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef71e9-372a-4228-a87c-196409a609f6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:03.239424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef71e9-372a-4228-a87c-196409a609f6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:03.271881 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d8d01-1c67-4233-a566-86001423eefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:03.272734 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d8d01-1c67-4233-a566-86001423eefd None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:03.273016 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d8d01-1c67-4233-a566-86001423eefd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:03.273288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d8d01-1c67-4233-a566-86001423eefd None admin] PATH_INFO: `/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/61d2edf68b1b440097981097699bb307/roles/ed3e6c61b2d14364a605282f0f1488ba` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:03.286873 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d8d01-1c67-4233-a566-86001423eefd None admin] RBAC: Authorizing `identity:create_grant(project_id=57e1a8b143974111b0ba09d041b331d5, user_id=61d2edf68b1b440097981097699bb307, role_id=ed3e6c61b2d14364a605282f0f1488ba)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:03.288338 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d8d01-1c67-4233-a566-86001423eefd None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:03.379115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 598/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:35:03 2022] PUT /identity/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/61d2edf68b1b440097981097699bb307/roles/ed3e6c61b2d14364a605282f0f1488ba => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:35:05.545506 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66285c78-69f2-4487-857c-043d166ec838 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:05.546031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66285c78-69f2-4487-857c-043d166ec838 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:05.546031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66285c78-69f2-4487-857c-043d166ec838 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:05.547392 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 635/1233] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:35:05.552711 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb379d6c-400d-41ba-b785-943a5c7b5c67 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:05.553134 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb379d6c-400d-41ba-b785-943a5c7b5c67 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:05.553260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb379d6c-400d-41ba-b785-943a5c7b5c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:05.568933 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-bb379d6c-400d-41ba-b785-943a5c7b5c67 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:35:05.570087 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bb379d6c-400d-41ba-b785-943a5c7b5c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:35:05.636757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 599/1234] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:35:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:35:05.661014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66285c78-69f2-4487-857c-043d166ec838 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:05.757094 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66285c78-69f2-4487-857c-043d166ec838 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:05.790514 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79175d9c-4a4f-4b58-adc3-1db960808282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:05.791301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79175d9c-4a4f-4b58-adc3-1db960808282 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:05.791584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79175d9c-4a4f-4b58-adc3-1db960808282 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:05.791886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79175d9c-4a4f-4b58-adc3-1db960808282 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:05.801726 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79175d9c-4a4f-4b58-adc3-1db960808282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:35:05.809355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-79175d9c-4a4f-4b58-adc3-1db960808282 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 06:35:05.809355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:05.809355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:05.809355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:05.809355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:05.809355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:05.809355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:05.809355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:05.809355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:05.809355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:05.809355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:05.809355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:05.809355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:35:05.809355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:35:05.809355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:35:05.809355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:35:05.810584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:35:05.810584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:35:05.810584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:35:05.810584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:35:05.810584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:05.810584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:05.810584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:05.810584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:05.810584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:05.810584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:05.810584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:05.810584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:35:05.810584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:05.810584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:05.810584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:05.810584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:05.811908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:05.811908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:05.811908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:05.811908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:05.811908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:35:05.811908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:35:05.811908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:35:05.811908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:35:05.811908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:35:05.811908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:35:05.811908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 06:35:05.811908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:35:05.811908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 636/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 12 06:35:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:05.816509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb379d6c-400d-41ba-b785-943a5c7b5c67 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:05.913186 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb379d6c-400d-41ba-b785-943a5c7b5c67 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:05.945343 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395034c-61b4-4f0e-95ad-a1eb4e33d58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:05.945997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395034c-61b4-4f0e-95ad-a1eb4e33d58f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:05.946276 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395034c-61b4-4f0e-95ad-a1eb4e33d58f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:05.946545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395034c-61b4-4f0e-95ad-a1eb4e33d58f None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:05.947278 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395034c-61b4-4f0e-95ad-a1eb4e33d58f None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:05.947578 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395034c-61b4-4f0e-95ad-a1eb4e33d58f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:05.948956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395034c-61b4-4f0e-95ad-a1eb4e33d58f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:05.957485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 600/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 12 06:35:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:05.963452 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79175d9c-4a4f-4b58-adc3-1db960808282 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:06.058745 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79175d9c-4a4f-4b58-adc3-1db960808282 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:06.090437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86337bbe-3c94-42cd-b1f2-dc3edb6fd1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:06.091226 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86337bbe-3c94-42cd-b1f2-dc3edb6fd1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:06.091503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86337bbe-3c94-42cd-b1f2-dc3edb6fd1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:06.091814 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86337bbe-3c94-42cd-b1f2-dc3edb6fd1a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:06.102451 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86337bbe-3c94-42cd-b1f2-dc3edb6fd1a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:06.103897 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86337bbe-3c94-42cd-b1f2-dc3edb6fd1a3 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:06.120274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-86337bbe-3c94-42cd-b1f2-dc3edb6fd1a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:35:06.120274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:06.120274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:06.120274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:06.120274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:06.120274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:06.120274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:06.120274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:06.120274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:06.120274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:06.120274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:06.120274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:06.120274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:35:06.120274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:35:06.120274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:35:06.121306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:35:06.121306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:06.121306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:06.121306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:06.121306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:06.121306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:06.121306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:06.121306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:06.121306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:35:06.121306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:06.121306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:06.121306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:06.121306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:06.121306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:06.121306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:06.121306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:06.121306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:06.126746 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:35:06.126746 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:35:06.126746 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:35:06.126746 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:35:06.126746 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 637/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:06.127942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395034c-61b4-4f0e-95ad-a1eb4e33d58f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:06.222321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395034c-61b4-4f0e-95ad-a1eb4e33d58f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:06.258486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717770cf-6631-400f-9b71-82860b6e10fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:06.259129 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717770cf-6631-400f-9b71-82860b6e10fe None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:06.259407 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717770cf-6631-400f-9b71-82860b6e10fe None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:06.259674 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717770cf-6631-400f-9b71-82860b6e10fe None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:06.260413 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717770cf-6631-400f-9b71-82860b6e10fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:06.260710 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717770cf-6631-400f-9b71-82860b6e10fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:06.262055 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717770cf-6631-400f-9b71-82860b6e10fe None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:06.273683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 601/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:06.279521 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86337bbe-3c94-42cd-b1f2-dc3edb6fd1a3 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:06.375446 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86337bbe-3c94-42cd-b1f2-dc3edb6fd1a3 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:06.406705 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab1702-1710-447e-9718-2a16156c008c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:06.407501 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab1702-1710-447e-9718-2a16156c008c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:06.407815 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab1702-1710-447e-9718-2a16156c008c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:06.408089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab1702-1710-447e-9718-2a16156c008c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:06.415542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab1702-1710-447e-9718-2a16156c008c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:06.417012 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab1702-1710-447e-9718-2a16156c008c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:06.431503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-39ab1702-1710-447e-9718-2a16156c008c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 06:35:06.431503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:06.431503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:06.431503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:06.431503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:06.431503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:06.431503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:06.431503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:06.431503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:06.431503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:06.431503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:06.431503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:06.431503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:35:06.431503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:35:06.431503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:35:06.431503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:35:06.432607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:06.432607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:06.432607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:35:06.432607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:35:06.432607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:35:06.432607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:35:06.432607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:06.432607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:06.432607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:06.432607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:06.432607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:06.432607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:35:06.432607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:06.432607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:06.432607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:06.432607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:06.432607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:06.432607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:06.433619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:06.433619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:06.433619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:35:06.433619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:35:06.433619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:35:06.433619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:35:06.433619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:35:06.433619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:35:06.433619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 06:35:06.433619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:35:06.433619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 638/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:35:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:06.439082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717770cf-6631-400f-9b71-82860b6e10fe None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:06.533963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717770cf-6631-400f-9b71-82860b6e10fe None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:06.566034 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb2b0d-cd15-456a-95f2-3977096ff852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:06.566668 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb2b0d-cd15-456a-95f2-3977096ff852 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:06.566943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb2b0d-cd15-456a-95f2-3977096ff852 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:06.567210 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb2b0d-cd15-456a-95f2-3977096ff852 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:06.568079 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb2b0d-cd15-456a-95f2-3977096ff852 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:06.568385 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb2b0d-cd15-456a-95f2-3977096ff852 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:06.569801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb2b0d-cd15-456a-95f2-3977096ff852 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:06.585986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 602/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Thu May 12 06:35:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:06.591719 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab1702-1710-447e-9718-2a16156c008c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:06.689085 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab1702-1710-447e-9718-2a16156c008c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:06.721125 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd5552-7b2d-444e-91b0-f0d63ef35013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:06.721771 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd5552-7b2d-444e-91b0-f0d63ef35013 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:06.722056 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd5552-7b2d-444e-91b0-f0d63ef35013 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:06.722333 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd5552-7b2d-444e-91b0-f0d63ef35013 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:06.785769 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd5552-7b2d-444e-91b0-f0d63ef35013 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:06.787480 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd5552-7b2d-444e-91b0-f0d63ef35013 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:06.880444 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 639/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:35:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 06:35:06.886307 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb2b0d-cd15-456a-95f2-3977096ff852 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:06.981405 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb2b0d-cd15-456a-95f2-3977096ff852 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:07.014410 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b999f-ba12-43b7-a9bf-654e3fe3a672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:07.015199 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b999f-ba12-43b7-a9bf-654e3fe3a672 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:07.015470 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b999f-ba12-43b7-a9bf-654e3fe3a672 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:07.015890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b999f-ba12-43b7-a9bf-654e3fe3a672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:07.025915 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b999f-ba12-43b7-a9bf-654e3fe3a672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:07.027478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b999f-ba12-43b7-a9bf-654e3fe3a672 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:07.044476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-059b999f-ba12-43b7-a9bf-654e3fe3a672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:35:07.044476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:07.044476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:07.044476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:07.044476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:07.044476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:07.044476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:07.044476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:07.044476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:07.044476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:07.044476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:07.044476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:07.044476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:35:07.044476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:35:07.044476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:35:07.046007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:35:07.046007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:07.046007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:07.046007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:07.046007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:07.046007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:07.046007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:07.046007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:07.046007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:35:07.046007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:07.046007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:07.046007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:07.046007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:07.046007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:07.046007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:07.046007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:07.046007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:07.047029 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:35:07.047029 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:35:07.047029 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:35:07.047029 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:35:07.047029 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 603/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:35:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:07.051789 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd5552-7b2d-444e-91b0-f0d63ef35013 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:07.145605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd5552-7b2d-444e-91b0-f0d63ef35013 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:07.178292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d68d52-4ac6-4491-8b7a-25cd025384de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:07.178940 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d68d52-4ac6-4491-8b7a-25cd025384de None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:07.179222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d68d52-4ac6-4491-8b7a-25cd025384de None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:07.179553 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d68d52-4ac6-4491-8b7a-25cd025384de None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:07.180303 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d68d52-4ac6-4491-8b7a-25cd025384de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:07.180608 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d68d52-4ac6-4491-8b7a-25cd025384de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:07.181997 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d68d52-4ac6-4491-8b7a-25cd025384de None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:07.193554 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 640/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:07.199187 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b999f-ba12-43b7-a9bf-654e3fe3a672 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:07.294621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b999f-ba12-43b7-a9bf-654e3fe3a672 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:07.326821 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7944ac-8bf7-4c25-9452-3c5883abaa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:07.327589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7944ac-8bf7-4c25-9452-3c5883abaa65 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:07.327897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7944ac-8bf7-4c25-9452-3c5883abaa65 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:07.328167 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7944ac-8bf7-4c25-9452-3c5883abaa65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:07.334446 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7944ac-8bf7-4c25-9452-3c5883abaa65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:07.335891 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7944ac-8bf7-4c25-9452-3c5883abaa65 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:07.349133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-fe7944ac-8bf7-4c25-9452-3c5883abaa65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:35:07.349133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:07.349133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:07.349133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:07.349133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:07.349133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:07.349133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:07.349133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:07.349133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:07.349133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:07.349133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:07.349133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:07.349133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:35:07.349133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:35:07.349133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:35:07.350085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:35:07.350085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:07.350085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:07.350085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:07.350085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:07.350085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:07.350085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:07.350085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:07.350085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:35:07.350085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:07.350085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:07.350085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:07.350085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:07.350085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:07.350085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:07.350085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:07.350085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:07.351078 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:35:07.351078 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:35:07.351078 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:35:07.351078 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:35:07.351078 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:35:07.351078 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:35:07.351078 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:35:07.351078 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:35:07.351078 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 604/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:35:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:07.356316 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d68d52-4ac6-4491-8b7a-25cd025384de None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:07.452029 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d68d52-4ac6-4491-8b7a-25cd025384de None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:07.484164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6cb03-e460-448e-9e42-bc657fd81aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:07.484816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6cb03-e460-448e-9e42-bc657fd81aab None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:07.485094 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6cb03-e460-448e-9e42-bc657fd81aab None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:07.485446 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6cb03-e460-448e-9e42-bc657fd81aab None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:07.486232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6cb03-e460-448e-9e42-bc657fd81aab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:07.486544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6cb03-e460-448e-9e42-bc657fd81aab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:07.487981 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6cb03-e460-448e-9e42-bc657fd81aab None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:07.499670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 641/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:35:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:07.505624 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7944ac-8bf7-4c25-9452-3c5883abaa65 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:07.599635 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7944ac-8bf7-4c25-9452-3c5883abaa65 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:07.631405 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac1278-304b-412e-b21c-0063a12ee68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:07.632076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac1278-304b-412e-b21c-0063a12ee68f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:07.632354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac1278-304b-412e-b21c-0063a12ee68f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:07.632622 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac1278-304b-412e-b21c-0063a12ee68f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:07.633448 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac1278-304b-412e-b21c-0063a12ee68f None admin] RBAC: Adding query filter params (role.id=ed3e6c61b2d14364a605282f0f1488ba, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=61d2edf68b1b440097981097699bb307) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:07.633756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac1278-304b-412e-b21c-0063a12ee68f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:07.635202 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac1278-304b-412e-b21c-0063a12ee68f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:07.640924 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 605/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:35:07 2022] GET /identity/v3/role_assignments?user.id=61d2edf68b1b440097981097699bb307&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=ed3e6c61b2d14364a605282f0f1488ba => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:09.903402 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13dbea-fb79-4f93-a1cb-857bf59fed8e None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:09.904006 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13dbea-fb79-4f93-a1cb-857bf59fed8e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:09.904121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13dbea-fb79-4f93-a1cb-857bf59fed8e None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:09.905517 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 642/1247] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:35:09.910890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19455639-d234-4982-9d73-b07be077776c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:09.911556 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19455639-d234-4982-9d73-b07be077776c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:09.911718 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19455639-d234-4982-9d73-b07be077776c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:09.927874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-19455639-d234-4982-9d73-b07be077776c None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:35:09.929049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-19455639-d234-4982-9d73-b07be077776c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:35:09.995311 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 606/1248] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:35:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:35:10.019813 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13dbea-fb79-4f93-a1cb-857bf59fed8e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:10.116845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13dbea-fb79-4f93-a1cb-857bf59fed8e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:10.149440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991dbfd-ab07-478f-aeaf-fdb404a6d7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:10.150239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991dbfd-ab07-478f-aeaf-fdb404a6d7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:10.150549 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991dbfd-ab07-478f-aeaf-fdb404a6d7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:10.150848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991dbfd-ab07-478f-aeaf-fdb404a6d7b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:10.160411 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991dbfd-ab07-478f-aeaf-fdb404a6d7b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:35:10.168413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-3991dbfd-ab07-478f-aeaf-fdb404a6d7b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:35:10.168413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:10.168413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:10.168413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:10.168413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:10.168413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:10.168413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:10.168413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:10.168413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:10.168413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:10.168413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:10.168413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:10.168413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:35:10.168413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:35:10.168413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:35:10.168413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:35:10.169509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:35:10.169509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:35:10.169509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:35:10.169509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:35:10.169509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:10.169509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:10.169509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:10.169509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:10.169509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:10.169509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:10.169509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:10.169509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:35:10.169509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:10.169509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:10.169509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:10.169509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:10.170571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:10.170571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:10.170571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:10.170571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:10.170571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:35:10.170571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:35:10.170571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:35:10.170571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:35:10.170571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:35:10.170571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:35:10.170571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:35:10.170571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:35:10.170571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 643/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:35:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:10.176224 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19455639-d234-4982-9d73-b07be077776c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:10.270034 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19455639-d234-4982-9d73-b07be077776c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:10.303430 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca688e9-0bd3-4473-8088-ce05a2979894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:10.304121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca688e9-0bd3-4473-8088-ce05a2979894 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:10.304415 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca688e9-0bd3-4473-8088-ce05a2979894 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:10.304714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca688e9-0bd3-4473-8088-ce05a2979894 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:10.305495 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca688e9-0bd3-4473-8088-ce05a2979894 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:10.305801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca688e9-0bd3-4473-8088-ce05a2979894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:10.307157 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca688e9-0bd3-4473-8088-ce05a2979894 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:10.315731 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 607/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:35:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:10.321459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991dbfd-ab07-478f-aeaf-fdb404a6d7b6 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:10.420737 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991dbfd-ab07-478f-aeaf-fdb404a6d7b6 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:10.452936 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2c25f-e5a2-4d97-b591-38524c27df68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:10.456606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2c25f-e5a2-4d97-b591-38524c27df68 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:10.456606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2c25f-e5a2-4d97-b591-38524c27df68 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:10.456606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2c25f-e5a2-4d97-b591-38524c27df68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:10.464434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2c25f-e5a2-4d97-b591-38524c27df68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:10.465877 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2c25f-e5a2-4d97-b591-38524c27df68 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:10.483014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-40b2c25f-e5a2-4d97-b591-38524c27df68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:35:10.483014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:10.483014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:10.483014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:10.483014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:10.483014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:10.483014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:10.483014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:10.483014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:10.483014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:10.483014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:10.483014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:10.483014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:35:10.483014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:35:10.483014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:35:10.486087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:35:10.486087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:10.486087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:10.486087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:10.486087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:10.486087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:10.486087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:10.486087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:10.486087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:35:10.486087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:10.486087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:10.486087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:10.486087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:10.486087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:10.486087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:10.486087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:10.486087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:10.487248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:35:10.487248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:35:10.487248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:35:10.487248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:35:10.487248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 644/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:10.490528 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca688e9-0bd3-4473-8088-ce05a2979894 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:10.584606 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca688e9-0bd3-4473-8088-ce05a2979894 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:10.616987 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2426d-b78d-4be7-b6df-24737b04d721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:10.617645 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2426d-b78d-4be7-b6df-24737b04d721 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:10.617928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2426d-b78d-4be7-b6df-24737b04d721 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:10.618201 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2426d-b78d-4be7-b6df-24737b04d721 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:10.618915 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2426d-b78d-4be7-b6df-24737b04d721 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:10.619217 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2426d-b78d-4be7-b6df-24737b04d721 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:10.620615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2426d-b78d-4be7-b6df-24737b04d721 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:10.631822 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 608/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:10.637626 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2c25f-e5a2-4d97-b591-38524c27df68 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:10.732621 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2c25f-e5a2-4d97-b591-38524c27df68 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:10.763532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29224bca-6004-4958-b2a8-586107e07457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:10.764355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29224bca-6004-4958-b2a8-586107e07457 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:10.764640 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29224bca-6004-4958-b2a8-586107e07457 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:10.765426 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29224bca-6004-4958-b2a8-586107e07457 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:10.772527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29224bca-6004-4958-b2a8-586107e07457 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:10.777883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29224bca-6004-4958-b2a8-586107e07457 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:10.788718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-29224bca-6004-4958-b2a8-586107e07457 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 06:35:10.788718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:10.788718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:10.788718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:10.788718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:10.788718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:10.788718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:10.788718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:10.788718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:10.788718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:10.788718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:10.788718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:10.788718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:35:10.788718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:35:10.788718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:35:10.788718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:35:10.789862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:10.789862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:10.789862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:35:10.789862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:35:10.789862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:35:10.789862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:35:10.789862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:10.789862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:10.789862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:10.789862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:10.789862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:10.789862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:35:10.789862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:10.789862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:10.789862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:10.789862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:10.789862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:10.789862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:10.791086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:10.791086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:10.791086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:35:10.791086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:35:10.791086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:35:10.791086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:35:10.791086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:35:10.791086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:35:10.791086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 06:35:10.791086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:35:10.791086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 645/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:35:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:10.795836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2426d-b78d-4be7-b6df-24737b04d721 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:10.890855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2426d-b78d-4be7-b6df-24737b04d721 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:10.923505 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab07dbb-d268-4819-8aea-5539217a6baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:10.924200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab07dbb-d268-4819-8aea-5539217a6baf None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:10.924483 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab07dbb-d268-4819-8aea-5539217a6baf None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:10.924757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab07dbb-d268-4819-8aea-5539217a6baf None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:10.925594 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab07dbb-d268-4819-8aea-5539217a6baf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:10.925903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab07dbb-d268-4819-8aea-5539217a6baf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:10.927324 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab07dbb-d268-4819-8aea-5539217a6baf None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:10.943600 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 609/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Thu May 12 06:35:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:10.949486 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29224bca-6004-4958-b2a8-586107e07457 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:11.044882 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29224bca-6004-4958-b2a8-586107e07457 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:11.075814 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e29cd9-9c2b-42a6-93d1-680a43dcb6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:11.076447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e29cd9-9c2b-42a6-93d1-680a43dcb6de None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:11.076725 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e29cd9-9c2b-42a6-93d1-680a43dcb6de None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:11.076996 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e29cd9-9c2b-42a6-93d1-680a43dcb6de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:11.142413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e29cd9-9c2b-42a6-93d1-680a43dcb6de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:11.143910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e29cd9-9c2b-42a6-93d1-680a43dcb6de None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:11.235133 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 646/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:35:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 06:35:11.240944 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab07dbb-d268-4819-8aea-5539217a6baf None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:11.336094 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab07dbb-d268-4819-8aea-5539217a6baf None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:11.367290 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fccd1-f3ab-42fb-acd6-74a093848d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:11.368093 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fccd1-f3ab-42fb-acd6-74a093848d3c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:11.368368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fccd1-f3ab-42fb-acd6-74a093848d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:11.368636 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fccd1-f3ab-42fb-acd6-74a093848d3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:11.378474 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fccd1-f3ab-42fb-acd6-74a093848d3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:11.380003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fccd1-f3ab-42fb-acd6-74a093848d3c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:11.397318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-532fccd1-f3ab-42fb-acd6-74a093848d3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:35:11.397318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:11.397318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:11.397318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:11.397318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:11.397318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:11.397318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:11.397318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:11.397318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:11.397318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:11.397318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:11.397318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:11.397318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:35:11.397318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:35:11.397318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:35:11.398438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:35:11.398438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:11.398438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:11.398438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:11.398438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:11.398438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:11.398438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:11.398438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:11.398438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:35:11.398438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:11.398438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:11.398438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:11.398438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:11.398438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:11.398438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:11.398438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:11.398438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:11.399516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:35:11.399516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:35:11.399516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:35:11.399516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:35:11.399516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 610/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:11.404219 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e29cd9-9c2b-42a6-93d1-680a43dcb6de None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:11.498098 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e29cd9-9c2b-42a6-93d1-680a43dcb6de None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:11.530209 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd73e3-e9c9-4235-96ec-9375329bb55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:11.530898 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd73e3-e9c9-4235-96ec-9375329bb55c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:11.531194 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd73e3-e9c9-4235-96ec-9375329bb55c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:11.531470 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd73e3-e9c9-4235-96ec-9375329bb55c None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:11.532254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd73e3-e9c9-4235-96ec-9375329bb55c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:11.532561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd73e3-e9c9-4235-96ec-9375329bb55c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:11.533927 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd73e3-e9c9-4235-96ec-9375329bb55c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:11.545115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 647/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:11.553359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fccd1-f3ab-42fb-acd6-74a093848d3c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:11.644591 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fccd1-f3ab-42fb-acd6-74a093848d3c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:11.677200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c576493-442a-4737-9e03-cd98491c6aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:11.677974 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c576493-442a-4737-9e03-cd98491c6aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:11.678253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c576493-442a-4737-9e03-cd98491c6aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:11.678522 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c576493-442a-4737-9e03-cd98491c6aa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:11.684848 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c576493-442a-4737-9e03-cd98491c6aa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:11.686365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c576493-442a-4737-9e03-cd98491c6aa0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:11.700113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-3c576493-442a-4737-9e03-cd98491c6aa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:35:11.700113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:11.700113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:11.700113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:11.700113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:11.700113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:11.700113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:11.700113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:11.700113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:11.700113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:11.700113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:11.700113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:11.700113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:35:11.700113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:35:11.700113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:35:11.702857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:35:11.702857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:11.702857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:11.702857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:11.702857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:11.702857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:11.702857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:11.702857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:11.702857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:35:11.702857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:11.702857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:11.702857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:11.702857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:11.702857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:11.702857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:11.702857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:11.702857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:11.704048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:35:11.704048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:35:11.704048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:35:11.704048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:35:11.704048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:35:11.704048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:35:11.704048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:35:11.704048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:35:11.704048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 611/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:35:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:11.707084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd73e3-e9c9-4235-96ec-9375329bb55c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:11.802357 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd73e3-e9c9-4235-96ec-9375329bb55c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:11.834020 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d25b63-13fd-4141-8640-7ca91389bcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:11.834695 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d25b63-13fd-4141-8640-7ca91389bcff None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:11.834980 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d25b63-13fd-4141-8640-7ca91389bcff None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:11.835256 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d25b63-13fd-4141-8640-7ca91389bcff None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:11.836093 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d25b63-13fd-4141-8640-7ca91389bcff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:11.836400 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d25b63-13fd-4141-8640-7ca91389bcff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:11.837841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d25b63-13fd-4141-8640-7ca91389bcff None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:11.849890 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 648/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:35:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:11.855999 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c576493-442a-4737-9e03-cd98491c6aa0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:11.952475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c576493-442a-4737-9e03-cd98491c6aa0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:11.985536 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5438e7-985f-4a8c-9884-813bcebb585c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:11.986180 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5438e7-985f-4a8c-9884-813bcebb585c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:11.986462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5438e7-985f-4a8c-9884-813bcebb585c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:11.986740 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5438e7-985f-4a8c-9884-813bcebb585c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:11.987572 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5438e7-985f-4a8c-9884-813bcebb585c None admin] RBAC: Adding query filter params (role.id=5e6a73052f3b4ee7829ecb858925e5ca, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=61d2edf68b1b440097981097699bb307) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:11.987911 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5438e7-985f-4a8c-9884-813bcebb585c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:11.989391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5438e7-985f-4a8c-9884-813bcebb585c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:11.994799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 612/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:35:11 2022] GET /identity/v3/role_assignments?user.id=61d2edf68b1b440097981097699bb307&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=5e6a73052f3b4ee7829ecb858925e5ca => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:14.160510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7521e-560f-4fc3-940a-363c5aa41cc0 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:14.161116 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7521e-560f-4fc3-940a-363c5aa41cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:14.161116 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7521e-560f-4fc3-940a-363c5aa41cc0 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:14.162681 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 649/1261] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:35:14.167924 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970e7d9-47c9-4eb8-958a-0866fb091602 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:14.168395 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970e7d9-47c9-4eb8-958a-0866fb091602 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:14.168494 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970e7d9-47c9-4eb8-958a-0866fb091602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:14.184567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d970e7d9-47c9-4eb8-958a-0866fb091602 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:35:14.189463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d970e7d9-47c9-4eb8-958a-0866fb091602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:35:14.247636 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 613/1262] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:35:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:35:14.270925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7521e-560f-4fc3-940a-363c5aa41cc0 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:14.366637 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7521e-560f-4fc3-940a-363c5aa41cc0 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:14.398822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2cd9a-ca42-4c57-ba33-e45b522b6175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:14.399605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2cd9a-ca42-4c57-ba33-e45b522b6175 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:14.399919 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2cd9a-ca42-4c57-ba33-e45b522b6175 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:14.400238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2cd9a-ca42-4c57-ba33-e45b522b6175 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:14.409900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2cd9a-ca42-4c57-ba33-e45b522b6175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:35:14.417925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-afc2cd9a-ca42-4c57-ba33-e45b522b6175 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:35:14.417925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:14.417925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:14.417925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:14.417925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:14.417925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:14.417925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:14.417925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:14.417925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:14.417925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:14.417925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:14.417925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:14.417925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:35:14.417925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:35:14.417925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:35:14.417925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:35:14.425526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:35:14.425526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:35:14.425526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:35:14.425526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:35:14.425526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:14.425526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:14.425526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:14.425526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:14.425526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:14.425526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:14.425526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:14.425526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:35:14.425526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:14.425526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:14.425526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:14.425526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:14.426736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:14.426736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:14.426736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:14.426736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:14.426736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:35:14.426736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:35:14.426736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:35:14.426736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:35:14.426736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:35:14.426736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:35:14.426736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:35:14.426736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:35:14.426736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 650/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:35:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:14.427770 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970e7d9-47c9-4eb8-958a-0866fb091602 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:14.519615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970e7d9-47c9-4eb8-958a-0866fb091602 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:14.551861 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79288bb7-51be-45d2-8c3c-12deb976d170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:14.552578 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79288bb7-51be-45d2-8c3c-12deb976d170 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:14.552860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79288bb7-51be-45d2-8c3c-12deb976d170 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:14.553128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79288bb7-51be-45d2-8c3c-12deb976d170 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:14.553870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79288bb7-51be-45d2-8c3c-12deb976d170 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:14.554171 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79288bb7-51be-45d2-8c3c-12deb976d170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:14.555613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79288bb7-51be-45d2-8c3c-12deb976d170 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:14.563947 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 614/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:35:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:14.569932 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2cd9a-ca42-4c57-ba33-e45b522b6175 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:14.665401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2cd9a-ca42-4c57-ba33-e45b522b6175 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:14.697266 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba0bbc-0fe0-466b-bc7f-41e719c5e26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:14.700836 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba0bbc-0fe0-466b-bc7f-41e719c5e26c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:14.700836 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba0bbc-0fe0-466b-bc7f-41e719c5e26c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:14.700836 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba0bbc-0fe0-466b-bc7f-41e719c5e26c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:14.709298 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba0bbc-0fe0-466b-bc7f-41e719c5e26c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:14.710733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba0bbc-0fe0-466b-bc7f-41e719c5e26c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:14.727562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-5eba0bbc-0fe0-466b-bc7f-41e719c5e26c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:35:14.727562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:14.727562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:14.727562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:14.727562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:14.727562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:14.727562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:14.727562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:14.727562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:14.727562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:14.727562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:14.727562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:14.727562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:35:14.727562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:35:14.727562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:35:14.731025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:35:14.731025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:14.731025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:14.731025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:14.731025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:14.731025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:14.731025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:14.731025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:14.731025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:35:14.731025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:14.731025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:14.731025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:14.731025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:14.731025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:14.731025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:14.731025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:14.731025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:14.732251 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:35:14.732251 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:35:14.732251 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:35:14.732251 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:35:14.732251 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 651/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:14.735348 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79288bb7-51be-45d2-8c3c-12deb976d170 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:14.831442 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79288bb7-51be-45d2-8c3c-12deb976d170 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:14.863237 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc22b07-fecb-499d-aaa1-0febe4161cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:14.867243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc22b07-fecb-499d-aaa1-0febe4161cff None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:14.867243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc22b07-fecb-499d-aaa1-0febe4161cff None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:14.867243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc22b07-fecb-499d-aaa1-0febe4161cff None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:14.867243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc22b07-fecb-499d-aaa1-0febe4161cff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:14.867243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc22b07-fecb-499d-aaa1-0febe4161cff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:14.867243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc22b07-fecb-499d-aaa1-0febe4161cff None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:14.877950 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 615/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:14.883580 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba0bbc-0fe0-466b-bc7f-41e719c5e26c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:14.979148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba0bbc-0fe0-466b-bc7f-41e719c5e26c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:15.011470 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da35e22-d1df-4403-8c8a-bc84ad120095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:15.012296 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da35e22-d1df-4403-8c8a-bc84ad120095 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:15.012584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da35e22-d1df-4403-8c8a-bc84ad120095 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:15.012850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da35e22-d1df-4403-8c8a-bc84ad120095 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:15.020596 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da35e22-d1df-4403-8c8a-bc84ad120095 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:15.022007 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da35e22-d1df-4403-8c8a-bc84ad120095 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:15.036141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-7da35e22-d1df-4403-8c8a-bc84ad120095 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 06:35:15.036141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:15.036141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:15.036141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:15.036141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:15.036141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:15.036141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:15.036141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:15.036141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:15.036141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:15.036141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:15.036141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:15.036141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:35:15.036141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:35:15.036141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:35:15.036141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:35:15.037601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:15.037601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:15.037601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:35:15.037601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:35:15.037601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:35:15.037601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:35:15.037601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:15.037601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:15.037601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:15.037601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:15.037601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:15.037601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:35:15.037601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:15.037601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:15.037601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:15.037601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:15.037601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:15.037601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:15.038607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:15.038607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:15.038607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:35:15.038607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:35:15.038607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:35:15.038607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:35:15.038607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:35:15.038607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:35:15.038607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 06:35:15.038607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:35:15.038607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 652/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:35:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:15.043321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc22b07-fecb-499d-aaa1-0febe4161cff None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:15.138221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc22b07-fecb-499d-aaa1-0febe4161cff None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:15.171053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f4df2-3db6-4500-8e45-4b005dd264c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:15.171769 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f4df2-3db6-4500-8e45-4b005dd264c6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:15.172061 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f4df2-3db6-4500-8e45-4b005dd264c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:15.172331 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f4df2-3db6-4500-8e45-4b005dd264c6 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:15.173163 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f4df2-3db6-4500-8e45-4b005dd264c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:15.173467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f4df2-3db6-4500-8e45-4b005dd264c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:15.174883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f4df2-3db6-4500-8e45-4b005dd264c6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:15.191560 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 616/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Thu May 12 06:35:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:15.197048 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da35e22-d1df-4403-8c8a-bc84ad120095 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:15.291357 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da35e22-d1df-4403-8c8a-bc84ad120095 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:15.322600 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bd778-94af-41e3-bd5b-1732ed730415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:15.325263 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bd778-94af-41e3-bd5b-1732ed730415 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:15.325263 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bd778-94af-41e3-bd5b-1732ed730415 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:15.325263 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bd778-94af-41e3-bd5b-1732ed730415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:15.334854 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bd778-94af-41e3-bd5b-1732ed730415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:15.336364 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bd778-94af-41e3-bd5b-1732ed730415 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:15.353786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-5c2bd778-94af-41e3-bd5b-1732ed730415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:35:15.353786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:15.353786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:15.353786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:15.353786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:15.353786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:15.353786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:15.353786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:15.353786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:15.353786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:15.353786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:15.353786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:15.353786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:35:15.353786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:35:15.353786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:35:15.354923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:35:15.354923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:15.354923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:15.354923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:15.354923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:15.354923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:15.354923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:15.354923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:15.354923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:35:15.354923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:15.354923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:15.354923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:15.354923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:15.354923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:15.354923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:15.354923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:15.354923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:15.355914 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:35:15.355914 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:35:15.355914 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:35:15.355914 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:35:15.355914 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 653/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:15.360764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f4df2-3db6-4500-8e45-4b005dd264c6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:15.457365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f4df2-3db6-4500-8e45-4b005dd264c6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:15.489523 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc274ea-e4db-49b0-a8ca-7107e8a2f39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:15.490169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc274ea-e4db-49b0-a8ca-7107e8a2f39d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:15.490448 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc274ea-e4db-49b0-a8ca-7107e8a2f39d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:15.490716 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc274ea-e4db-49b0-a8ca-7107e8a2f39d None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:15.491427 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc274ea-e4db-49b0-a8ca-7107e8a2f39d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:15.491754 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc274ea-e4db-49b0-a8ca-7107e8a2f39d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:15.493140 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc274ea-e4db-49b0-a8ca-7107e8a2f39d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:15.504233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 617/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:15.509736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bd778-94af-41e3-bd5b-1732ed730415 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:15.605300 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bd778-94af-41e3-bd5b-1732ed730415 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:15.636747 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770c6a2-3359-4125-a7a1-fba7b90811b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:15.637529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770c6a2-3359-4125-a7a1-fba7b90811b3 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:15.637808 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770c6a2-3359-4125-a7a1-fba7b90811b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:15.638076 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770c6a2-3359-4125-a7a1-fba7b90811b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:15.645091 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770c6a2-3359-4125-a7a1-fba7b90811b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:15.646664 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770c6a2-3359-4125-a7a1-fba7b90811b3 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:15.661337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-7770c6a2-3359-4125-a7a1-fba7b90811b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:35:15.661337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:15.661337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:15.661337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:15.661337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:15.661337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:15.661337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:15.661337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:15.661337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:15.661337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:15.661337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:15.661337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:15.661337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:35:15.661337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:35:15.661337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:35:15.662657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:35:15.662657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:15.662657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:15.662657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:15.662657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:15.662657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:15.662657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:15.662657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:15.662657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:35:15.662657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:15.662657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:15.662657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:15.662657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:15.662657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:15.662657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:15.662657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:15.662657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:15.663672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:35:15.663672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:35:15.663672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:35:15.663672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:35:15.663672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:35:15.663672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:35:15.663672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:35:15.663672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:35:15.663672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 654/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:35:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:15.668598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc274ea-e4db-49b0-a8ca-7107e8a2f39d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:15.763216 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc274ea-e4db-49b0-a8ca-7107e8a2f39d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:15.795510 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f94f05-f4dd-4327-a86a-b4844c6f3c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:15.796810 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f94f05-f4dd-4327-a86a-b4844c6f3c2b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:15.797089 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f94f05-f4dd-4327-a86a-b4844c6f3c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:15.797355 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f94f05-f4dd-4327-a86a-b4844c6f3c2b None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:15.798166 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f94f05-f4dd-4327-a86a-b4844c6f3c2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:15.798473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f94f05-f4dd-4327-a86a-b4844c6f3c2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:15.799919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f94f05-f4dd-4327-a86a-b4844c6f3c2b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:15.811380 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 618/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:35:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:15.817367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770c6a2-3359-4125-a7a1-fba7b90811b3 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:15.910924 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770c6a2-3359-4125-a7a1-fba7b90811b3 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:15.943521 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d36b9d-ccdc-45d9-a085-487e8da178d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:15.944456 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d36b9d-ccdc-45d9-a085-487e8da178d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:15.944738 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d36b9d-ccdc-45d9-a085-487e8da178d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:15.945008 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d36b9d-ccdc-45d9-a085-487e8da178d8 None admin] PATH_INFO: `/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/61d2edf68b1b440097981097699bb307/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:15.947065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d36b9d-ccdc-45d9-a085-487e8da178d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=57e1a8b143974111b0ba09d041b331d5, user_id=61d2edf68b1b440097981097699bb307, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:15.948556 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d36b9d-ccdc-45d9-a085-487e8da178d8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:16.035107 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 655/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 12 06:35:15 2022] PUT /identity/v3/projects/57e1a8b143974111b0ba09d041b331d5/users/61d2edf68b1b440097981097699bb307/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:35:18.219175 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07129e3-1d6d-4a7e-b90c-8e910ea0d620 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:18.219793 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07129e3-1d6d-4a7e-b90c-8e910ea0d620 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:18.219793 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07129e3-1d6d-4a7e-b90c-8e910ea0d620 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:18.221112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 619/1274] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:35:18.226371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caed8eb-dc52-44fe-bc0f-8ed007e44e53 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:18.226800 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caed8eb-dc52-44fe-bc0f-8ed007e44e53 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:18.226925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caed8eb-dc52-44fe-bc0f-8ed007e44e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:18.244485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6caed8eb-dc52-44fe-bc0f-8ed007e44e53 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:35:18.245648 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6caed8eb-dc52-44fe-bc0f-8ed007e44e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:35:18.308583 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 656/1275] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:35:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:35:18.331747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07129e3-1d6d-4a7e-b90c-8e910ea0d620 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:18.428973 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07129e3-1d6d-4a7e-b90c-8e910ea0d620 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:18.461474 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec273a34-ddb7-41bb-893d-b620aa923872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:18.462253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec273a34-ddb7-41bb-893d-b620aa923872 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:18.462539 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec273a34-ddb7-41bb-893d-b620aa923872 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:18.462812 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec273a34-ddb7-41bb-893d-b620aa923872 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:18.472566 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec273a34-ddb7-41bb-893d-b620aa923872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 06:35:18.480219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-ec273a34-ddb7-41bb-893d-b620aa923872 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:35:18.480219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:18.480219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:18.480219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:18.480219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:18.480219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:18.480219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:18.480219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:18.480219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:18.480219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:18.480219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:18.480219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:18.480219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 06:35:18.480219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 06:35:18.480219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 06:35:18.480219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 06:35:18.481308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 06:35:18.481308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 06:35:18.481308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 06:35:18.481308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 06:35:18.481308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:18.481308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:18.481308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:18.481308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:18.481308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:18.481308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:18.481308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:18.481308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:35:18.481308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:18.481308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:18.481308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:18.481308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:18.482373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:18.482373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:18.482373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:18.482373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:18.482373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 06:35:18.482373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 06:35:18.482373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 06:35:18.482373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 06:35:18.482373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 06:35:18.482373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 06:35:18.482373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 06:35:18.482373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:35:18.482373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 620/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 12 06:35:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:18.487985 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caed8eb-dc52-44fe-bc0f-8ed007e44e53 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:18.582381 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caed8eb-dc52-44fe-bc0f-8ed007e44e53 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:18.614647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846d667-a19a-4cf1-961e-82e19242464d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:18.615312 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846d667-a19a-4cf1-961e-82e19242464d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:18.615588 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846d667-a19a-4cf1-961e-82e19242464d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:18.615884 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846d667-a19a-4cf1-961e-82e19242464d None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:18.619254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846d667-a19a-4cf1-961e-82e19242464d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:18.619254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846d667-a19a-4cf1-961e-82e19242464d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:18.619254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846d667-a19a-4cf1-961e-82e19242464d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:18.626465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 657/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 12 06:35:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:18.632275 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec273a34-ddb7-41bb-893d-b620aa923872 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:18.727937 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec273a34-ddb7-41bb-893d-b620aa923872 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:18.759601 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916dceaf-b7f9-4f34-b992-0a30238139c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:18.760427 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dceaf-b7f9-4f34-b992-0a30238139c2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:18.760814 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dceaf-b7f9-4f34-b992-0a30238139c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:18.761087 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dceaf-b7f9-4f34-b992-0a30238139c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:18.771066 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916dceaf-b7f9-4f34-b992-0a30238139c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:18.772527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916dceaf-b7f9-4f34-b992-0a30238139c2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:18.789787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-916dceaf-b7f9-4f34-b992-0a30238139c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:35:18.789787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:18.789787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:18.789787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:18.789787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:18.789787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:18.789787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:18.789787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:18.789787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:18.789787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:18.789787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:18.789787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:18.789787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:35:18.789787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:35:18.789787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:35:18.790865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:35:18.790865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:18.790865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:18.790865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:18.790865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:18.790865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:18.790865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:18.790865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:18.790865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:35:18.790865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:18.790865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:18.790865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:18.790865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:18.790865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:18.790865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:18.790865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:18.790865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:18.792021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:35:18.792021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:35:18.792021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:35:18.792021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:35:18.792021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 621/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:18.797235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846d667-a19a-4cf1-961e-82e19242464d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:18.890797 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846d667-a19a-4cf1-961e-82e19242464d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:18.922792 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80401b6c-1a40-489c-9716-5ce2fda4914e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:18.923444 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80401b6c-1a40-489c-9716-5ce2fda4914e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:18.923748 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80401b6c-1a40-489c-9716-5ce2fda4914e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:18.924024 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80401b6c-1a40-489c-9716-5ce2fda4914e None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:18.924741 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80401b6c-1a40-489c-9716-5ce2fda4914e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:18.925048 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80401b6c-1a40-489c-9716-5ce2fda4914e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:18.926385 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80401b6c-1a40-489c-9716-5ce2fda4914e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:18.937447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 658/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:18.943229 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916dceaf-b7f9-4f34-b992-0a30238139c2 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:19.039773 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916dceaf-b7f9-4f34-b992-0a30238139c2 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:19.071499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6492bc-b239-4bae-bd46-122f77b7b24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:19.072320 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6492bc-b239-4bae-bd46-122f77b7b24e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:19.072602 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6492bc-b239-4bae-bd46-122f77b7b24e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:19.072872 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6492bc-b239-4bae-bd46-122f77b7b24e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:19.081726 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6492bc-b239-4bae-bd46-122f77b7b24e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:19.083164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6492bc-b239-4bae-bd46-122f77b7b24e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:19.098128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-ce6492bc-b239-4bae-bd46-122f77b7b24e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 06:35:19.098128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:19.098128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:19.098128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:19.098128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:19.098128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:19.098128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:19.098128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:19.098128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:19.098128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:19.098128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:19.098128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:19.098128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 06:35:19.098128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 06:35:19.098128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 06:35:19.098128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 06:35:19.099257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:19.099257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:19.099257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 06:35:19.099257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:35:19.099257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 06:35:19.099257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 06:35:19.099257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:19.099257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:19.099257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:19.099257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:19.099257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:19.099257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:35:19.099257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:19.099257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:19.099257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:19.099257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:19.099257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:19.099257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:19.104896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:19.104896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:19.104896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 06:35:19.104896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 06:35:19.104896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 06:35:19.104896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 06:35:19.104896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 06:35:19.104896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 06:35:19.104896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 06:35:19.104896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:35:19.104896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 622/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:35:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:19.105632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80401b6c-1a40-489c-9716-5ce2fda4914e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:19.198278 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80401b6c-1a40-489c-9716-5ce2fda4914e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:19.230096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea02348-4875-47ac-be95-62f25184c47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:19.230754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea02348-4875-47ac-be95-62f25184c47d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:19.231031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea02348-4875-47ac-be95-62f25184c47d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:19.231303 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea02348-4875-47ac-be95-62f25184c47d None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:19.232165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea02348-4875-47ac-be95-62f25184c47d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:19.232470 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea02348-4875-47ac-be95-62f25184c47d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:19.233896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea02348-4875-47ac-be95-62f25184c47d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:19.249962 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 659/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Thu May 12 06:35:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:19.255585 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6492bc-b239-4bae-bd46-122f77b7b24e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:19.350549 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6492bc-b239-4bae-bd46-122f77b7b24e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:19.382470 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf9493-17bc-43c6-be31-50895b239ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:19.383109 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf9493-17bc-43c6-be31-50895b239ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:19.383406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf9493-17bc-43c6-be31-50895b239ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:19.383678 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf9493-17bc-43c6-be31-50895b239ec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:19.449107 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf9493-17bc-43c6-be31-50895b239ec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:19.450497 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf9493-17bc-43c6-be31-50895b239ec3 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:19.544466 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 623/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 12 06:35:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 06:35:19.550302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea02348-4875-47ac-be95-62f25184c47d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:19.644583 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea02348-4875-47ac-be95-62f25184c47d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:19.676647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a752c53-5c9d-4b56-960b-361ee703dd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:19.677428 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a752c53-5c9d-4b56-960b-361ee703dd2b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:19.677704 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a752c53-5c9d-4b56-960b-361ee703dd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:19.677971 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a752c53-5c9d-4b56-960b-361ee703dd2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:19.688088 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a752c53-5c9d-4b56-960b-361ee703dd2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:19.689512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a752c53-5c9d-4b56-960b-361ee703dd2b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:19.707869 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-5a752c53-5c9d-4b56-960b-361ee703dd2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:35:19.707869 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:19.707869 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:19.707869 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:19.707869 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:19.707869 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:19.707869 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:19.707869 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:19.707869 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:19.707869 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:19.707869 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:19.707869 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:19.707869 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 06:35:19.707869 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 06:35:19.707869 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 06:35:19.709051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 06:35:19.709051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:19.709051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:19.709051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:19.709051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:19.709051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:19.709051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:19.709051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:19.709051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:35:19.709051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:19.709051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:19.709051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:19.709051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:19.709051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:19.709051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:19.709051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:19.709051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:19.710316 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 06:35:19.710316 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 06:35:19.710316 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 06:35:19.710316 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:35:19.710316 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 660/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:19.714657 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf9493-17bc-43c6-be31-50895b239ec3 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:19.808872 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf9493-17bc-43c6-be31-50895b239ec3 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:19.840719 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a886e2-aaaf-4a70-9cb8-1b5a7438be3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:19.841391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a886e2-aaaf-4a70-9cb8-1b5a7438be3e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:19.841646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a886e2-aaaf-4a70-9cb8-1b5a7438be3e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:19.841917 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a886e2-aaaf-4a70-9cb8-1b5a7438be3e None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:19.842626 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a886e2-aaaf-4a70-9cb8-1b5a7438be3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:19.842927 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a886e2-aaaf-4a70-9cb8-1b5a7438be3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:19.844301 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a886e2-aaaf-4a70-9cb8-1b5a7438be3e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:19.854930 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 624/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 12 06:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:19.861140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a752c53-5c9d-4b56-960b-361ee703dd2b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:19.955513 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a752c53-5c9d-4b56-960b-361ee703dd2b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:19.988670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c37534-2e4e-4576-a8ae-1053a50bf6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:19.989405 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c37534-2e4e-4576-a8ae-1053a50bf6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:19.989664 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c37534-2e4e-4576-a8ae-1053a50bf6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:19.989931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c37534-2e4e-4576-a8ae-1053a50bf6b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:19.996358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c37534-2e4e-4576-a8ae-1053a50bf6b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:19.997782 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c37534-2e4e-4576-a8ae-1053a50bf6b8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:20.011713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-26c37534-2e4e-4576-a8ae-1053a50bf6b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:35:20.011713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:20.011713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:20.011713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:20.011713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:20.011713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:20.011713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:20.011713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:20.011713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:20.011713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:20.011713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:20.011713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:20.011713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 06:35:20.011713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 06:35:20.011713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 06:35:20.012887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 06:35:20.012887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:20.012887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:20.012887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:20.012887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:20.012887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:20.012887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:20.012887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:20.012887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 06:35:20.012887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:20.012887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:20.012887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:20.012887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:20.012887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:20.012887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:20.012887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:20.012887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:20.013973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 06:35:20.013973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 06:35:20.013973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 06:35:20.013973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 06:35:20.013973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 06:35:20.013973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 06:35:20.013973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 06:35:20.013973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 06:35:20.013973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 661/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 12 06:35:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:20.018633 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a886e2-aaaf-4a70-9cb8-1b5a7438be3e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:20.113756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a886e2-aaaf-4a70-9cb8-1b5a7438be3e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:20.145454 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27864f5e-67f1-42e6-b0a7-28c51546f210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:20.146095 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27864f5e-67f1-42e6-b0a7-28c51546f210 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:20.146377 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27864f5e-67f1-42e6-b0a7-28c51546f210 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:20.146647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27864f5e-67f1-42e6-b0a7-28c51546f210 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:20.147459 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27864f5e-67f1-42e6-b0a7-28c51546f210 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:20.147799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27864f5e-67f1-42e6-b0a7-28c51546f210 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:20.149214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27864f5e-67f1-42e6-b0a7-28c51546f210 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:20.161136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 625/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 12 06:35:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:20.167354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c37534-2e4e-4576-a8ae-1053a50bf6b8 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:20.262683 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c37534-2e4e-4576-a8ae-1053a50bf6b8 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:20.294976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e735c0-b4bb-4ef8-80a4-2f975296f9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:20.295644 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e735c0-b4bb-4ef8-80a4-2f975296f9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:20.296569 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e735c0-b4bb-4ef8-80a4-2f975296f9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:20.296858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e735c0-b4bb-4ef8-80a4-2f975296f9d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:20.297724 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e735c0-b4bb-4ef8-80a4-2f975296f9d4 None admin] RBAC: Adding query filter params (role.id=5e6a73052f3b4ee7829ecb858925e5ca, scope.project.id=57e1a8b143974111b0ba09d041b331d5, user.id=61d2edf68b1b440097981097699bb307) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:20.298035 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e735c0-b4bb-4ef8-80a4-2f975296f9d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:20.299453 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e735c0-b4bb-4ef8-80a4-2f975296f9d4 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:20.305130 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 662/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 12 06:35:20 2022] GET /identity/v3/role_assignments?user.id=61d2edf68b1b440097981097699bb307&scope.project.id=57e1a8b143974111b0ba09d041b331d5&role.id=5e6a73052f3b4ee7829ecb858925e5ca => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:22.504991 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed887dc-b54f-4243-bd34-840a6995edf0 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:22.505518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed887dc-b54f-4243-bd34-840a6995edf0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:22.505518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed887dc-b54f-4243-bd34-840a6995edf0 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:22.507019 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 626/1288] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:35:22.512485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cbaf0-7e1d-4d66-bc1f-39841efa59c1 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:22.512904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cbaf0-7e1d-4d66-bc1f-39841efa59c1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:22.513218 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cbaf0-7e1d-4d66-bc1f-39841efa59c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:22.530228 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3e8cbaf0-7e1d-4d66-bc1f-39841efa59c1 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:35:22.531609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3e8cbaf0-7e1d-4d66-bc1f-39841efa59c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:35:22.597606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 663/1289] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:35:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:35:22.620607 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed887dc-b54f-4243-bd34-840a6995edf0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:22.722762 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed887dc-b54f-4243-bd34-840a6995edf0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:22.757560 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2676e87-731e-448a-bcaf-e4ebd4e194b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:22.758321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2676e87-731e-448a-bcaf-e4ebd4e194b7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:22.758601 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2676e87-731e-448a-bcaf-e4ebd4e194b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:22.758871 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2676e87-731e-448a-bcaf-e4ebd4e194b7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:22.759523 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2676e87-731e-448a-bcaf-e4ebd4e194b7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:22.760994 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2676e87-731e-448a-bcaf-e4ebd4e194b7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:22.772923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-c2676e87-731e-448a-bcaf-e4ebd4e194b7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 06:35:22.772923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:22.772923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:35:22.772923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:35:22.772923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:35:22.772923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:35:22.772923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:35:22.772923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:35:22.772923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 06:35:22.772923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:35:22.772923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:35:22.772923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:35:22.772923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:22.772923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:22.772923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:22.772923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:22.772923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:22.774231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:22.774231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:22.774231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:22.774231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:22.774231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:22.774231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:22.774231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:35:22.774231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:35:22.774231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:35:22.774231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:35:22.774231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:22.774231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:22.774231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:22.774231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:22.774231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:22.774231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:22.775172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:22.775172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:35:22.775172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:22.775172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:22.775172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:22.775172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:22.775172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:22.775172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:22.775172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:22.775172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:22.775172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:35:22.775172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:35:22.775172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 06:35:22.775172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:35:22.775172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 627/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Thu May 12 06:35:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:22.780210 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8cbaf0-7e1d-4d66-bc1f-39841efa59c1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:22.874161 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8cbaf0-7e1d-4d66-bc1f-39841efa59c1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:22.907893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aeaa3d-fd05-4cb1-8a03-4aac02eda381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:22.908555 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeaa3d-fd05-4cb1-8a03-4aac02eda381 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:22.908839 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeaa3d-fd05-4cb1-8a03-4aac02eda381 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:22.909111 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeaa3d-fd05-4cb1-8a03-4aac02eda381 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:22.909817 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aeaa3d-fd05-4cb1-8a03-4aac02eda381 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:22.910122 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aeaa3d-fd05-4cb1-8a03-4aac02eda381 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:22.911469 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aeaa3d-fd05-4cb1-8a03-4aac02eda381 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:22.916456 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 664/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Thu May 12 06:35:22 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:22.922293 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2676e87-731e-448a-bcaf-e4ebd4e194b7 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:23.018149 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2676e87-731e-448a-bcaf-e4ebd4e194b7 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:23.049824 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e4518-9521-4870-b56b-76b5eed31e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:23.050472 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e4518-9521-4870-b56b-76b5eed31e40 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:23.050751 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e4518-9521-4870-b56b-76b5eed31e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:23.051017 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e4518-9521-4870-b56b-76b5eed31e40 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:23.051736 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e4518-9521-4870-b56b-76b5eed31e40 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:23.052033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e4518-9521-4870-b56b-76b5eed31e40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:23.053375 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e4518-9521-4870-b56b-76b5eed31e40 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:23.057565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 628/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Thu May 12 06:35:22 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:25.242036 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc492fd-e55c-4fe1-9ab4-b86033261f5e None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:25.242577 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc492fd-e55c-4fe1-9ab4-b86033261f5e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:25.242577 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc492fd-e55c-4fe1-9ab4-b86033261f5e None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:25.243981 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 665/1293] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:35:25.249428 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293a71d-e4b4-4975-96f6-a66cbb69718e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:25.249864 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293a71d-e4b4-4975-96f6-a66cbb69718e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:25.249966 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293a71d-e4b4-4975-96f6-a66cbb69718e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:25.266620 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5293a71d-e4b4-4975-96f6-a66cbb69718e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:35:25.267843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5293a71d-e4b4-4975-96f6-a66cbb69718e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:35:25.330358 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 629/1294] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:35:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:35:25.353503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc492fd-e55c-4fe1-9ab4-b86033261f5e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:25.448389 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc492fd-e55c-4fe1-9ab4-b86033261f5e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:25.480023 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc317f9-ec53-40e6-8b30-7d4578ab9348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:25.480675 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc317f9-ec53-40e6-8b30-7d4578ab9348 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:25.481042 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc317f9-ec53-40e6-8b30-7d4578ab9348 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:25.481317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc317f9-ec53-40e6-8b30-7d4578ab9348 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:25.482045 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc317f9-ec53-40e6-8b30-7d4578ab9348 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:25.483450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc317f9-ec53-40e6-8b30-7d4578ab9348 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:25.579429 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 666/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 12 06:35:25 2022] POST /identity/v3/services => generated 246 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:35:27.765308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d4d72-2069-4130-a66b-1e4eab92a76b None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:27.765841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d4d72-2069-4130-a66b-1e4eab92a76b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:27.765933 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d4d72-2069-4130-a66b-1e4eab92a76b None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:27.767243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 630/1296] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:35:27.772398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6e55c-edd3-4b9d-8587-cfa1df55ba5f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:27.776365 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6e55c-edd3-4b9d-8587-cfa1df55ba5f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:27.776365 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6e55c-edd3-4b9d-8587-cfa1df55ba5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:27.789751 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-dbc6e55c-edd3-4b9d-8587-cfa1df55ba5f None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:35:27.790908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-dbc6e55c-edd3-4b9d-8587-cfa1df55ba5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:35:27.860660 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 667/1297] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:35:27 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:35:27.883284 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d4d72-2069-4130-a66b-1e4eab92a76b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:27.980878 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d4d72-2069-4130-a66b-1e4eab92a76b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:28.012604 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4592517-dcf0-456f-bce4-1ac34ca1446e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:28.013382 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4592517-dcf0-456f-bce4-1ac34ca1446e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:28.013666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4592517-dcf0-456f-bce4-1ac34ca1446e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:28.013936 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4592517-dcf0-456f-bce4-1ac34ca1446e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:28.014588 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4592517-dcf0-456f-bce4-1ac34ca1446e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:28.016505 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4592517-dcf0-456f-bce4-1ac34ca1446e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:28.027941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-c4592517-dcf0-456f-bce4-1ac34ca1446e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 06:35:28.027941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:28.027941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:35:28.027941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:35:28.027941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:35:28.027941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:35:28.027941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:35:28.027941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:35:28.027941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 06:35:28.027941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:35:28.027941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:35:28.027941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:35:28.027941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:28.027941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:28.027941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:28.027941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:28.027941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:28.032193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:28.032193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:28.032193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:28.032193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:28.032193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:28.032193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:28.032193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:35:28.032193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:35:28.032193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:35:28.032193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:35:28.032193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:28.032193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:28.032193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:28.032193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:28.032193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:28.032193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:28.033322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:28.033322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:35:28.033322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:28.033322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:28.033322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:28.033322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:28.033322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:28.033322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:28.033322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:28.033322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:28.033322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:35:28.033322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:35:28.033322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 06:35:28.033322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:35:28.033322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 631/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Thu May 12 06:35:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:28.035732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6e55c-edd3-4b9d-8587-cfa1df55ba5f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:28.127111 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6e55c-edd3-4b9d-8587-cfa1df55ba5f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:28.159514 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07710bb5-0568-4fab-8e7a-cc35be85c1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:28.160200 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07710bb5-0568-4fab-8e7a-cc35be85c1fa None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:28.160483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07710bb5-0568-4fab-8e7a-cc35be85c1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:28.160755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07710bb5-0568-4fab-8e7a-cc35be85c1fa None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:28.161460 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07710bb5-0568-4fab-8e7a-cc35be85c1fa None admin] RBAC: Adding query filter params (name=placement) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:28.161765 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07710bb5-0568-4fab-8e7a-cc35be85c1fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:28.163373 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07710bb5-0568-4fab-8e7a-cc35be85c1fa None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:28.168338 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 668/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Thu May 12 06:35:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:28.174169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4592517-dcf0-456f-bce4-1ac34ca1446e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:28.269897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4592517-dcf0-456f-bce4-1ac34ca1446e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:28.301934 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d4d0b-6079-4ae4-819a-d061a9284b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:28.302576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d4d0b-6079-4ae4-819a-d061a9284b2a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:28.302857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d4d0b-6079-4ae4-819a-d061a9284b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:28.303126 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d4d0b-6079-4ae4-819a-d061a9284b2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:28.303934 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d4d0b-6079-4ae4-819a-d061a9284b2a None admin] RBAC: Adding query filter params (interface=public, service_id=00bd36c365b740ff904c01982c7b52e3, region_id=RegionOne) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:28.304240 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d4d0b-6079-4ae4-819a-d061a9284b2a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:28.305594 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d4d0b-6079-4ae4-819a-d061a9284b2a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:28.310401 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 632/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Thu May 12 06:35:28 2022] GET /identity/v3/endpoints?service_id=00bd36c365b740ff904c01982c7b52e3&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:28.316013 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07710bb5-0568-4fab-8e7a-cc35be85c1fa None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:28.409407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07710bb5-0568-4fab-8e7a-cc35be85c1fa None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:28.441197 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83d6bf-96c4-44da-b84f-ba9da2acc208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:28.441875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83d6bf-96c4-44da-b84f-ba9da2acc208 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:28.442152 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83d6bf-96c4-44da-b84f-ba9da2acc208 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:28.442421 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83d6bf-96c4-44da-b84f-ba9da2acc208 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:28.443090 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83d6bf-96c4-44da-b84f-ba9da2acc208 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:28.444457 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83d6bf-96c4-44da-b84f-ba9da2acc208 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:28.451084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 669/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Thu May 12 06:35:28 2022] GET /identity/v3/services => generated 2191 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:35:30.651392 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b7134-b90a-4abc-88c7-021c0e169a9a None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:30.651986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b7134-b90a-4abc-88c7-021c0e169a9a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:30.651986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b7134-b90a-4abc-88c7-021c0e169a9a None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:30.653366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 633/1302] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:35:30.659164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20483f-5216-4ceb-b1ed-3854cf00da61 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:30.670766 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20483f-5216-4ceb-b1ed-3854cf00da61 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:30.670766 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20483f-5216-4ceb-b1ed-3854cf00da61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:30.676822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-ca20483f-5216-4ceb-b1ed-3854cf00da61 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:35:30.678000 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ca20483f-5216-4ceb-b1ed-3854cf00da61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:35:30.740775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 670/1303] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:35:30 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 06:35:30.763364 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b7134-b90a-4abc-88c7-021c0e169a9a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:30.861596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b7134-b90a-4abc-88c7-021c0e169a9a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:30.892697 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4805f01-ea16-4cad-afac-89435fbe09b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:30.893471 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4805f01-ea16-4cad-afac-89435fbe09b1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:30.893747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4805f01-ea16-4cad-afac-89435fbe09b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:30.894016 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4805f01-ea16-4cad-afac-89435fbe09b1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:30.894654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4805f01-ea16-4cad-afac-89435fbe09b1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:30.896034 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4805f01-ea16-4cad-afac-89435fbe09b1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:30.908305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-a4805f01-ea16-4cad-afac-89435fbe09b1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 06:35:30.908305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:30.908305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 06:35:30.908305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 06:35:30.908305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 06:35:30.908305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 06:35:30.908305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 06:35:30.908305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:35:30.908305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 06:35:30.908305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:35:30.908305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 06:35:30.908305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:35:30.908305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 06:35:30.908305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 06:35:30.908305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 06:35:30.908305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 06:35:30.908305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 06:35:30.909509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 06:35:30.909509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 06:35:30.909509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 06:35:30.909509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 06:35:30.909509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 06:35:30.909509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 06:35:30.909509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 06:35:30.909509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 06:35:30.909509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 06:35:30.909509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 06:35:30.909509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 06:35:30.909509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 06:35:30.909509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 06:35:30.909509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 06:35:30.909509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 06:35:30.909509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 12 06:35:30.910805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 06:35:30.910805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 12 06:35:30.910805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 06:35:30.910805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 12 06:35:30.910805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 06:35:30.910805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 06:35:30.910805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 06:35:30.910805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 12 06:35:30.910805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 06:35:30.910805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 12 06:35:30.910805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 06:35:30.910805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 06:35:30.910805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 06:35:30.910805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 12 06:35:30.910805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 634/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Thu May 12 06:35:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 06:35:30.915977 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20483f-5216-4ceb-b1ed-3854cf00da61 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:31.010831 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20483f-5216-4ceb-b1ed-3854cf00da61 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:31.042962 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1c3ce-af7b-411b-8b8a-f9870e58a03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:31.043626 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1c3ce-af7b-411b-8b8a-f9870e58a03c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:31.043946 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1c3ce-af7b-411b-8b8a-f9870e58a03c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:31.044217 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1c3ce-af7b-411b-8b8a-f9870e58a03c None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:31.044926 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1c3ce-af7b-411b-8b8a-f9870e58a03c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:35:31.045231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1c3ce-af7b-411b-8b8a-f9870e58a03c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:31.047107 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1c3ce-af7b-411b-8b8a-f9870e58a03c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:31.052240 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 671/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Thu May 12 06:35:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:35:31.058020 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4805f01-ea16-4cad-afac-89435fbe09b1 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:35:31.152616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4805f01-ea16-4cad-afac-89435fbe09b1 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:35:31.184226 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384757d5-73b3-45f1-9a22-69be31c4f44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:35:31.184809 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384757d5-73b3-45f1-9a22-69be31c4f44c None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:35:31.185088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384757d5-73b3-45f1-9a22-69be31c4f44c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:35:31.185358 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384757d5-73b3-45f1-9a22-69be31c4f44c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:35:31.186084 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384757d5-73b3-45f1-9a22-69be31c4f44c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:35:31.187501 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384757d5-73b3-45f1-9a22-69be31c4f44c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:35:31.304636 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 635/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Thu May 12 06:35:31 2022] POST /identity/v3/endpoints => generated 331 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:43:06.449167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5951b-de4b-4e71-92e4-204df12628f1 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:06.449753 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5951b-de4b-4e71-92e4-204df12628f1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:06.449753 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5951b-de4b-4e71-92e4-204df12628f1 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:06.451130 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 672/1307] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:43:06.456722 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57747a-15a8-4c72-8d1c-6d6c871b52c0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:06.457182 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57747a-15a8-4c72-8d1c-6d6c871b52c0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:06.457278 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57747a-15a8-4c72-8d1c-6d6c871b52c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:06.556106 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-fa57747a-15a8-4c72-8d1c-6d6c871b52c0 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:43:06.557231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fa57747a-15a8-4c72-8d1c-6d6c871b52c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:06.685935 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 636/1308] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:43:06.738463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14950391-5d9b-4dd4-8cf9-5561018dc14a None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:06.738746 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14950391-5d9b-4dd4-8cf9-5561018dc14a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:06.739330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14950391-5d9b-4dd4-8cf9-5561018dc14a None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:06.743448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 673/1309] 10.222.0.25 () {54 vars in 964 bytes} [Thu May 12 06:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:43:06.753879 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e85c4-09dc-4d5f-ada7-98a1b8fa41b4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:06.755472 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e85c4-09dc-4d5f-ada7-98a1b8fa41b4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:06.756799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e85c4-09dc-4d5f-ada7-98a1b8fa41b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:06.843093 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7b1e85c4-09dc-4d5f-ada7-98a1b8fa41b4 None None] MFA Rules not processed for user `5a9cbec1af6545fcb34425dce87d0ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:43:06.844366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7b1e85c4-09dc-4d5f-ada7-98a1b8fa41b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:06.924630 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 637/1310] 10.222.0.25 () {58 vars in 1061 bytes} [Thu May 12 06:43:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:43:06.933928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14950391-5d9b-4dd4-8cf9-5561018dc14a None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:43:06.935920 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-14950391-5d9b-4dd4-8cf9-5561018dc14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:07.057178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14950391-5d9b-4dd4-8cf9-5561018dc14a None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:43:07.128682 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee3d84-b6e9-44ee-b938-fbf91e952ffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:43:07.129334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee3d84-b6e9-44ee-b938-fbf91e952ffe service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:07.129614 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee3d84-b6e9-44ee-b938-fbf91e952ffe service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:07.129886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee3d84-b6e9-44ee-b938-fbf91e952ffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:07.131527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-03ee3d84-b6e9-44ee-b938-fbf91e952ffe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:07.238243 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee3d84-b6e9-44ee-b938-fbf91e952ffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:43:07.239899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee3d84-b6e9-44ee-b938-fbf91e952ffe service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:43:07.259013 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 674/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:43:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:43:09.767906 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ce0ca-b6c1-48ab-8dc3-05d6eebd9b09 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:09.768356 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ce0ca-b6c1-48ab-8dc3-05d6eebd9b09 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:09.768456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ce0ca-b6c1-48ab-8dc3-05d6eebd9b09 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:09.769817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 638/1312] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:43:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:43:09.775361 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e192c-fdab-45dc-8d32-b84b7a320cfa None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:09.775793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e192c-fdab-45dc-8d32-b84b7a320cfa None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:09.775933 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e192c-fdab-45dc-8d32-b84b7a320cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:09.868824 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6b3e192c-fdab-45dc-8d32-b84b7a320cfa None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:43:09.872385 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6b3e192c-fdab-45dc-8d32-b84b7a320cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:09.970914 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 675/1313] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:43:10.008976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ce0ca-b6c1-48ab-8dc3-05d6eebd9b09 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:43:10.010621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d33ce0ca-b6c1-48ab-8dc3-05d6eebd9b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:10.112594 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ce0ca-b6c1-48ab-8dc3-05d6eebd9b09 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:43:10.182209 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcc404-bb56-4c7a-9514-b938ee730fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:43:10.182906 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcc404-bb56-4c7a-9514-b938ee730fbf service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:10.183137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcc404-bb56-4c7a-9514-b938ee730fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:10.183405 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcc404-bb56-4c7a-9514-b938ee730fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:10.185105 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-acdcc404-bb56-4c7a-9514-b938ee730fbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:10.289803 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcc404-bb56-4c7a-9514-b938ee730fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:43:10.291290 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcc404-bb56-4c7a-9514-b938ee730fbf service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:43:10.309915 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 639/1314] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:43:13.028226 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74145a-4a28-4d7e-8a53-64df5dde9470 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:13.028786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74145a-4a28-4d7e-8a53-64df5dde9470 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:13.028786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74145a-4a28-4d7e-8a53-64df5dde9470 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:13.030217 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 676/1315] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:43:13.036162 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc689628-78ef-4182-b1fb-65235ddaa1d2 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:13.036734 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc689628-78ef-4182-b1fb-65235ddaa1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:13.036734 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc689628-78ef-4182-b1fb-65235ddaa1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:13.106008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-fc689628-78ef-4182-b1fb-65235ddaa1d2 None None] MFA Rules not processed for user `dffac131970f4d20b8b06d03ca4d1883`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:43:13.107254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fc689628-78ef-4182-b1fb-65235ddaa1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:13.207891 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 640/1316] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:43:13 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:43:13.247248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74145a-4a28-4d7e-8a53-64df5dde9470 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:43:13.248722 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1a74145a-4a28-4d7e-8a53-64df5dde9470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:13.350046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74145a-4a28-4d7e-8a53-64df5dde9470 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:43:13.419301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdda6e-e946-4922-b1da-72a9660a87b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:43:13.419981 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdda6e-e946-4922-b1da-72a9660a87b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:13.420262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdda6e-e946-4922-b1da-72a9660a87b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:13.420535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdda6e-e946-4922-b1da-72a9660a87b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:13.422646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b3cdda6e-e946-4922-b1da-72a9660a87b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:13.524326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdda6e-e946-4922-b1da-72a9660a87b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:43:13.525687 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdda6e-e946-4922-b1da-72a9660a87b1 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:43:13.543136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 677/1317] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:43:13 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:43:16.627767 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274573e6-5957-4f8b-9155-7b9bae6576ee None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:16.628333 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274573e6-5957-4f8b-9155-7b9bae6576ee None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:16.628333 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274573e6-5957-4f8b-9155-7b9bae6576ee None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:16.629671 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 641/1318] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:43:16.634780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f9cc8-3408-4349-a084-af156730e95e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:16.635230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f9cc8-3408-4349-a084-af156730e95e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:16.635327 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f9cc8-3408-4349-a084-af156730e95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:16.697307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-cd9f9cc8-3408-4349-a084-af156730e95e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:43:16.698452 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-cd9f9cc8-3408-4349-a084-af156730e95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:16.790002 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 678/1319] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:43:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:43:16.827779 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274573e6-5957-4f8b-9155-7b9bae6576ee None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:43:16.829901 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-274573e6-5957-4f8b-9155-7b9bae6576ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:16.929101 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274573e6-5957-4f8b-9155-7b9bae6576ee None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:43:16.998851 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1c0d5-6985-444d-a5aa-39beb6c620f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:43:16.999492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1c0d5-6985-444d-a5aa-39beb6c620f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:16.999803 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1c0d5-6985-444d-a5aa-39beb6c620f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:17.000075 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1c0d5-6985-444d-a5aa-39beb6c620f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:17.001704 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-25e1c0d5-6985-444d-a5aa-39beb6c620f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:17.104072 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1c0d5-6985-444d-a5aa-39beb6c620f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:43:17.105488 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1c0d5-6985-444d-a5aa-39beb6c620f9 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:43:17.122363 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 642/1320] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:43:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:43:20.303664 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e578c4-0d8a-4f26-ba29-94ea0ab56c11 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:20.304569 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e578c4-0d8a-4f26-ba29-94ea0ab56c11 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:20.304856 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e578c4-0d8a-4f26-ba29-94ea0ab56c11 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:20.306281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 679/1321] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:43:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:43:20.311537 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdb8b0-45a0-4c92-b944-ec5a200b5f6b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:20.311978 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdb8b0-45a0-4c92-b944-ec5a200b5f6b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:20.312251 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdb8b0-45a0-4c92-b944-ec5a200b5f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:20.374572 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3fbdb8b0-45a0-4c92-b944-ec5a200b5f6b None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:43:20.376433 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3fbdb8b0-45a0-4c92-b944-ec5a200b5f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:20.469767 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 643/1322] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:43:20.505476 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e578c4-0d8a-4f26-ba29-94ea0ab56c11 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:43:20.506998 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-77e578c4-0d8a-4f26-ba29-94ea0ab56c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:20.605962 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e578c4-0d8a-4f26-ba29-94ea0ab56c11 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:43:20.675494 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666459e-7134-49b9-9a24-36a33689f69f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:43:20.676185 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666459e-7134-49b9-9a24-36a33689f69f service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:20.676461 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666459e-7134-49b9-9a24-36a33689f69f service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:20.676727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666459e-7134-49b9-9a24-36a33689f69f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:20.678386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8666459e-7134-49b9-9a24-36a33689f69f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:20.781612 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666459e-7134-49b9-9a24-36a33689f69f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:43:20.783107 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666459e-7134-49b9-9a24-36a33689f69f service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:43:20.801306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 680/1323] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:43:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 06:43:23.064732 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c687fd-b32d-4a1d-bbab-3c6d798ec2ab None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:23.065289 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c687fd-b32d-4a1d-bbab-3c6d798ec2ab None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:23.065289 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c687fd-b32d-4a1d-bbab-3c6d798ec2ab None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:23.066720 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 644/1324] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:43:23.072032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e3d44-3e54-49f5-a73b-578b6a09ba6a None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:23.072457 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e3d44-3e54-49f5-a73b-578b6a09ba6a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:23.072568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e3d44-3e54-49f5-a73b-578b6a09ba6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:23.135227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-512e3d44-3e54-49f5-a73b-578b6a09ba6a None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:43:23.136472 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-512e3d44-3e54-49f5-a73b-578b6a09ba6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:23.231408 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 681/1325] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:43:23.267202 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c687fd-b32d-4a1d-bbab-3c6d798ec2ab None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:43:23.268848 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-89c687fd-b32d-4a1d-bbab-3c6d798ec2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:23.367428 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c687fd-b32d-4a1d-bbab-3c6d798ec2ab None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:43:23.438468 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c41290-18f3-4053-accc-b820b5b64304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:43:23.439112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c41290-18f3-4053-accc-b820b5b64304 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:23.439387 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c41290-18f3-4053-accc-b820b5b64304 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:23.439652 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c41290-18f3-4053-accc-b820b5b64304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:23.441306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a5c41290-18f3-4053-accc-b820b5b64304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:23.545678 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c41290-18f3-4053-accc-b820b5b64304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:43:23.547613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c41290-18f3-4053-accc-b820b5b64304 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:43:23.565396 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 645/1326] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:43:25.823559 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d4c92-951c-49ca-a96f-c63e30461cf2 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:25.824125 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d4c92-951c-49ca-a96f-c63e30461cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:25.824125 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d4c92-951c-49ca-a96f-c63e30461cf2 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:25.825533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 682/1327] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:43:25.830941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74417d2c-463e-4e3c-8e4a-bac92976440e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:25.831349 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74417d2c-463e-4e3c-8e4a-bac92976440e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:25.831489 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74417d2c-463e-4e3c-8e4a-bac92976440e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:25.893477 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-74417d2c-463e-4e3c-8e4a-bac92976440e None None] MFA Rules not processed for user `dffac131970f4d20b8b06d03ca4d1883`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:43:25.894665 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-74417d2c-463e-4e3c-8e4a-bac92976440e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:25.989819 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 646/1328] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:43:25 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:43:26.025435 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d4c92-951c-49ca-a96f-c63e30461cf2 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:43:26.027032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e59d4c92-951c-49ca-a96f-c63e30461cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:26.127245 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d4c92-951c-49ca-a96f-c63e30461cf2 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:43:26.196462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913be3b8-9104-41b1-aeab-7fd8f28c944d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:43:26.197114 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913be3b8-9104-41b1-aeab-7fd8f28c944d service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:26.197395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913be3b8-9104-41b1-aeab-7fd8f28c944d service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:26.197666 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913be3b8-9104-41b1-aeab-7fd8f28c944d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:26.199318 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-913be3b8-9104-41b1-aeab-7fd8f28c944d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:26.306413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913be3b8-9104-41b1-aeab-7fd8f28c944d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:43:26.307992 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913be3b8-9104-41b1-aeab-7fd8f28c944d service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:43:26.326270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 683/1329] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:43:26 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:43:28.937528 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80554aa-6b85-4379-a82d-48381930ea0c None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:28.938038 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80554aa-6b85-4379-a82d-48381930ea0c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:28.938132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80554aa-6b85-4379-a82d-48381930ea0c None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:28.939795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 647/1330] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:43:28.945630 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cc76d-69da-4fa5-ace6-de019a9f14a1 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:28.946128 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cc76d-69da-4fa5-ace6-de019a9f14a1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:28.946300 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cc76d-69da-4fa5-ace6-de019a9f14a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:29.013888 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-5c9cc76d-69da-4fa5-ace6-de019a9f14a1 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:43:29.015101 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5c9cc76d-69da-4fa5-ace6-de019a9f14a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:29.108090 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 684/1331] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:43:29.158177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326e98c-34e5-43ac-8c9a-9140d54394a2 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:29.158456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326e98c-34e5-43ac-8c9a-9140d54394a2 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:29.158728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326e98c-34e5-43ac-8c9a-9140d54394a2 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:29.160166 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 648/1332] 10.222.0.25 () {54 vars in 964 bytes} [Thu May 12 06:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:43:29.166163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec629c30-3211-4c2e-aa05-acc7fa3fe58b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:29.166454 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec629c30-3211-4c2e-aa05-acc7fa3fe58b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:29.166729 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec629c30-3211-4c2e-aa05-acc7fa3fe58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:29.240134 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-ec629c30-3211-4c2e-aa05-acc7fa3fe58b None None] MFA Rules not processed for user `5a9cbec1af6545fcb34425dce87d0ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:43:29.241345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ec629c30-3211-4c2e-aa05-acc7fa3fe58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:29.313569 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 685/1333] 10.222.0.25 () {58 vars in 1061 bytes} [Thu May 12 06:43:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:43:29.322733 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326e98c-34e5-43ac-8c9a-9140d54394a2 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:43:29.324285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f326e98c-34e5-43ac-8c9a-9140d54394a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:29.425968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326e98c-34e5-43ac-8c9a-9140d54394a2 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:43:29.500699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda09abf-9843-413a-b7a5-18f5e0f91a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:43:29.501355 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda09abf-9843-413a-b7a5-18f5e0f91a71 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:29.501635 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda09abf-9843-413a-b7a5-18f5e0f91a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:29.502054 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda09abf-9843-413a-b7a5-18f5e0f91a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:29.503553 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-dda09abf-9843-413a-b7a5-18f5e0f91a71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:29.613043 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda09abf-9843-413a-b7a5-18f5e0f91a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:43:29.614494 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda09abf-9843-413a-b7a5-18f5e0f91a71 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:43:29.633258 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 649/1334] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:43:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:43:32.111628 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892a4bf-d260-4821-b2f4-0da26d57e5c2 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:32.112231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892a4bf-d260-4821-b2f4-0da26d57e5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:32.112231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892a4bf-d260-4821-b2f4-0da26d57e5c2 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:32.113581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 686/1335] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:43:32.118759 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c72159-4759-43ae-be25-18266f886a49 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:32.119211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c72159-4759-43ae-be25-18266f886a49 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:32.119316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c72159-4759-43ae-be25-18266f886a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:32.183392 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d7c72159-4759-43ae-be25-18266f886a49 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:43:32.184617 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d7c72159-4759-43ae-be25-18266f886a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:32.275746 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 650/1336] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:43:32.316136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892a4bf-d260-4821-b2f4-0da26d57e5c2 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:43:32.317639 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e892a4bf-d260-4821-b2f4-0da26d57e5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:32.414767 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892a4bf-d260-4821-b2f4-0da26d57e5c2 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:43:32.487349 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf577e8a-51bd-438b-ae2c-d64af66a900f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:43:32.488039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf577e8a-51bd-438b-ae2c-d64af66a900f service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:32.488464 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf577e8a-51bd-438b-ae2c-d64af66a900f service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:32.488746 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf577e8a-51bd-438b-ae2c-d64af66a900f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:32.490410 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-cf577e8a-51bd-438b-ae2c-d64af66a900f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:32.601297 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf577e8a-51bd-438b-ae2c-d64af66a900f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:43:32.602728 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf577e8a-51bd-438b-ae2c-d64af66a900f service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:43:32.619910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 687/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:43:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:43:35.688744 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe77716-2df2-49e0-87a6-fa976e99a140 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:35.689310 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe77716-2df2-49e0-87a6-fa976e99a140 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:35.689406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe77716-2df2-49e0-87a6-fa976e99a140 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:35.690875 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 651/1338] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:43:35.696046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167766b-6db0-4085-a41e-4ac3f2bd643f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:35.696470 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167766b-6db0-4085-a41e-4ac3f2bd643f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:35.696689 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167766b-6db0-4085-a41e-4ac3f2bd643f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:35.758028 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-9167766b-6db0-4085-a41e-4ac3f2bd643f None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:43:35.759207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9167766b-6db0-4085-a41e-4ac3f2bd643f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:35.851211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 688/1339] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:43:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:43:35.886454 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe77716-2df2-49e0-87a6-fa976e99a140 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:43:35.888032 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cfe77716-2df2-49e0-87a6-fa976e99a140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:35.989063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe77716-2df2-49e0-87a6-fa976e99a140 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:43:36.061186 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02174eb9-3c02-4d2f-b09d-c6431eab46ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:43:36.061856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02174eb9-3c02-4d2f-b09d-c6431eab46ee service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:36.062138 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02174eb9-3c02-4d2f-b09d-c6431eab46ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:36.062409 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02174eb9-3c02-4d2f-b09d-c6431eab46ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:36.064069 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-02174eb9-3c02-4d2f-b09d-c6431eab46ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:36.172310 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02174eb9-3c02-4d2f-b09d-c6431eab46ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:43:36.173857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02174eb9-3c02-4d2f-b09d-c6431eab46ee service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:43:36.191171 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 652/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:43:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:43:40.796953 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627a324-b0b0-48ed-9cec-9edf648d0cde None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:40.797448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627a324-b0b0-48ed-9cec-9edf648d0cde None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:40.797534 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627a324-b0b0-48ed-9cec-9edf648d0cde None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:40.798860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 689/1341] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:43:40.804187 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a324e00-c7f1-4fd8-ae0f-31cb0cb536ec None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:40.804643 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a324e00-c7f1-4fd8-ae0f-31cb0cb536ec None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:40.804754 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a324e00-c7f1-4fd8-ae0f-31cb0cb536ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:40.876128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7a324e00-c7f1-4fd8-ae0f-31cb0cb536ec None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:43:40.877349 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7a324e00-c7f1-4fd8-ae0f-31cb0cb536ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:40.981204 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 653/1342] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:43:41.019651 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627a324-b0b0-48ed-9cec-9edf648d0cde None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:43:41.021955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a627a324-b0b0-48ed-9cec-9edf648d0cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:41.112184 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627a324-b0b0-48ed-9cec-9edf648d0cde None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:43:41.115738 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e7661-e331-48d4-85bb-fb87d36e9b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:43:41.116381 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e7661-e331-48d4-85bb-fb87d36e9b89 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:41.116676 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e7661-e331-48d4-85bb-fb87d36e9b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:41.116933 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e7661-e331-48d4-85bb-fb87d36e9b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:41.126180 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e7661-e331-48d4-85bb-fb87d36e9b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:43:41.127582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e7661-e331-48d4-85bb-fb87d36e9b89 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:43:41.136706 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 690/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:43:44.275394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860951a-87e7-4d5c-9524-754bf3abdf3f None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:44.276004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860951a-87e7-4d5c-9524-754bf3abdf3f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:44.276004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860951a-87e7-4d5c-9524-754bf3abdf3f None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:44.277356 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 654/1344] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:43:44.282641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388251cf-b4e7-48ac-9979-3c2f0ade9478 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:44.283039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388251cf-b4e7-48ac-9979-3c2f0ade9478 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:44.283199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388251cf-b4e7-48ac-9979-3c2f0ade9478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:44.310422 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-388251cf-b4e7-48ac-9979-3c2f0ade9478 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:43:44.312325 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-388251cf-b4e7-48ac-9979-3c2f0ade9478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:44.386344 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 691/1345] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:43:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:43:44.423593 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860951a-87e7-4d5c-9524-754bf3abdf3f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:43:44.425368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d860951a-87e7-4d5c-9524-754bf3abdf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:44.438532 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860951a-87e7-4d5c-9524-754bf3abdf3f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:43:44.442017 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d102c5-b4b5-4df4-9836-3f377daac465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:43:44.442650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d102c5-b4b5-4df4-9836-3f377daac465 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:44.442925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d102c5-b4b5-4df4-9836-3f377daac465 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:44.443193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d102c5-b4b5-4df4-9836-3f377daac465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:44.451936 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d102c5-b4b5-4df4-9836-3f377daac465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:43:44.453349 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d102c5-b4b5-4df4-9836-3f377daac465 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:43:44.462780 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 655/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:43:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:43:48.879541 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fd95a-31d3-4d07-a3fa-d57d19792dd9 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:48.880117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fd95a-31d3-4d07-a3fa-d57d19792dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:48.880117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fd95a-31d3-4d07-a3fa-d57d19792dd9 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:48.881521 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 692/1347] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:43:48.886899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbf81e-b802-4b06-818c-c6f0e40e21c0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:48.887309 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbf81e-b802-4b06-818c-c6f0e40e21c0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:48.887473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbf81e-b802-4b06-818c-c6f0e40e21c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:48.904482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1bfbf81e-b802-4b06-818c-c6f0e40e21c0 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:43:48.905643 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1bfbf81e-b802-4b06-818c-c6f0e40e21c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:48.913651 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 656/1348] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:43:48.951595 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fd95a-31d3-4d07-a3fa-d57d19792dd9 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:43:48.962498 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fd95a-31d3-4d07-a3fa-d57d19792dd9 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:43:48.966075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d182b-8ed6-4af6-abab-59df4f43ce22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:43:48.966722 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d182b-8ed6-4af6-abab-59df4f43ce22 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:48.967006 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d182b-8ed6-4af6-abab-59df4f43ce22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:48.967283 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d182b-8ed6-4af6-abab-59df4f43ce22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:48.976428 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d182b-8ed6-4af6-abab-59df4f43ce22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:43:48.977920 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d182b-8ed6-4af6-abab-59df4f43ce22 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:43:48.989861 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 693/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:43:54.315829 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1561c-63a4-448e-a9fb-fdeb700849a2 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:54.316337 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1561c-63a4-448e-a9fb-fdeb700849a2 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:54.316442 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1561c-63a4-448e-a9fb-fdeb700849a2 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:54.317994 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 657/1350] 10.222.0.25 () {54 vars in 921 bytes} [Thu May 12 06:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:43:54.322780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7862b-fe93-40a2-8fbf-12dc0f87d68f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:54.323188 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7862b-fe93-40a2-8fbf-12dc0f87d68f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:54.323320 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7862b-fe93-40a2-8fbf-12dc0f87d68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:54.401935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e6e7862b-fe93-40a2-8fbf-12dc0f87d68f None None] MFA Rules not processed for user `61d2edf68b1b440097981097699bb307`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:43:54.401935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e6e7862b-fe93-40a2-8fbf-12dc0f87d68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:54.488644 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 694/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Thu May 12 06:43:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:43:58.801650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d80a9d-c7db-44ae-879e-1ed89d400f9c None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:58.802198 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d80a9d-c7db-44ae-879e-1ed89d400f9c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:58.802198 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d80a9d-c7db-44ae-879e-1ed89d400f9c None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:58.803846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 658/1352] 10.222.0.25 () {54 vars in 921 bytes} [Thu May 12 06:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:43:58.808936 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666aaf23-9a28-43d4-8720-4536cefbc2b9 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:43:58.809763 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666aaf23-9a28-43d4-8720-4536cefbc2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:43:58.810306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666aaf23-9a28-43d4-8720-4536cefbc2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:43:58.829803 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-666aaf23-9a28-43d4-8720-4536cefbc2b9 None None] MFA Rules not processed for user `61d2edf68b1b440097981097699bb307`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:43:58.831355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-666aaf23-9a28-43d4-8720-4536cefbc2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:43:58.841007 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 695/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Thu May 12 06:43:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:00.254460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad5e82-0ced-432c-bee5-3765a3658c95 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:00.254974 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad5e82-0ced-432c-bee5-3765a3658c95 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:00.254974 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad5e82-0ced-432c-bee5-3765a3658c95 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:00.256464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 659/1354] 10.222.0.25 () {54 vars in 921 bytes} [Thu May 12 06:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:00.261879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a3bc8-d844-47ef-9fe6-930ddd90f4ed None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:00.262369 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a3bc8-d844-47ef-9fe6-930ddd90f4ed None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:00.262455 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a3bc8-d844-47ef-9fe6-930ddd90f4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:00.281374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4f0a3bc8-d844-47ef-9fe6-930ddd90f4ed None None] MFA Rules not processed for user `61d2edf68b1b440097981097699bb307`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:00.282556 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4f0a3bc8-d844-47ef-9fe6-930ddd90f4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:00.291015 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 696/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Thu May 12 06:44:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:04.272152 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f387f-882d-4e15-ab5d-a000893f58d1 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:04.272728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f387f-882d-4e15-ab5d-a000893f58d1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:04.272728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f387f-882d-4e15-ab5d-a000893f58d1 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:04.274106 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 660/1356] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:04.280171 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c42e7-ba92-4af8-ae0e-fd1a50a5a690 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:04.280961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c42e7-ba92-4af8-ae0e-fd1a50a5a690 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:04.281241 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c42e7-ba92-4af8-ae0e-fd1a50a5a690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:04.298748 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-a76c42e7-ba92-4af8-ae0e-fd1a50a5a690 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:04.299964 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a76c42e7-ba92-4af8-ae0e-fd1a50a5a690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:04.308187 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 697/1357] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:04.356082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f2c43-a27a-4c31-a89c-eefdf87684c5 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:04.356891 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f2c43-a27a-4c31-a89c-eefdf87684c5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:04.357403 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f2c43-a27a-4c31-a89c-eefdf87684c5 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:04.358928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 661/1358] 10.222.0.25 () {54 vars in 961 bytes} [Thu May 12 06:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:04.364377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793e131-cabe-4cc0-b79a-8155355cd57d None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:04.364770 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793e131-cabe-4cc0-b79a-8155355cd57d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:04.365148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793e131-cabe-4cc0-b79a-8155355cd57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:04.413789 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-2793e131-cabe-4cc0-b79a-8155355cd57d None None] MFA Rules not processed for user `bbcd54a927bf46f183b50fbda677868d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:04.414957 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2793e131-cabe-4cc0-b79a-8155355cd57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:04.506024 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 698/1359] 10.222.0.25 () {58 vars in 1058 bytes} [Thu May 12 06:44:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:04.507156 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f2c43-a27a-4c31-a89c-eefdf87684c5 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:44:04.521855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f2c43-a27a-4c31-a89c-eefdf87684c5 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:44:04.527450 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd959a8-105e-47f7-8cf7-dedf5d730316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:44:04.528067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd959a8-105e-47f7-8cf7-dedf5d730316 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:04.528351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd959a8-105e-47f7-8cf7-dedf5d730316 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:04.529158 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd959a8-105e-47f7-8cf7-dedf5d730316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:04.537322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd959a8-105e-47f7-8cf7-dedf5d730316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:44:04.538928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd959a8-105e-47f7-8cf7-dedf5d730316 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:44:04.564048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 662/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:44:06.991088 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70540d0c-183d-4d3c-ab00-734c2a7b05b3 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:06.992144 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70540d0c-183d-4d3c-ab00-734c2a7b05b3 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:06.993231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70540d0c-183d-4d3c-ab00-734c2a7b05b3 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:06.994835 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 699/1361] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:44:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:07.000658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46392a90-8380-49db-98b1-a490402f3aa3 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:07.001089 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46392a90-8380-49db-98b1-a490402f3aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:07.001212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46392a90-8380-49db-98b1-a490402f3aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:07.019191 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-46392a90-8380-49db-98b1-a490402f3aa3 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:07.020428 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-46392a90-8380-49db-98b1-a490402f3aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:07.029291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 663/1362] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:07.071336 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70540d0c-183d-4d3c-ab00-734c2a7b05b3 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:44:07.088851 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70540d0c-183d-4d3c-ab00-734c2a7b05b3 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:44:07.095921 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27504052-5798-4033-ab4d-26b88c387df1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:44:07.096580 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27504052-5798-4033-ab4d-26b88c387df1 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:07.097016 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27504052-5798-4033-ab4d-26b88c387df1 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:07.097300 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27504052-5798-4033-ab4d-26b88c387df1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:07.106288 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27504052-5798-4033-ab4d-26b88c387df1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:44:07.108794 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27504052-5798-4033-ab4d-26b88c387df1 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:44:07.118772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 700/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:44:09.802069 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0323c-f9de-42cf-87c2-f3f5d3dc6107 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:09.802618 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0323c-f9de-42cf-87c2-f3f5d3dc6107 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:09.802618 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0323c-f9de-42cf-87c2-f3f5d3dc6107 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:09.804285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 664/1364] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:09.809890 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e460be7-a829-4e56-af4c-46c95240e770 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:09.810691 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e460be7-a829-4e56-af4c-46c95240e770 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:09.811121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e460be7-a829-4e56-af4c-46c95240e770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:09.836582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-9e460be7-a829-4e56-af4c-46c95240e770 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:09.838128 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9e460be7-a829-4e56-af4c-46c95240e770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:09.848789 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 701/1365] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:09.896110 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa4239-e030-43e6-9f60-1307150dac6e None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:09.896398 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa4239-e030-43e6-9f60-1307150dac6e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:09.896671 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa4239-e030-43e6-9f60-1307150dac6e None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:09.898174 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 665/1366] 10.222.0.25 () {54 vars in 961 bytes} [Thu May 12 06:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:09.904261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a9069-8ce3-4ac8-a6b8-39081590a142 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:09.904728 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a9069-8ce3-4ac8-a6b8-39081590a142 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:09.905008 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a9069-8ce3-4ac8-a6b8-39081590a142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:09.924118 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-9c0a9069-8ce3-4ac8-a6b8-39081590a142 None None] MFA Rules not processed for user `bbcd54a927bf46f183b50fbda677868d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:09.926746 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9c0a9069-8ce3-4ac8-a6b8-39081590a142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:09.936961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 702/1367] 10.222.0.25 () {58 vars in 1058 bytes} [Thu May 12 06:44:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:09.944786 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa4239-e030-43e6-9f60-1307150dac6e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:44:09.958989 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa4239-e030-43e6-9f60-1307150dac6e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:44:09.964633 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd3162-2cca-4a92-ae44-80aa1f6c6bb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:44:09.965345 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd3162-2cca-4a92-ae44-80aa1f6c6bb4 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:09.965632 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd3162-2cca-4a92-ae44-80aa1f6c6bb4 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:09.966451 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd3162-2cca-4a92-ae44-80aa1f6c6bb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:09.974593 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd3162-2cca-4a92-ae44-80aa1f6c6bb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:44:09.976191 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd3162-2cca-4a92-ae44-80aa1f6c6bb4 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:44:09.985305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 666/1368] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:44:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:44:12.451485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c7de0-b024-493f-b198-4e0f40d27e2e None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:12.452038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c7de0-b024-493f-b198-4e0f40d27e2e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:12.452151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c7de0-b024-493f-b198-4e0f40d27e2e None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:12.453446 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 703/1369] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:12.458912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc03f2c-eff8-47de-b382-94435d6435e1 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:12.459310 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc03f2c-eff8-47de-b382-94435d6435e1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:12.459462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc03f2c-eff8-47de-b382-94435d6435e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:12.478249 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7fc03f2c-eff8-47de-b382-94435d6435e1 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:12.479571 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7fc03f2c-eff8-47de-b382-94435d6435e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:12.488400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 667/1370] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:12.533318 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c7de0-b024-493f-b198-4e0f40d27e2e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:44:12.548156 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dc89a-895c-4253-8268-6694291fbb37 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:12.548713 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dc89a-895c-4253-8268-6694291fbb37 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:12.549118 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dc89a-895c-4253-8268-6694291fbb37 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:12.549576 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c7de0-b024-493f-b198-4e0f40d27e2e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:44:12.550698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 668/1371] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:12.555437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc8ebf-92c2-4e24-895b-fbb6b1c387cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:44:12.556147 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc8ebf-92c2-4e24-895b-fbb6b1c387cb service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:12.556553 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc8ebf-92c2-4e24-895b-fbb6b1c387cb service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:12.556826 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc8ebf-92c2-4e24-895b-fbb6b1c387cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:12.557117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c865b6-8680-406d-b08b-6960de00f837 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:12.557472 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c865b6-8680-406d-b08b-6960de00f837 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:12.558075 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c865b6-8680-406d-b08b-6960de00f837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:12.566955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc8ebf-92c2-4e24-895b-fbb6b1c387cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:44:12.568598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc8ebf-92c2-4e24-895b-fbb6b1c387cb service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:44:12.577161 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a0c865b6-8680-406d-b08b-6960de00f837 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:12.578384 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a0c865b6-8680-406d-b08b-6960de00f837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:12.580063 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 704/1372] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:44:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:44:12.590786 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 669/1373] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:44:12.860678 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25992c8d-5c45-4ecd-b6fb-8e4ab9d96435 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:12.861283 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25992c8d-5c45-4ecd-b6fb-8e4ab9d96435 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:12.861592 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25992c8d-5c45-4ecd-b6fb-8e4ab9d96435 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:12.863292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 705/1374] 10.222.0.25 () {54 vars in 963 bytes} [Thu May 12 06:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:12.869125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcc15b-528f-4141-94e1-7ed4f2607401 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:12.869416 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcc15b-528f-4141-94e1-7ed4f2607401 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:12.869688 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcc15b-528f-4141-94e1-7ed4f2607401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:12.925875 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-86bcc15b-528f-4141-94e1-7ed4f2607401 None None] MFA Rules not processed for user `4b5006e095ba41d994dca0bf581417e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:12.927217 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-86bcc15b-528f-4141-94e1-7ed4f2607401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:12.995976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 670/1375] 10.222.0.25 () {58 vars in 1060 bytes} [Thu May 12 06:44:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:13.001501 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25992c8d-5c45-4ecd-b6fb-8e4ab9d96435 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:44:13.013022 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25992c8d-5c45-4ecd-b6fb-8e4ab9d96435 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:44:13.016662 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a4ca5-7d8c-4f98-a0a7-20d2d750a55e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:44:13.017346 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a4ca5-7d8c-4f98-a0a7-20d2d750a55e service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:13.017628 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a4ca5-7d8c-4f98-a0a7-20d2d750a55e service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:13.018041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a4ca5-7d8c-4f98-a0a7-20d2d750a55e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:13.027183 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a4ca5-7d8c-4f98-a0a7-20d2d750a55e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:44:13.029194 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a4ca5-7d8c-4f98-a0a7-20d2d750a55e service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:44:13.039224 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 706/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:44:14.970491 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c11157-9b92-4704-a89e-4cdb68a2e0bf None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:14.971012 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c11157-9b92-4704-a89e-4cdb68a2e0bf None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:14.971012 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c11157-9b92-4704-a89e-4cdb68a2e0bf None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:14.972838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 671/1377] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:14.978053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd981a-23e0-4d6e-91e0-713d13ffd6a3 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:14.978500 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd981a-23e0-4d6e-91e0-713d13ffd6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:14.978680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd981a-23e0-4d6e-91e0-713d13ffd6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:14.996799 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e0dd981a-23e0-4d6e-91e0-713d13ffd6a3 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:14.998482 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e0dd981a-23e0-4d6e-91e0-713d13ffd6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:15.006283 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 707/1378] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:15.050556 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c11157-9b92-4704-a89e-4cdb68a2e0bf None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:44:15.064629 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c11157-9b92-4704-a89e-4cdb68a2e0bf None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:44:15.070275 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c281c-8ed7-453c-8bd0-c9ae4dc0d283 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:44:15.070920 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c281c-8ed7-453c-8bd0-c9ae4dc0d283 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:15.071202 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c281c-8ed7-453c-8bd0-c9ae4dc0d283 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:15.071476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c281c-8ed7-453c-8bd0-c9ae4dc0d283 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:15.079849 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c281c-8ed7-453c-8bd0-c9ae4dc0d283 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:44:15.081429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c281c-8ed7-453c-8bd0-c9ae4dc0d283 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:44:15.091494 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 672/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:44:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:44:17.459031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acfb93-7680-43e3-8284-2fa65d0c5885 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:17.459563 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acfb93-7680-43e3-8284-2fa65d0c5885 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:17.459563 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acfb93-7680-43e3-8284-2fa65d0c5885 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:17.460890 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 708/1380] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:17.466068 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11925ae-3fc0-4daf-ade8-00f545871d02 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:17.466454 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11925ae-3fc0-4daf-ade8-00f545871d02 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:17.466619 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11925ae-3fc0-4daf-ade8-00f545871d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:17.483792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d11925ae-3fc0-4daf-ade8-00f545871d02 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:17.484947 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d11925ae-3fc0-4daf-ade8-00f545871d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:17.492755 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 673/1381] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:17.536136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acfb93-7680-43e3-8284-2fa65d0c5885 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:44:17.551020 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acfb93-7680-43e3-8284-2fa65d0c5885 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:44:17.556596 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8e7ad-a33b-47b3-8772-3edd6568cf35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:44:17.557230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8e7ad-a33b-47b3-8772-3edd6568cf35 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:17.557510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8e7ad-a33b-47b3-8772-3edd6568cf35 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:17.557780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8e7ad-a33b-47b3-8772-3edd6568cf35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:17.566569 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8e7ad-a33b-47b3-8772-3edd6568cf35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:44:17.568155 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8e7ad-a33b-47b3-8772-3edd6568cf35 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:44:17.578326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 709/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:44:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:44:19.948108 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195ba04-1036-44ee-bfb8-13e7e35e55f8 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:19.948712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195ba04-1036-44ee-bfb8-13e7e35e55f8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:19.948957 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195ba04-1036-44ee-bfb8-13e7e35e55f8 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:19.950456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 674/1383] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:19.955748 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0314d-2993-410d-a9c0-2455415b0e28 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:19.956151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0314d-2993-410d-a9c0-2455415b0e28 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:19.956305 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0314d-2993-410d-a9c0-2455415b0e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:19.974788 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-37b0314d-2993-410d-a9c0-2455415b0e28 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:19.976003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-37b0314d-2993-410d-a9c0-2455415b0e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:19.984503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 710/1384] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:20.025129 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195ba04-1036-44ee-bfb8-13e7e35e55f8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:44:20.040312 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195ba04-1036-44ee-bfb8-13e7e35e55f8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:44:20.047726 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9def8-a94c-4656-a506-e6936bedf5f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:44:20.048495 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9def8-a94c-4656-a506-e6936bedf5f8 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:20.048877 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9def8-a94c-4656-a506-e6936bedf5f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:20.049394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9def8-a94c-4656-a506-e6936bedf5f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:20.060597 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9def8-a94c-4656-a506-e6936bedf5f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:44:20.062778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9def8-a94c-4656-a506-e6936bedf5f8 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:44:20.073946 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 675/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:44:22.452992 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1abb0c-be48-4be0-8472-7dbe46136b34 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:22.453483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1abb0c-be48-4be0-8472-7dbe46136b34 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:22.453576 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1abb0c-be48-4be0-8472-7dbe46136b34 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:22.454909 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 711/1386] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:22.460238 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac575e31-e64a-4d51-ab51-312d391129db None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:22.460623 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac575e31-e64a-4d51-ab51-312d391129db None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:22.460823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac575e31-e64a-4d51-ab51-312d391129db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:22.478954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ac575e31-e64a-4d51-ab51-312d391129db None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:22.480168 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ac575e31-e64a-4d51-ab51-312d391129db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:22.488448 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 676/1387] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:22.532086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1abb0c-be48-4be0-8472-7dbe46136b34 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:44:22.551295 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1abb0c-be48-4be0-8472-7dbe46136b34 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:44:22.558195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71857a-a974-4bc7-8ab9-78bd124e6944 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:44:22.558973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71857a-a974-4bc7-8ab9-78bd124e6944 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:22.559587 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71857a-a974-4bc7-8ab9-78bd124e6944 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:22.560211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71857a-a974-4bc7-8ab9-78bd124e6944 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:22.571821 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71857a-a974-4bc7-8ab9-78bd124e6944 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:44:22.573861 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71857a-a974-4bc7-8ab9-78bd124e6944 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:44:22.586049 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 712/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:44:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:44:24.992460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441fdc8-4d03-44aa-8f76-9e27e3ab400f None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:24.992971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441fdc8-4d03-44aa-8f76-9e27e3ab400f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:24.993073 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441fdc8-4d03-44aa-8f76-9e27e3ab400f None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:24.994461 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 677/1389] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:25.001134 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f093181-4b03-4a77-94bd-9782714a0e1e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:25.001583 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f093181-4b03-4a77-94bd-9782714a0e1e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:25.001840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f093181-4b03-4a77-94bd-9782714a0e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:25.021153 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-1f093181-4b03-4a77-94bd-9782714a0e1e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:25.022382 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1f093181-4b03-4a77-94bd-9782714a0e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:25.030604 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 713/1390] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:25.077111 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441fdc8-4d03-44aa-8f76-9e27e3ab400f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:44:25.091522 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441fdc8-4d03-44aa-8f76-9e27e3ab400f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:44:25.097203 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6962fe-2ad0-4b5b-8c90-6432cde1650e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:44:25.097779 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6962fe-2ad0-4b5b-8c90-6432cde1650e service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:25.098060 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6962fe-2ad0-4b5b-8c90-6432cde1650e service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:25.098331 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6962fe-2ad0-4b5b-8c90-6432cde1650e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:25.107281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6962fe-2ad0-4b5b-8c90-6432cde1650e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:44:25.109427 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6962fe-2ad0-4b5b-8c90-6432cde1650e service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:44:25.121993 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 678/1391] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:44:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:44:27.606160 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e446ca-084c-4c56-aa64-e57a9c1a6a92 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:27.606760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e446ca-084c-4c56-aa64-e57a9c1a6a92 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:27.606760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e446ca-084c-4c56-aa64-e57a9c1a6a92 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:27.608151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 714/1392] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:44:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:27.613704 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9c96b-87a4-42d8-84b9-20c2070fdab6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:27.614122 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9c96b-87a4-42d8-84b9-20c2070fdab6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:27.614260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9c96b-87a4-42d8-84b9-20c2070fdab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:27.632472 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a4d9c96b-87a4-42d8-84b9-20c2070fdab6 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:27.633691 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a4d9c96b-87a4-42d8-84b9-20c2070fdab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:27.641623 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 679/1393] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:27.685788 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e446ca-084c-4c56-aa64-e57a9c1a6a92 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:44:27.700011 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e446ca-084c-4c56-aa64-e57a9c1a6a92 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:44:27.705449 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da69190-9d56-420f-b708-5162fecc61fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:44:27.706085 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da69190-9d56-420f-b708-5162fecc61fb service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:27.706369 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da69190-9d56-420f-b708-5162fecc61fb service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:27.706642 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da69190-9d56-420f-b708-5162fecc61fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:27.715457 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da69190-9d56-420f-b708-5162fecc61fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:44:27.717066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da69190-9d56-420f-b708-5162fecc61fb service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:44:27.726471 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 715/1394] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:44:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:44:29.022347 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ccc2c-07fb-4eb4-a708-7a865a392580 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:29.022877 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ccc2c-07fb-4eb4-a708-7a865a392580 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:29.022877 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ccc2c-07fb-4eb4-a708-7a865a392580 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:29.024317 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 680/1395] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:29.029643 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4dc3a-3525-4b33-a549-b644e301459b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:29.030075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4dc3a-3525-4b33-a549-b644e301459b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:29.030178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4dc3a-3525-4b33-a549-b644e301459b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:29.049763 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e8d4dc3a-3525-4b33-a549-b644e301459b None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:29.051004 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e8d4dc3a-3525-4b33-a549-b644e301459b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:29.059741 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 716/1396] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:29.114162 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff54d2-2c7d-4a4c-9b36-ea17cdd2c7b6 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:29.114453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff54d2-2c7d-4a4c-9b36-ea17cdd2c7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:29.114727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff54d2-2c7d-4a4c-9b36-ea17cdd2c7b6 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:29.116109 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 681/1397] 10.222.0.25 () {54 vars in 962 bytes} [Thu May 12 06:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:29.121062 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e780c1-9262-4b61-a425-b00ce0674752 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:29.121969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e780c1-9262-4b61-a425-b00ce0674752 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:29.122250 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e780c1-9262-4b61-a425-b00ce0674752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:29.172434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-b8e780c1-9262-4b61-a425-b00ce0674752 None None] MFA Rules not processed for user `4a08d8e39f6f42bc9b93dd6d2311bcbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:29.173938 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b8e780c1-9262-4b61-a425-b00ce0674752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:29.233924 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 717/1398] 10.222.0.25 () {58 vars in 1059 bytes} [Thu May 12 06:44:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:29.241112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff54d2-2c7d-4a4c-9b36-ea17cdd2c7b6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:44:29.251586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff54d2-2c7d-4a4c-9b36-ea17cdd2c7b6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:44:29.255115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe1e00-0962-48fc-8d4d-c6f86b3390db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a08d8e39f6f42bc9b93dd6d2311bcbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:44:29.255776 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe1e00-0962-48fc-8d4d-c6f86b3390db service glance] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:29.256057 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe1e00-0962-48fc-8d4d-c6f86b3390db service glance] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:29.256327 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe1e00-0962-48fc-8d4d-c6f86b3390db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:29.265466 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe1e00-0962-48fc-8d4d-c6f86b3390db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:44:29.266880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe1e00-0962-48fc-8d4d-c6f86b3390db service glance] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:44:29.276060 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 682/1399] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:44:29.870143 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd22b20-b972-4f67-a108-32a74999c5d2 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:29.870539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd22b20-b972-4f67-a108-32a74999c5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:29.870878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd22b20-b972-4f67-a108-32a74999c5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:29.919867 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-cfd22b20-b972-4f67-a108-32a74999c5d2 None None] MFA Rules not processed for user `7a25a3f2c9a148a1ae73e519070b190b`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:29.921191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-cfd22b20-b972-4f67-a108-32a74999c5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:29.992325 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 718/1400] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 12 06:44:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:30.033110 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2acbe-1f02-4795-b4a4-783fafb4bb6a None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:30.033602 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2acbe-1f02-4795-b4a4-783fafb4bb6a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:30.033698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2acbe-1f02-4795-b4a4-783fafb4bb6a None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:30.035032 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 683/1401] 10.222.0.25 () {54 vars in 942 bytes} [Thu May 12 06:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:30.041190 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b21e77-aded-4eba-ae16-f5a468993089 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:30.041605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b21e77-aded-4eba-ae16-f5a468993089 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:30.041778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b21e77-aded-4eba-ae16-f5a468993089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:30.090767 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-c4b21e77-aded-4eba-ae16-f5a468993089 None None] MFA Rules not processed for user `a9882820f88349cb8fa2e3d457b19959`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:30.092011 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c4b21e77-aded-4eba-ae16-f5a468993089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:30.159675 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46a44b-21d5-40dc-b7a2-0a1b0e314e03 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:30.159918 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46a44b-21d5-40dc-b7a2-0a1b0e314e03 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:30.160173 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46a44b-21d5-40dc-b7a2-0a1b0e314e03 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:30.161531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 684/1402] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:44:30.161905 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 719/1403] 10.222.0.25 () {58 vars in 1039 bytes} [Thu May 12 06:44:30 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:30.166678 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1252ff-b561-4432-972b-b4ed333eaafc None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:30.166969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1252ff-b561-4432-972b-b4ed333eaafc None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:30.167502 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1252ff-b561-4432-972b-b4ed333eaafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:30.172551 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b21e77-aded-4eba-ae16-f5a468993089 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:44:30.182086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b21e77-aded-4eba-ae16-f5a468993089 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:44:30.186299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8b1252ff-b561-4432-972b-b4ed333eaafc None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:30.187417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269871c-e382-4a85-95bf-3ed6988c9bbf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9882820f88349cb8fa2e3d457b19959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:44:30.187565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8b1252ff-b561-4432-972b-b4ed333eaafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:30.188137 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269871c-e382-4a85-95bf-3ed6988c9bbf service swift] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:30.188416 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269871c-e382-4a85-95bf-3ed6988c9bbf service swift] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:30.188684 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269871c-e382-4a85-95bf-3ed6988c9bbf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:30.195233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 685/1404] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:30.196660 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269871c-e382-4a85-95bf-3ed6988c9bbf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:44:30.198275 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269871c-e382-4a85-95bf-3ed6988c9bbf service swift] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:44:30.206009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 720/1405] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 12 06:44:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 06:44:30.240590 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1252ff-b561-4432-972b-b4ed333eaafc None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:44:30.252935 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1252ff-b561-4432-972b-b4ed333eaafc None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:44:30.258471 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3978dd4-b722-448c-83b6-63155c241cd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:44:30.259098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3978dd4-b722-448c-83b6-63155c241cd3 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:30.259375 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3978dd4-b722-448c-83b6-63155c241cd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:30.259643 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3978dd4-b722-448c-83b6-63155c241cd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:30.267707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3978dd4-b722-448c-83b6-63155c241cd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:44:30.269315 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3978dd4-b722-448c-83b6-63155c241cd3 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:44:30.279012 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 686/1406] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:44:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:44:32.747503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a2550-a8d4-4b05-b12d-530c7c9548ee None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:32.748076 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a2550-a8d4-4b05-b12d-530c7c9548ee None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:32.748076 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a2550-a8d4-4b05-b12d-530c7c9548ee None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:32.749626 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 721/1407] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:32.754962 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8f67a-5603-4540-b6b2-1e7337979fb0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:32.755420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8f67a-5603-4540-b6b2-1e7337979fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:32.755633 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8f67a-5603-4540-b6b2-1e7337979fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:32.773912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-93a8f67a-5603-4540-b6b2-1e7337979fb0 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:32.775088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-93a8f67a-5603-4540-b6b2-1e7337979fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:32.787974 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 687/1408] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:32.835065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a2550-a8d4-4b05-b12d-530c7c9548ee None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:44:32.849764 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a2550-a8d4-4b05-b12d-530c7c9548ee None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:44:32.856069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040b4c3-95bd-4120-b43c-4e3587d8c2e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:44:32.856787 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040b4c3-95bd-4120-b43c-4e3587d8c2e2 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:32.857143 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040b4c3-95bd-4120-b43c-4e3587d8c2e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:32.857496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040b4c3-95bd-4120-b43c-4e3587d8c2e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:32.866299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040b4c3-95bd-4120-b43c-4e3587d8c2e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:44:32.868019 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040b4c3-95bd-4120-b43c-4e3587d8c2e2 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:44:32.877989 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 722/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:44:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:44:54.422935 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb78650-d90e-4d45-8317-68f0645de0ed None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:54.423527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb78650-d90e-4d45-8317-68f0645de0ed None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:54.423527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb78650-d90e-4d45-8317-68f0645de0ed None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:54.424796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 688/1410] 10.222.0.25 () {54 vars in 918 bytes} [Thu May 12 06:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:54.429956 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34153b8a-b9f1-45b7-b13a-5da4eb5b1ff0 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:54.430399 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34153b8a-b9f1-45b7-b13a-5da4eb5b1ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:54.430495 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34153b8a-b9f1-45b7-b13a-5da4eb5b1ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:54.449305 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-34153b8a-b9f1-45b7-b13a-5da4eb5b1ff0 None None] MFA Rules not processed for user `61d2edf68b1b440097981097699bb307`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:54.450513 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-34153b8a-b9f1-45b7-b13a-5da4eb5b1ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:54.458810 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 723/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Thu May 12 06:44:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:54.473383 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943b540-03df-4791-a696-0a9b6b00349a None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:54.473670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943b540-03df-4791-a696-0a9b6b00349a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:54.473938 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943b540-03df-4791-a696-0a9b6b00349a None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:54.475272 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 689/1412] 10.222.0.25 () {54 vars in 918 bytes} [Thu May 12 06:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:54.480101 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d4af0-aefd-4c51-8df4-5aa9f17f129f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:54.480390 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d4af0-aefd-4c51-8df4-5aa9f17f129f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:54.480671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d4af0-aefd-4c51-8df4-5aa9f17f129f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:54.497862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-0d4d4af0-aefd-4c51-8df4-5aa9f17f129f None None] MFA Rules not processed for user `bbcd54a927bf46f183b50fbda677868d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:54.499071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0d4d4af0-aefd-4c51-8df4-5aa9f17f129f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:54.508173 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 724/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Thu May 12 06:44:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:57.158092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08116c95-b0f7-405b-ad4f-342cf8caecc7 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:57.158644 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08116c95-b0f7-405b-ad4f-342cf8caecc7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:57.158644 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08116c95-b0f7-405b-ad4f-342cf8caecc7 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:57.160106 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 690/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 06:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:57.165498 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308db066-1505-4efb-88d5-c66710b7c763 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:57.165887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308db066-1505-4efb-88d5-c66710b7c763 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:57.165887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308db066-1505-4efb-88d5-c66710b7c763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:57.183696 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-308db066-1505-4efb-88d5-c66710b7c763 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:57.184889 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-308db066-1505-4efb-88d5-c66710b7c763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:57.193438 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 725/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 06:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:57.234142 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08116c95-b0f7-405b-ad4f-342cf8caecc7 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:44:57.247894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08116c95-b0f7-405b-ad4f-342cf8caecc7 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:44:57.253117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95c4fa-6525-4859-aacb-0345ef294d32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:44:57.253743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95c4fa-6525-4859-aacb-0345ef294d32 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:57.254019 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95c4fa-6525-4859-aacb-0345ef294d32 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:57.254288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95c4fa-6525-4859-aacb-0345ef294d32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:57.262235 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95c4fa-6525-4859-aacb-0345ef294d32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:44:57.263845 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95c4fa-6525-4859-aacb-0345ef294d32 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:44:57.273149 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 691/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:44:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:44:58.251715 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f90d6-a7bf-4cb0-88fa-2a0482cc99e5 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:58.252265 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f90d6-a7bf-4cb0-88fa-2a0482cc99e5 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:58.252265 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f90d6-a7bf-4cb0-88fa-2a0482cc99e5 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:58.253574 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 726/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 06:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:58.258596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e81a42-436a-4b88-85b2-9b9f003ccc4d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:58.259003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e81a42-436a-4b88-85b2-9b9f003ccc4d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:58.259119 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e81a42-436a-4b88-85b2-9b9f003ccc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:58.276845 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-74e81a42-436a-4b88-85b2-9b9f003ccc4d None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:58.278063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-74e81a42-436a-4b88-85b2-9b9f003ccc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:58.285761 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 692/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 06:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:58.453216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f90d6-a7bf-4cb0-88fa-2a0482cc99e5 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:44:58.467615 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f90d6-a7bf-4cb0-88fa-2a0482cc99e5 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:44:58.473010 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84ca31-2eb0-4d09-a4cc-615f5a6f06a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:44:58.473651 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84ca31-2eb0-4d09-a4cc-615f5a6f06a8 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:58.473966 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84ca31-2eb0-4d09-a4cc-615f5a6f06a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:58.474241 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84ca31-2eb0-4d09-a4cc-615f5a6f06a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:58.483104 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84ca31-2eb0-4d09-a4cc-615f5a6f06a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:44:58.484720 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84ca31-2eb0-4d09-a4cc-615f5a6f06a8 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:44:58.493726 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 727/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:44:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:44:59.440080 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738916ed-25d7-47ac-8889-221290f41848 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:59.440639 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738916ed-25d7-47ac-8889-221290f41848 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:59.440639 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738916ed-25d7-47ac-8889-221290f41848 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:59.441905 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 693/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 06:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:44:59.446688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb3b8c-4b2d-4364-93f6-8742f5dd5b91 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:59.447135 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb3b8c-4b2d-4364-93f6-8742f5dd5b91 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:59.447250 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb3b8c-4b2d-4364-93f6-8742f5dd5b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:59.465078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-90fb3b8c-4b2d-4364-93f6-8742f5dd5b91 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:44:59.466272 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-90fb3b8c-4b2d-4364-93f6-8742f5dd5b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:44:59.474237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 728/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 06:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:44:59.622738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738916ed-25d7-47ac-8889-221290f41848 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:44:59.636532 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738916ed-25d7-47ac-8889-221290f41848 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:44:59.641796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854ca23-e8f3-471d-b5c4-dd205ac83373 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:44:59.642420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854ca23-e8f3-471d-b5c4-dd205ac83373 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:44:59.642697 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854ca23-e8f3-471d-b5c4-dd205ac83373 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:44:59.642967 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854ca23-e8f3-471d-b5c4-dd205ac83373 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:44:59.650748 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854ca23-e8f3-471d-b5c4-dd205ac83373 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:44:59.652344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854ca23-e8f3-471d-b5c4-dd205ac83373 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:44:59.661257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 694/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:45:00.580009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade71f99-1f4e-4e0b-82d9-fff3c9777362 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:00.580564 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade71f99-1f4e-4e0b-82d9-fff3c9777362 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:00.580564 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade71f99-1f4e-4e0b-82d9-fff3c9777362 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:00.581915 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 729/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 06:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:45:00.586795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992b4f5-f2fe-4750-a69b-788b7674af4a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:00.587239 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992b4f5-f2fe-4750-a69b-788b7674af4a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:00.587355 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992b4f5-f2fe-4750-a69b-788b7674af4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:00.605182 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d992b4f5-f2fe-4750-a69b-788b7674af4a None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:45:00.606377 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d992b4f5-f2fe-4750-a69b-788b7674af4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:45:00.613943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 695/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 06:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:45:00.760637 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade71f99-1f4e-4e0b-82d9-fff3c9777362 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:45:00.774478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade71f99-1f4e-4e0b-82d9-fff3c9777362 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:45:00.779827 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf1a92-2a8b-4463-9274-c7a79c8481ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:45:00.780450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf1a92-2a8b-4463-9274-c7a79c8481ee service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:00.780727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf1a92-2a8b-4463-9274-c7a79c8481ee service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:00.780997 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf1a92-2a8b-4463-9274-c7a79c8481ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:00.788802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf1a92-2a8b-4463-9274-c7a79c8481ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:45:00.790342 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf1a92-2a8b-4463-9274-c7a79c8481ee service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:45:00.799759 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 730/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:45:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:45:01.714277 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4627e7-8b36-4335-9580-eb6bfa61b375 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:01.714873 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4627e7-8b36-4335-9580-eb6bfa61b375 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:01.714873 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4627e7-8b36-4335-9580-eb6bfa61b375 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:01.716257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 696/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 06:45:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:45:01.721025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88cee4-3516-46cf-a789-e86de357c232 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:01.721650 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88cee4-3516-46cf-a789-e86de357c232 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:01.721960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88cee4-3516-46cf-a789-e86de357c232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:01.740009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-0a88cee4-3516-46cf-a789-e86de357c232 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:45:01.741175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0a88cee4-3516-46cf-a789-e86de357c232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:45:01.749352 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 731/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 06:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:45:01.896683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4627e7-8b36-4335-9580-eb6bfa61b375 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:45:01.911380 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4627e7-8b36-4335-9580-eb6bfa61b375 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:45:01.916854 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94c047-0ddc-4c91-966c-c2b6f68775f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:45:01.917755 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94c047-0ddc-4c91-966c-c2b6f68775f6 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:01.918033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94c047-0ddc-4c91-966c-c2b6f68775f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:01.918303 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94c047-0ddc-4c91-966c-c2b6f68775f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:01.926256 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94c047-0ddc-4c91-966c-c2b6f68775f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:45:01.927857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94c047-0ddc-4c91-966c-c2b6f68775f6 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:45:01.936953 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 697/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:45:02.913099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f3db4-3293-44c8-932a-86e01087710b None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:02.913666 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f3db4-3293-44c8-932a-86e01087710b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:02.913666 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f3db4-3293-44c8-932a-86e01087710b None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:02.915015 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 732/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 06:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:45:02.921156 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f67649-09eb-4c9f-bfb5-e51fa7a5fded None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:02.921631 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f67649-09eb-4c9f-bfb5-e51fa7a5fded None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:02.921731 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f67649-09eb-4c9f-bfb5-e51fa7a5fded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:02.940025 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a2f67649-09eb-4c9f-bfb5-e51fa7a5fded None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:45:02.941205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a2f67649-09eb-4c9f-bfb5-e51fa7a5fded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:45:02.949016 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 698/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 06:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:45:03.097461 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f3db4-3293-44c8-932a-86e01087710b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:45:03.111921 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f3db4-3293-44c8-932a-86e01087710b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:45:03.117185 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f8fb0-f911-45e0-b9d7-274f38964a47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:45:03.117809 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f8fb0-f911-45e0-b9d7-274f38964a47 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:03.118086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f8fb0-f911-45e0-b9d7-274f38964a47 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:03.118356 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f8fb0-f911-45e0-b9d7-274f38964a47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:03.126215 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f8fb0-f911-45e0-b9d7-274f38964a47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:45:03.127802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f8fb0-f911-45e0-b9d7-274f38964a47 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:45:03.136798 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 733/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:45:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:45:04.207560 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cae06f-e6fc-4f0e-beb3-6d6541763d8c None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:04.208157 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cae06f-e6fc-4f0e-beb3-6d6541763d8c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:04.208157 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cae06f-e6fc-4f0e-beb3-6d6541763d8c None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:04.209501 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 699/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 06:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:45:04.214703 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b7546-9f4c-4350-a52f-8a07ba36afb5 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:04.215113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b7546-9f4c-4350-a52f-8a07ba36afb5 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:04.215254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b7546-9f4c-4350-a52f-8a07ba36afb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:04.232993 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f04b7546-9f4c-4350-a52f-8a07ba36afb5 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:45:04.234197 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f04b7546-9f4c-4350-a52f-8a07ba36afb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:45:04.242123 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 734/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 06:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:45:04.390854 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cae06f-e6fc-4f0e-beb3-6d6541763d8c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:45:04.405015 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cae06f-e6fc-4f0e-beb3-6d6541763d8c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:45:04.410342 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f15f5-c171-46bb-abe7-b7075adb4fc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:45:04.410970 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f15f5-c171-46bb-abe7-b7075adb4fc2 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:04.411252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f15f5-c171-46bb-abe7-b7075adb4fc2 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:04.411522 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f15f5-c171-46bb-abe7-b7075adb4fc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:04.420154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f15f5-c171-46bb-abe7-b7075adb4fc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:45:04.421712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f15f5-c171-46bb-abe7-b7075adb4fc2 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:45:04.430770 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 700/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:45:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:45:05.355812 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143de70-2080-433a-a2af-b5cf348ff545 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:05.356341 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143de70-2080-433a-a2af-b5cf348ff545 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:05.356341 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143de70-2080-433a-a2af-b5cf348ff545 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:05.357720 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 735/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 06:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:45:05.362654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc883d9d-676b-45a1-9394-2d794b94099c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:05.363056 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc883d9d-676b-45a1-9394-2d794b94099c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:05.363208 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc883d9d-676b-45a1-9394-2d794b94099c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:05.380994 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-cc883d9d-676b-45a1-9394-2d794b94099c None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:45:05.382168 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cc883d9d-676b-45a1-9394-2d794b94099c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:45:05.390466 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 701/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 06:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:45:05.536742 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143de70-2080-433a-a2af-b5cf348ff545 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:45:05.550741 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143de70-2080-433a-a2af-b5cf348ff545 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:45:05.556028 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3560e-fa50-4b94-aa9b-e05efd876655 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:45:05.557155 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3560e-fa50-4b94-aa9b-e05efd876655 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:05.557432 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3560e-fa50-4b94-aa9b-e05efd876655 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:05.557702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3560e-fa50-4b94-aa9b-e05efd876655 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:05.565482 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3560e-fa50-4b94-aa9b-e05efd876655 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:45:05.567029 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3560e-fa50-4b94-aa9b-e05efd876655 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:45:05.576687 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 736/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:45:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:45:06.481549 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a947e5-76f2-4f4a-8475-0af687326c8e None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:06.482020 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a947e5-76f2-4f4a-8475-0af687326c8e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:06.482127 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a947e5-76f2-4f4a-8475-0af687326c8e None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:06.483471 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 702/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 06:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:45:06.488286 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e0869-dff0-4168-a362-8ee43b4b2897 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:06.488722 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e0869-dff0-4168-a362-8ee43b4b2897 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:06.488844 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e0869-dff0-4168-a362-8ee43b4b2897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:06.506127 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-312e0869-dff0-4168-a362-8ee43b4b2897 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:45:06.507300 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-312e0869-dff0-4168-a362-8ee43b4b2897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:45:06.515528 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 737/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 06:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:45:06.664561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a947e5-76f2-4f4a-8475-0af687326c8e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:45:06.679459 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a947e5-76f2-4f4a-8475-0af687326c8e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:45:06.685482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298b5c2-08ab-455c-b7d1-34227566a3c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:45:06.686113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298b5c2-08ab-455c-b7d1-34227566a3c1 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:06.686399 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298b5c2-08ab-455c-b7d1-34227566a3c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:06.686677 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298b5c2-08ab-455c-b7d1-34227566a3c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:06.694802 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298b5c2-08ab-455c-b7d1-34227566a3c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:45:06.696404 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298b5c2-08ab-455c-b7d1-34227566a3c1 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:45:06.705632 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 703/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:45:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:45:08.773499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e6ebb-0ee1-40c9-8356-7fa587ec49bd None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:08.774055 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e6ebb-0ee1-40c9-8356-7fa587ec49bd None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:08.774055 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e6ebb-0ee1-40c9-8356-7fa587ec49bd None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:08.775449 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 738/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 06:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:45:08.780666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434f816-38cc-4c8c-a3af-0431086841a8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:08.781071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434f816-38cc-4c8c-a3af-0431086841a8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:08.781334 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434f816-38cc-4c8c-a3af-0431086841a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:08.799224 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4434f816-38cc-4c8c-a3af-0431086841a8 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:45:08.800457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4434f816-38cc-4c8c-a3af-0431086841a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:45:08.808937 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 704/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 06:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:45:08.845708 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e6ebb-0ee1-40c9-8356-7fa587ec49bd None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:45:08.856694 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e6ebb-0ee1-40c9-8356-7fa587ec49bd None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:45:08.860207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4f32a-aeaf-4a88-af76-385e72933b7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:45:08.860834 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4f32a-aeaf-4a88-af76-385e72933b7f service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:08.861111 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4f32a-aeaf-4a88-af76-385e72933b7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:08.861380 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4f32a-aeaf-4a88-af76-385e72933b7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:08.870624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4f32a-aeaf-4a88-af76-385e72933b7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:45:08.872068 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4f32a-aeaf-4a88-af76-385e72933b7f service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:45:08.881256 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 739/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:45:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:45:11.217185 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e820db8-8bbf-4402-920e-a6826c9ea6ab None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:11.217752 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e820db8-8bbf-4402-920e-a6826c9ea6ab None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:11.217752 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e820db8-8bbf-4402-920e-a6826c9ea6ab None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:11.219097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 705/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 06:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:45:11.224248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15136052-d1bd-41fa-89a5-795374bf2bfc None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:11.224674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15136052-d1bd-41fa-89a5-795374bf2bfc None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:11.224784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15136052-d1bd-41fa-89a5-795374bf2bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:11.242337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-15136052-d1bd-41fa-89a5-795374bf2bfc None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:45:11.243452 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-15136052-d1bd-41fa-89a5-795374bf2bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:45:11.251108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 740/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 06:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:45:11.287825 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e820db8-8bbf-4402-920e-a6826c9ea6ab None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:45:11.299023 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e820db8-8bbf-4402-920e-a6826c9ea6ab None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:45:11.302486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8300aa-87c0-4dcc-965a-f994887f5633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:45:11.303114 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8300aa-87c0-4dcc-965a-f994887f5633 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:11.303394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8300aa-87c0-4dcc-965a-f994887f5633 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:11.303666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8300aa-87c0-4dcc-965a-f994887f5633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:11.312308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8300aa-87c0-4dcc-965a-f994887f5633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:45:11.313728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8300aa-87c0-4dcc-965a-f994887f5633 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:45:11.322818 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 706/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:45:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:45:14.107018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec05ff-27ec-4425-921e-59b4a7aaaec7 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:14.107018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec05ff-27ec-4425-921e-59b4a7aaaec7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:14.107018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec05ff-27ec-4425-921e-59b4a7aaaec7 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:14.107018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 741/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 06:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:45:14.107843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590be3e-c886-4667-bce9-c813e0111b58 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:14.107843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590be3e-c886-4667-bce9-c813e0111b58 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:14.107843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590be3e-c886-4667-bce9-c813e0111b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:14.107843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1590be3e-c886-4667-bce9-c813e0111b58 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:45:14.107843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1590be3e-c886-4667-bce9-c813e0111b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:45:14.115606 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 707/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 06:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:45:14.154134 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec05ff-27ec-4425-921e-59b4a7aaaec7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:45:14.165046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec05ff-27ec-4425-921e-59b4a7aaaec7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:45:14.168757 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e99f0f-209c-4a49-a567-f7e848ba20a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:45:14.169377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e99f0f-209c-4a49-a567-f7e848ba20a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:14.169654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e99f0f-209c-4a49-a567-f7e848ba20a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:14.169921 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e99f0f-209c-4a49-a567-f7e848ba20a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:14.178549 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e99f0f-209c-4a49-a567-f7e848ba20a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:45:14.180054 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e99f0f-209c-4a49-a567-f7e848ba20a2 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:45:14.189613 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 742/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:45:16.563191 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00909eaa-4932-493a-bcc7-a1dd0dc23ed8 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:16.563750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00909eaa-4932-493a-bcc7-a1dd0dc23ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:16.563750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00909eaa-4932-493a-bcc7-a1dd0dc23ed8 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:16.565114 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 708/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 06:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:45:16.570370 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9338372-3596-4196-8286-861c7f238833 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:16.570770 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9338372-3596-4196-8286-861c7f238833 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:16.570956 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9338372-3596-4196-8286-861c7f238833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:16.589039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-a9338372-3596-4196-8286-861c7f238833 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:45:16.590223 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a9338372-3596-4196-8286-861c7f238833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:45:16.597979 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 743/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 06:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:45:16.636004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00909eaa-4932-493a-bcc7-a1dd0dc23ed8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:45:16.646392 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00909eaa-4932-493a-bcc7-a1dd0dc23ed8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:45:16.650419 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b2fde-4057-4211-b79f-31dfdf68d841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:45:16.651044 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b2fde-4057-4211-b79f-31dfdf68d841 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:16.651327 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b2fde-4057-4211-b79f-31dfdf68d841 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:16.651599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b2fde-4057-4211-b79f-31dfdf68d841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:16.660187 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b2fde-4057-4211-b79f-31dfdf68d841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:45:16.661604 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b2fde-4057-4211-b79f-31dfdf68d841 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:45:16.671545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 709/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:45:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:45:18.922636 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6f924-5faf-48a2-9ce9-627d27a1c442 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:18.923201 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6f924-5faf-48a2-9ce9-627d27a1c442 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:18.923201 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6f924-5faf-48a2-9ce9-627d27a1c442 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:18.924578 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 744/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 06:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:45:18.929758 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2c824-2bbc-45da-bb20-3d8b5992739e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:18.930183 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2c824-2bbc-45da-bb20-3d8b5992739e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:18.930305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2c824-2bbc-45da-bb20-3d8b5992739e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:18.947295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-81c2c824-2bbc-45da-bb20-3d8b5992739e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:45:18.948514 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-81c2c824-2bbc-45da-bb20-3d8b5992739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:45:18.956206 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 710/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 06:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:45:18.993833 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6f924-5faf-48a2-9ce9-627d27a1c442 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:45:19.004419 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6f924-5faf-48a2-9ce9-627d27a1c442 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:45:19.007860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143574f-f563-41c1-93f6-2ad37ef95d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:45:19.008486 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143574f-f563-41c1-93f6-2ad37ef95d6c service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:19.008765 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143574f-f563-41c1-93f6-2ad37ef95d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:19.009062 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143574f-f563-41c1-93f6-2ad37ef95d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:19.017683 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143574f-f563-41c1-93f6-2ad37ef95d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:45:19.019079 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143574f-f563-41c1-93f6-2ad37ef95d6c service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:45:19.028710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 745/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:45:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:45:21.253807 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766219a-7cb9-48cc-89d4-436a2b1e2b1d None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:21.254333 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766219a-7cb9-48cc-89d4-436a2b1e2b1d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:21.254333 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766219a-7cb9-48cc-89d4-436a2b1e2b1d None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:21.255635 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 711/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 06:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:45:21.261458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7290c-7e24-4f3c-b8e0-4548e6d330f8 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:21.261866 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7290c-7e24-4f3c-b8e0-4548e6d330f8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:21.262019 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7290c-7e24-4f3c-b8e0-4548e6d330f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:21.279130 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-9cf7290c-7e24-4f3c-b8e0-4548e6d330f8 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:45:21.280344 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9cf7290c-7e24-4f3c-b8e0-4548e6d330f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:45:21.288026 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 746/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 06:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:45:21.325464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766219a-7cb9-48cc-89d4-436a2b1e2b1d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:45:21.335920 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766219a-7cb9-48cc-89d4-436a2b1e2b1d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:45:21.339427 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7af72-c300-4a83-9b89-d9108f4fbbd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:45:21.340089 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7af72-c300-4a83-9b89-d9108f4fbbd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:21.340369 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7af72-c300-4a83-9b89-d9108f4fbbd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:21.340640 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7af72-c300-4a83-9b89-d9108f4fbbd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:21.349152 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7af72-c300-4a83-9b89-d9108f4fbbd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:45:21.350580 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7af72-c300-4a83-9b89-d9108f4fbbd5 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:45:21.360296 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 712/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:45:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:45:23.599160 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d435e-bd33-4a40-a610-1b54ac28fb9e None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:23.599727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d435e-bd33-4a40-a610-1b54ac28fb9e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:23.599727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d435e-bd33-4a40-a610-1b54ac28fb9e None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:23.601136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 747/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 06:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:45:23.606502 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23f6c2-6d4e-47aa-8d22-a7d8c3f99110 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:23.606895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23f6c2-6d4e-47aa-8d22-a7d8c3f99110 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:23.607065 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23f6c2-6d4e-47aa-8d22-a7d8c3f99110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:23.624191 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-df23f6c2-6d4e-47aa-8d22-a7d8c3f99110 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:45:23.625377 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-df23f6c2-6d4e-47aa-8d22-a7d8c3f99110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:45:23.633027 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 713/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 06:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:45:23.670156 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d435e-bd33-4a40-a610-1b54ac28fb9e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:45:23.680893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d435e-bd33-4a40-a610-1b54ac28fb9e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:45:23.684483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02945bdc-e407-4c7f-b688-faf2f5513441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:45:23.685119 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02945bdc-e407-4c7f-b688-faf2f5513441 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:23.685405 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02945bdc-e407-4c7f-b688-faf2f5513441 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:23.685681 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02945bdc-e407-4c7f-b688-faf2f5513441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:23.694414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02945bdc-e407-4c7f-b688-faf2f5513441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:45:23.695860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02945bdc-e407-4c7f-b688-faf2f5513441 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:45:23.705599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 748/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:45:25.932833 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18c1fd-30a3-4315-8940-58eef164ad70 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:25.933414 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18c1fd-30a3-4315-8940-58eef164ad70 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:25.933414 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18c1fd-30a3-4315-8940-58eef164ad70 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:25.934718 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 714/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 06:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:45:25.939914 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0b1cb-cad1-4612-bf31-1a6881810f04 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:25.940336 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0b1cb-cad1-4612-bf31-1a6881810f04 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:25.940495 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0b1cb-cad1-4612-bf31-1a6881810f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:25.958545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-59a0b1cb-cad1-4612-bf31-1a6881810f04 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:45:25.959751 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-59a0b1cb-cad1-4612-bf31-1a6881810f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:45:25.967654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 749/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 06:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:45:26.004650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18c1fd-30a3-4315-8940-58eef164ad70 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:45:26.015631 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18c1fd-30a3-4315-8940-58eef164ad70 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:45:26.019082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9eb2ec-9eba-4e89-9b2d-13450cf04ca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:45:26.019733 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9eb2ec-9eba-4e89-9b2d-13450cf04ca9 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:26.020018 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9eb2ec-9eba-4e89-9b2d-13450cf04ca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:26.020289 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9eb2ec-9eba-4e89-9b2d-13450cf04ca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:26.028827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9eb2ec-9eba-4e89-9b2d-13450cf04ca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:45:26.030227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9eb2ec-9eba-4e89-9b2d-13450cf04ca9 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:45:26.039212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 715/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:45:28.288747 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f316724-40e0-478d-b59b-3c071105d9d3 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:28.289306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f316724-40e0-478d-b59b-3c071105d9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:28.289306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f316724-40e0-478d-b59b-3c071105d9d3 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:28.291267 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 750/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 06:45:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:45:28.297008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a1a86-f620-4e82-9e91-00b5b2522477 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:28.297454 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a1a86-f620-4e82-9e91-00b5b2522477 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:28.297561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a1a86-f620-4e82-9e91-00b5b2522477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:28.314572 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-724a1a86-f620-4e82-9e91-00b5b2522477 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:45:28.315780 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-724a1a86-f620-4e82-9e91-00b5b2522477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:45:28.323411 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 716/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 06:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:45:28.359444 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f316724-40e0-478d-b59b-3c071105d9d3 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:45:28.369759 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f316724-40e0-478d-b59b-3c071105d9d3 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:45:28.373261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdcbea-0627-4486-ac2e-98a983e08f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:45:28.373888 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdcbea-0627-4486-ac2e-98a983e08f8c service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:28.374166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdcbea-0627-4486-ac2e-98a983e08f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:28.374434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdcbea-0627-4486-ac2e-98a983e08f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:28.382949 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdcbea-0627-4486-ac2e-98a983e08f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:45:28.384392 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdcbea-0627-4486-ac2e-98a983e08f8c service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:45:28.393373 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 751/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:45:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:45:30.587245 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2acf68-bd91-40de-9a7d-696f8bf38502 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:30.587843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2acf68-bd91-40de-9a7d-696f8bf38502 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:30.587843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2acf68-bd91-40de-9a7d-696f8bf38502 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:30.589161 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 717/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 06:45:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:45:30.594361 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5ffa4-b019-4545-8632-e676c38c639e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:30.594767 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5ffa4-b019-4545-8632-e676c38c639e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:30.594917 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5ffa4-b019-4545-8632-e676c38c639e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:30.612732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-63c5ffa4-b019-4545-8632-e676c38c639e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:45:30.613914 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-63c5ffa4-b019-4545-8632-e676c38c639e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:45:30.621593 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 752/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 06:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:45:30.657176 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2acf68-bd91-40de-9a7d-696f8bf38502 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:45:30.668405 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2acf68-bd91-40de-9a7d-696f8bf38502 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:45:30.671868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d2016-4bd2-45a5-98f5-a70827599ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:45:30.672495 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d2016-4bd2-45a5-98f5-a70827599ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:45:30.672772 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d2016-4bd2-45a5-98f5-a70827599ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:45:30.673071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d2016-4bd2-45a5-98f5-a70827599ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:45:30.681765 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d2016-4bd2-45a5-98f5-a70827599ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:45:30.683166 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d2016-4bd2-45a5-98f5-a70827599ce6 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:45:30.692178 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 718/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:45:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:46:03.843515 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627cd7a-6675-4d4a-8ba1-91797ff24e50 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:03.844107 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627cd7a-6675-4d4a-8ba1-91797ff24e50 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:03.844107 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627cd7a-6675-4d4a-8ba1-91797ff24e50 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:03.845385 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 753/1471] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:46:03.850980 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d6da9-72bf-4575-aa2f-36c3376adff2 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:03.851413 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d6da9-72bf-4575-aa2f-36c3376adff2 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:03.851518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d6da9-72bf-4575-aa2f-36c3376adff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:03.869289 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-303d6da9-72bf-4575-aa2f-36c3376adff2 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:46:03.870579 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-303d6da9-72bf-4575-aa2f-36c3376adff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:46:03.878252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 719/1472] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:46:03.924870 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bde64-04eb-4327-bca3-b295a235755c None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:03.925157 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bde64-04eb-4327-bca3-b295a235755c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:03.925434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bde64-04eb-4327-bca3-b295a235755c None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:03.926851 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 754/1473] 10.222.0.25 () {54 vars in 962 bytes} [Thu May 12 06:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:46:03.932237 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14c10a-8b17-44df-9f4e-3ce291a455f2 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:03.932527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14c10a-8b17-44df-9f4e-3ce291a455f2 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:03.932804 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14c10a-8b17-44df-9f4e-3ce291a455f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:03.950863 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1b14c10a-8b17-44df-9f4e-3ce291a455f2 None None] MFA Rules not processed for user `4a08d8e39f6f42bc9b93dd6d2311bcbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:46:03.952066 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1b14c10a-8b17-44df-9f4e-3ce291a455f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:46:03.958469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 720/1474] 10.222.0.25 () {58 vars in 1059 bytes} [Thu May 12 06:46:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:46:03.965553 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bde64-04eb-4327-bca3-b295a235755c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:46:03.976711 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bde64-04eb-4327-bca3-b295a235755c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:46:03.980173 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41dd727-54c7-451a-a5f0-609c47329e5e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a08d8e39f6f42bc9b93dd6d2311bcbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:46:03.980793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dd727-54c7-451a-a5f0-609c47329e5e service glance] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:03.981102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dd727-54c7-451a-a5f0-609c47329e5e service glance] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:03.981371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dd727-54c7-451a-a5f0-609c47329e5e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:03.990076 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41dd727-54c7-451a-a5f0-609c47329e5e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:46:03.992362 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41dd727-54c7-451a-a5f0-609c47329e5e service glance] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:46:04.001432 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 755/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:46:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 06:46:06.296840 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e0545-cae9-4bb9-9dbc-ebcbf0677dab None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:06.297383 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e0545-cae9-4bb9-9dbc-ebcbf0677dab None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:06.297383 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e0545-cae9-4bb9-9dbc-ebcbf0677dab None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:06.298665 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 721/1476] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:46:06.304445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7801b-a623-4ee6-a3da-9f7d72f194e7 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:06.304900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7801b-a623-4ee6-a3da-9f7d72f194e7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:06.305011 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7801b-a623-4ee6-a3da-9f7d72f194e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:06.322753 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-81e7801b-a623-4ee6-a3da-9f7d72f194e7 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:46:06.323973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-81e7801b-a623-4ee6-a3da-9f7d72f194e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:46:06.331573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 756/1477] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:46:06.355108 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e0545-cae9-4bb9-9dbc-ebcbf0677dab None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:46:06.367820 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e0545-cae9-4bb9-9dbc-ebcbf0677dab None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:46:06.372220 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49f291-280b-46d5-b3b3-457542cdd480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:46:06.372853 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49f291-280b-46d5-b3b3-457542cdd480 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:06.373133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49f291-280b-46d5-b3b3-457542cdd480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:06.373405 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49f291-280b-46d5-b3b3-457542cdd480 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:06.374133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49f291-280b-46d5-b3b3-457542cdd480 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:46:06.375929 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: WARNING py.warnings [None req-5b49f291-280b-46d5-b3b3-457542cdd480 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 06:46:06.375929 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: warnings.warn(msg) May 12 06:46:06.375929 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: May 12 06:46:06.377063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49f291-280b-46d5-b3b3-457542cdd480 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:46:06.395460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 722/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 12 06:46:06 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:46:08.629973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f53b1-39ad-44fe-99ae-7e8e99645740 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:08.630520 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f53b1-39ad-44fe-99ae-7e8e99645740 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:08.630520 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f53b1-39ad-44fe-99ae-7e8e99645740 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:08.631928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 757/1479] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:46:08.637104 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec6bd6-208d-4db1-bd97-66c4dcebbe9a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:08.637511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec6bd6-208d-4db1-bd97-66c4dcebbe9a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:08.637680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec6bd6-208d-4db1-bd97-66c4dcebbe9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:08.655628 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3aec6bd6-208d-4db1-bd97-66c4dcebbe9a None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:46:08.656863 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3aec6bd6-208d-4db1-bd97-66c4dcebbe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:46:08.665269 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 723/1480] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:46:08.706285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f53b1-39ad-44fe-99ae-7e8e99645740 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:46:08.722476 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f53b1-39ad-44fe-99ae-7e8e99645740 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:46:08.728502 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d1f39-6d8c-4678-b1cc-122cdfd9ca39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:46:08.729136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d1f39-6d8c-4678-b1cc-122cdfd9ca39 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:08.729414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d1f39-6d8c-4678-b1cc-122cdfd9ca39 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:08.729684 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d1f39-6d8c-4678-b1cc-122cdfd9ca39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:08.737649 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d1f39-6d8c-4678-b1cc-122cdfd9ca39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:46:08.739154 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d1f39-6d8c-4678-b1cc-122cdfd9ca39 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:46:08.748304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 758/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:46:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:46:11.138991 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e887c-aa49-4dd2-88eb-ea1a1210e660 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:11.139547 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e887c-aa49-4dd2-88eb-ea1a1210e660 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:11.139547 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e887c-aa49-4dd2-88eb-ea1a1210e660 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:11.140938 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 724/1482] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:46:11.146295 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ce24f-c659-4c17-815f-d14aef82b94e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:11.146766 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ce24f-c659-4c17-815f-d14aef82b94e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:11.146885 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ce24f-c659-4c17-815f-d14aef82b94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:11.163847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-2b8ce24f-c659-4c17-815f-d14aef82b94e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:46:11.165020 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2b8ce24f-c659-4c17-815f-d14aef82b94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:46:11.172899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 759/1483] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:46:11.209467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e887c-aa49-4dd2-88eb-ea1a1210e660 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:46:11.220276 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e887c-aa49-4dd2-88eb-ea1a1210e660 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:46:11.223957 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb18bbd-b982-4d4a-bce3-cd537c75d7c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:46:11.224619 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb18bbd-b982-4d4a-bce3-cd537c75d7c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:11.224932 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb18bbd-b982-4d4a-bce3-cd537c75d7c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:11.225206 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb18bbd-b982-4d4a-bce3-cd537c75d7c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:11.233938 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb18bbd-b982-4d4a-bce3-cd537c75d7c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:46:11.235369 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb18bbd-b982-4d4a-bce3-cd537c75d7c2 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:46:11.245138 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 725/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:46:13.489688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5fe5e-9599-4ceb-b37a-389ba3a29042 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:13.490199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5fe5e-9599-4ceb-b37a-389ba3a29042 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:13.490199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5fe5e-9599-4ceb-b37a-389ba3a29042 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:13.492110 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 760/1485] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:46:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:46:13.497202 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87365c29-0496-43f8-9b28-8d7074ce87d1 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:13.497664 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87365c29-0496-43f8-9b28-8d7074ce87d1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:13.497776 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87365c29-0496-43f8-9b28-8d7074ce87d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:13.515878 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-87365c29-0496-43f8-9b28-8d7074ce87d1 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:46:13.517049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-87365c29-0496-43f8-9b28-8d7074ce87d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:46:13.524606 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 726/1486] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:46:13.562998 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5fe5e-9599-4ceb-b37a-389ba3a29042 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:46:13.573588 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5fe5e-9599-4ceb-b37a-389ba3a29042 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:46:13.577117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebfdd6-55f2-47fd-90a2-2ad02758f84f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:46:13.577745 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebfdd6-55f2-47fd-90a2-2ad02758f84f service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:13.578030 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebfdd6-55f2-47fd-90a2-2ad02758f84f service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:13.578306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebfdd6-55f2-47fd-90a2-2ad02758f84f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:13.586932 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aebfdd6-55f2-47fd-90a2-2ad02758f84f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:46:13.588395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aebfdd6-55f2-47fd-90a2-2ad02758f84f service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:46:13.597509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 761/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:46:15.947709 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eefae-3eec-4cc4-83e4-025990c8b16b None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:15.948357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eefae-3eec-4cc4-83e4-025990c8b16b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:15.948357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eefae-3eec-4cc4-83e4-025990c8b16b None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:15.949678 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 727/1488] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 06:46:15.954997 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1bc29-5867-45ab-849d-cac75f88e1d6 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:15.955406 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1bc29-5867-45ab-849d-cac75f88e1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:15.955549 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1bc29-5867-45ab-849d-cac75f88e1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:15.972850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-eaa1bc29-5867-45ab-849d-cac75f88e1d6 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:46:15.974048 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-eaa1bc29-5867-45ab-849d-cac75f88e1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:46:15.982645 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 762/1489] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:46:16.022258 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0eefae-3eec-4cc4-83e4-025990c8b16b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:46:16.032680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0eefae-3eec-4cc4-83e4-025990c8b16b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:46:16.036196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2ce90-d667-49ef-8fae-e5c5770fdea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:46:16.036831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2ce90-d667-49ef-8fae-e5c5770fdea3 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:16.037641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2ce90-d667-49ef-8fae-e5c5770fdea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:16.037913 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2ce90-d667-49ef-8fae-e5c5770fdea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:16.046808 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2ce90-d667-49ef-8fae-e5c5770fdea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:46:16.048250 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2ce90-d667-49ef-8fae-e5c5770fdea3 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:46:16.057886 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 728/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 06:46:18.660884 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959793c2-1848-48ff-baa4-4288349e15f2 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:18.661439 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959793c2-1848-48ff-baa4-4288349e15f2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:18.661439 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959793c2-1848-48ff-baa4-4288349e15f2 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:18.662855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 763/1491] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 12 06:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:46:18.668338 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54969bb-6f5d-4be1-ad33-915aabc08a81 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:18.668748 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54969bb-6f5d-4be1-ad33-915aabc08a81 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:18.668895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54969bb-6f5d-4be1-ad33-915aabc08a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:18.686637 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d54969bb-6f5d-4be1-ad33-915aabc08a81 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:46:18.687868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d54969bb-6f5d-4be1-ad33-915aabc08a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:46:18.696223 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 729/1492] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 12 06:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:46:18.733632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959793c2-1848-48ff-baa4-4288349e15f2 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:46:18.744660 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959793c2-1848-48ff-baa4-4288349e15f2 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:46:18.748197 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a2b55-a01a-402f-a06a-67c41a555358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:46:18.748827 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a2b55-a01a-402f-a06a-67c41a555358 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:46:18.749112 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a2b55-a01a-402f-a06a-67c41a555358 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:46:18.749388 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a2b55-a01a-402f-a06a-67c41a555358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:46:18.758858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a2b55-a01a-402f-a06a-67c41a555358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:46:18.760318 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a2b55-a01a-402f-a06a-67c41a555358 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:46:18.769581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 764/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:46:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:47:55.088883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a24a0d-d81c-4022-a9fd-c4a75511d7b3 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:47:55.089459 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a24a0d-d81c-4022-a9fd-c4a75511d7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:47:55.089459 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a24a0d-d81c-4022-a9fd-c4a75511d7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:47:55.107047 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-36a24a0d-d81c-4022-a9fd-c4a75511d7b3 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:47:55.108252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-36a24a0d-d81c-4022-a9fd-c4a75511d7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:47:55.116176 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 730/1494] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:47:55.125302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7894a-49f8-4177-bd9a-7e939f906935 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:47:55.125776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7894a-49f8-4177-bd9a-7e939f906935 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:47:55.125885 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7894a-49f8-4177-bd9a-7e939f906935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:47:55.143705 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f9b7894a-49f8-4177-bd9a-7e939f906935 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:47:55.144905 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f9b7894a-49f8-4177-bd9a-7e939f906935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:47:55.152771 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 765/1495] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:47:55.157727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a24a0d-d81c-4022-a9fd-c4a75511d7b3 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:47:55.167363 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a24a0d-d81c-4022-a9fd-c4a75511d7b3 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:47:55.171872 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92e508-1a9c-40d8-8600-097bd5b6d3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:47:55.172515 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92e508-1a9c-40d8-8600-097bd5b6d3fb admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:47:55.172854 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92e508-1a9c-40d8-8600-097bd5b6d3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:47:55.173139 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92e508-1a9c-40d8-8600-097bd5b6d3fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:47:55.173858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92e508-1a9c-40d8-8600-097bd5b6d3fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:47:55.174164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92e508-1a9c-40d8-8600-097bd5b6d3fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:47:55.175159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: WARNING py.warnings [None req-fd92e508-1a9c-40d8-8600-097bd5b6d3fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 06:47:55.175159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: warnings.warn(msg) May 12 06:47:55.175159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: May 12 06:47:55.176064 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92e508-1a9c-40d8-8600-097bd5b6d3fb admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:47:55.187053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 731/1496] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:47:55.195279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7894a-49f8-4177-bd9a-7e939f906935 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:47:55.204876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7894a-49f8-4177-bd9a-7e939f906935 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:47:55.209477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54754cd9-5d3e-4d06-ba1d-2f8bb1668ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:47:55.210160 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54754cd9-5d3e-4d06-ba1d-2f8bb1668ffd admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:47:55.210427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54754cd9-5d3e-4d06-ba1d-2f8bb1668ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:47:55.210702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54754cd9-5d3e-4d06-ba1d-2f8bb1668ffd admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:47:55.211395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54754cd9-5d3e-4d06-ba1d-2f8bb1668ffd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:47:55.213262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: WARNING py.warnings [None req-54754cd9-5d3e-4d06-ba1d-2f8bb1668ffd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 06:47:55.213262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: warnings.warn(msg) May 12 06:47:55.213262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: May 12 06:47:55.214452 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54754cd9-5d3e-4d06-ba1d-2f8bb1668ffd admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:47:55.309932 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 766/1497] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:47:55 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:47:55.314681 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92e508-1a9c-40d8-8600-097bd5b6d3fb admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:47:55.324462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92e508-1a9c-40d8-8600-097bd5b6d3fb admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:47:55.377353 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba26b4-24f2-4b77-8b87-e42d980b4a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:47:55.378006 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba26b4-24f2-4b77-8b87-e42d980b4a02 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:47:55.378292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba26b4-24f2-4b77-8b87-e42d980b4a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:47:55.378562 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba26b4-24f2-4b77-8b87-e42d980b4a02 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:47:55.379249 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba26b4-24f2-4b77-8b87-e42d980b4a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:47:55.380275 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: WARNING py.warnings [None req-f3ba26b4-24f2-4b77-8b87-e42d980b4a02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 06:47:55.380275 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: warnings.warn(msg) May 12 06:47:55.380275 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: May 12 06:47:55.381465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba26b4-24f2-4b77-8b87-e42d980b4a02 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:47:55.440347 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 732/1498] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:47:55 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:47:55.444533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54754cd9-5d3e-4d06-ba1d-2f8bb1668ffd admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:47:55.455369 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54754cd9-5d3e-4d06-ba1d-2f8bb1668ffd admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:47:55.460002 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebb62b-a6f1-4ac0-addf-0eb3bdbcd8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:47:55.460668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebb62b-a6f1-4ac0-addf-0eb3bdbcd8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:47:55.460953 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebb62b-a6f1-4ac0-addf-0eb3bdbcd8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:47:55.461234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebb62b-a6f1-4ac0-addf-0eb3bdbcd8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:47:55.461963 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebb62b-a6f1-4ac0-addf-0eb3bdbcd8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:47:55.463024 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: WARNING py.warnings [None req-74ebb62b-a6f1-4ac0-addf-0eb3bdbcd8e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 06:47:55.463024 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: warnings.warn(msg) May 12 06:47:55.463024 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: May 12 06:47:55.463909 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebb62b-a6f1-4ac0-addf-0eb3bdbcd8e3 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:47:55.476322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 767/1499] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:47:55.480200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba26b4-24f2-4b77-8b87-e42d980b4a02 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:47:55.490058 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba26b4-24f2-4b77-8b87-e42d980b4a02 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:47:55.494562 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc090a08-e245-4e86-b5f9-dfe48ab529dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:47:55.498442 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc090a08-e245-4e86-b5f9-dfe48ab529dd admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:47:55.498442 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc090a08-e245-4e86-b5f9-dfe48ab529dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:47:55.498442 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc090a08-e245-4e86-b5f9-dfe48ab529dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:47:55.498442 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc090a08-e245-4e86-b5f9-dfe48ab529dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:47:55.498442 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: WARNING py.warnings [None req-bc090a08-e245-4e86-b5f9-dfe48ab529dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 06:47:55.498442 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: warnings.warn(msg) May 12 06:47:55.498442 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: May 12 06:47:55.499029 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc090a08-e245-4e86-b5f9-dfe48ab529dd admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:47:55.511726 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 733/1500] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:47:55.515801 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebb62b-a6f1-4ac0-addf-0eb3bdbcd8e3 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:47:55.525855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebb62b-a6f1-4ac0-addf-0eb3bdbcd8e3 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:47:55.530307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328884bb-55a6-4017-a101-a4506f872709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:47:55.531175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328884bb-55a6-4017-a101-a4506f872709 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:47:55.531488 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328884bb-55a6-4017-a101-a4506f872709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:47:55.531799 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328884bb-55a6-4017-a101-a4506f872709 admin admin] PATH_INFO: `/v3/projects/99cb87b20d904ea1a05a79a4b48a4d38/users/666aac92bbe84f76a32a845fe21d285a/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:47:55.546299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328884bb-55a6-4017-a101-a4506f872709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99cb87b20d904ea1a05a79a4b48a4d38, user_id=666aac92bbe84f76a32a845fe21d285a, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:47:55.547883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: WARNING py.warnings [None req-328884bb-55a6-4017-a101-a4506f872709 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 06:47:55.547883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: warnings.warn(msg) May 12 06:47:55.547883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: May 12 06:47:55.549801 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328884bb-55a6-4017-a101-a4506f872709 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:47:55.646828 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 768/1501] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:47:55 2022] PUT /identity/v3/projects/99cb87b20d904ea1a05a79a4b48a4d38/users/666aac92bbe84f76a32a845fe21d285a/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:47:55.657987 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d52408-6ba2-4398-9a22-36455c50a40c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:47:55.660001 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d52408-6ba2-4398-9a22-36455c50a40c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:47:55.660001 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d52408-6ba2-4398-9a22-36455c50a40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:47:55.684277 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b0d52408-6ba2-4398-9a22-36455c50a40c None None] MFA Rules not processed for user `666aac92bbe84f76a32a845fe21d285a`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:47:55.685455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b0d52408-6ba2-4398-9a22-36455c50a40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:47:55.746326 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 734/1502] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:47:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:47:55.760252 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a31a40-5503-4971-8bd2-670cff09813e None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:47:55.760544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a31a40-5503-4971-8bd2-670cff09813e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:47:55.763161 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a31a40-5503-4971-8bd2-670cff09813e None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:47:55.763161 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 769/1503] 10.222.0.25 () {54 vars in 963 bytes} [Thu May 12 06:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:47:55.767184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd26ae5-c7f5-402b-9ccb-7c40e1dc066c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:47:55.767473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd26ae5-c7f5-402b-9ccb-7c40e1dc066c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:47:55.767796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd26ae5-c7f5-402b-9ccb-7c40e1dc066c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:47:55.785351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5cd26ae5-c7f5-402b-9ccb-7c40e1dc066c None None] MFA Rules not processed for user `4b5006e095ba41d994dca0bf581417e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:47:55.786551 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5cd26ae5-c7f5-402b-9ccb-7c40e1dc066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:47:55.836127 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 735/1504] 10.222.0.25 () {58 vars in 1060 bytes} [Thu May 12 06:47:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:47:55.843896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a31a40-5503-4971-8bd2-670cff09813e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:47:55.854281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a31a40-5503-4971-8bd2-670cff09813e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:47:55.857720 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020ae7e-fa1a-4cca-aea2-c5c23f7968dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:47:55.858340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020ae7e-fa1a-4cca-aea2-c5c23f7968dd service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:47:55.858618 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020ae7e-fa1a-4cca-aea2-c5c23f7968dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:47:55.858889 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020ae7e-fa1a-4cca-aea2-c5c23f7968dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:47:55.867403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020ae7e-fa1a-4cca-aea2-c5c23f7968dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:47:55.868842 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020ae7e-fa1a-4cca-aea2-c5c23f7968dd service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:47:55.878023 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 770/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:47:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:47:55.919325 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a75941-6c35-4103-abaf-dde70fed9110 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:47:55.919614 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a75941-6c35-4103-abaf-dde70fed9110 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:47:55.919938 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a75941-6c35-4103-abaf-dde70fed9110 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:47:55.921206 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 736/1506] 10.222.0.25 () {52 vars in 829 bytes} [Thu May 12 06:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:47:55.925191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020ae7e-fa1a-4cca-aea2-c5c23f7968dd service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:47:55.988768 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020ae7e-fa1a-4cca-aea2-c5c23f7968dd service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:47:55.992751 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9c228-4c25-4856-8565-01a88ff1281b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:47:55.993652 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9c228-4c25-4856-8565-01a88ff1281b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:47:55.993963 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9c228-4c25-4856-8565-01a88ff1281b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:47:55.994239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9c228-4c25-4856-8565-01a88ff1281b admin admin] PATH_INFO: `/v3/users/666aac92bbe84f76a32a845fe21d285a` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:47:55.995440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9c228-4c25-4856-8565-01a88ff1281b admin admin] RBAC: Authorizing `identity:delete_user(user_id=666aac92bbe84f76a32a845fe21d285a)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:47:55.996484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: WARNING py.warnings [None req-bdd9c228-4c25-4856-8565-01a88ff1281b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 06:47:55.996484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: warnings.warn(msg) May 12 06:47:55.996484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: May 12 06:47:55.997682 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9c228-4c25-4856-8565-01a88ff1281b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:47:56.178413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-bdd9c228-4c25-4856-8565-01a88ff1281b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '666aac92bbe84f76a32a845fe21d285a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:47:56.179037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-bdd9c228-4c25-4856-8565-01a88ff1281b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '666aac92bbe84f76a32a845fe21d285a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:47:56.179713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-bdd9c228-4c25-4856-8565-01a88ff1281b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '666aac92bbe84f76a32a845fe21d285a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:47:56.197321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-bdd9c228-4c25-4856-8565-01a88ff1281b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '666aac92bbe84f76a32a845fe21d285a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:47:56.209067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-bdd9c228-4c25-4856-8565-01a88ff1281b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '666aac92bbe84f76a32a845fe21d285a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:47:56.263185 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 771/1507] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:47:55 2022] DELETE /identity/v3/users/666aac92bbe84f76a32a845fe21d285a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:47:56.267786 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa3b76-dca9-4626-86ff-1afc517926d8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:47:56.268265 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa3b76-dca9-4626-86ff-1afc517926d8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:47:56.268374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa3b76-dca9-4626-86ff-1afc517926d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:47:56.286921 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-21aa3b76-dca9-4626-86ff-1afc517926d8 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:47:56.288162 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-21aa3b76-dca9-4626-86ff-1afc517926d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:47:56.344726 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 737/1508] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:47:56.354168 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9c228-4c25-4856-8565-01a88ff1281b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:47:56.355560 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-bdd9c228-4c25-4856-8565-01a88ff1281b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:47:56.412127 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9c228-4c25-4856-8565-01a88ff1281b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:47:56.415908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f5384-ea17-41e5-9f35-25d91a6d26a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:47:56.416548 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f5384-ea17-41e5-9f35-25d91a6d26a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:47:56.416825 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f5384-ea17-41e5-9f35-25d91a6d26a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:47:56.417092 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f5384-ea17-41e5-9f35-25d91a6d26a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:47:56.426242 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f5384-ea17-41e5-9f35-25d91a6d26a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:47:56.427705 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f5384-ea17-41e5-9f35-25d91a6d26a9 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:47:56.436882 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 772/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:47:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:47:56.882185 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa3b76-dca9-4626-86ff-1afc517926d8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:47:56.884482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-21aa3b76-dca9-4626-86ff-1afc517926d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:47:56.896446 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa3b76-dca9-4626-86ff-1afc517926d8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:47:56.901056 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7acef-3cd0-402b-900c-1ce3310a1c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:47:56.901908 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7acef-3cd0-402b-900c-1ce3310a1c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:47:56.902179 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7acef-3cd0-402b-900c-1ce3310a1c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:47:56.902446 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7acef-3cd0-402b-900c-1ce3310a1c5d admin admin] PATH_INFO: `/v3/projects/99cb87b20d904ea1a05a79a4b48a4d38` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:47:56.903802 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7acef-3cd0-402b-900c-1ce3310a1c5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=99cb87b20d904ea1a05a79a4b48a4d38)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:47:56.904818 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: WARNING py.warnings [None req-a2d7acef-3cd0-402b-900c-1ce3310a1c5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 06:47:56.904818 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: warnings.warn(msg) May 12 06:47:56.904818 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: May 12 06:47:56.906008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7acef-3cd0-402b-900c-1ce3310a1c5d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:47:57.063540 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a2d7acef-3cd0-402b-900c-1ce3310a1c5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99cb87b20d904ea1a05a79a4b48a4d38', 'request_id': 'req-a2d7acef-3cd0-402b-900c-1ce3310a1c5d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:47:57.160524 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a2d7acef-3cd0-402b-900c-1ce3310a1c5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99cb87b20d904ea1a05a79a4b48a4d38', 'request_id': 'req-a2d7acef-3cd0-402b-900c-1ce3310a1c5d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:47:57.167034 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a2d7acef-3cd0-402b-900c-1ce3310a1c5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99cb87b20d904ea1a05a79a4b48a4d38', 'request_id': 'req-a2d7acef-3cd0-402b-900c-1ce3310a1c5d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:47:57.185141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a2d7acef-3cd0-402b-900c-1ce3310a1c5d admin admin] The token cache is being invalidate because project 99cb87b20d904ea1a05a79a4b48a4d38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:47:57.186040 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a2d7acef-3cd0-402b-900c-1ce3310a1c5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:47:57.186158 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a2d7acef-3cd0-402b-900c-1ce3310a1c5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:47:57.187804 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 738/1510] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:47:56 2022] DELETE /identity/v3/projects/99cb87b20d904ea1a05a79a4b48a4d38 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:49:35.620413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c158b2-0bb7-4738-9d61-930f651f3da7 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:35.621051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c158b2-0bb7-4738-9d61-930f651f3da7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:35.621051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c158b2-0bb7-4738-9d61-930f651f3da7 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:35.622362 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 773/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 06:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:49:35.627280 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bb7fc-695b-429e-8c55-0595a947af4a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:35.627769 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bb7fc-695b-429e-8c55-0595a947af4a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:35.627891 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bb7fc-695b-429e-8c55-0595a947af4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:35.645795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-756bb7fc-695b-429e-8c55-0595a947af4a None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:49:35.646986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-756bb7fc-695b-429e-8c55-0595a947af4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:49:35.702189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 739/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 06:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:49:35.869559 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c158b2-0bb7-4738-9d61-930f651f3da7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:49:35.871260 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-59c158b2-0bb7-4738-9d61-930f651f3da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:49:35.943490 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c158b2-0bb7-4738-9d61-930f651f3da7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:49:35.951537 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbd657-44a1-403e-a576-a2feb76a4393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:49:35.952682 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbd657-44a1-403e-a576-a2feb76a4393 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:35.952682 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbd657-44a1-403e-a576-a2feb76a4393 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:35.952870 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbd657-44a1-403e-a576-a2feb76a4393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:35.961954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbd657-44a1-403e-a576-a2feb76a4393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:49:35.963842 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbd657-44a1-403e-a576-a2feb76a4393 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:49:35.975253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 774/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:49:36.492484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45166135-f146-405d-b7ad-8d768de1aed0 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:36.492965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45166135-f146-405d-b7ad-8d768de1aed0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:36.493253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45166135-f146-405d-b7ad-8d768de1aed0 None None] PATH_INFO: `/v3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:36.494784 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 740/1514] 10.222.0.23 () {54 vars in 925 bytes} [Thu May 12 06:49:36 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:49:36.500611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0f3af-bbbf-4f6a-b60c-78124f6c635c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:36.500897 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0f3af-bbbf-4f6a-b60c-78124f6c635c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:36.501167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0f3af-bbbf-4f6a-b60c-78124f6c635c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:36.522486 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-65f0f3af-bbbf-4f6a-b60c-78124f6c635c None None] MFA Rules not processed for user `61d2edf68b1b440097981097699bb307`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:49:36.523679 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-65f0f3af-bbbf-4f6a-b60c-78124f6c635c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:49:36.590396 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 775/1515] 10.222.0.23 () {58 vars in 1015 bytes} [Thu May 12 06:49:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:49:36.882023 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d8f3c-2abd-461a-90ae-322f0cca2f89 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:36.882563 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d8f3c-2abd-461a-90ae-322f0cca2f89 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:36.882563 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d8f3c-2abd-461a-90ae-322f0cca2f89 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:36.883987 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 741/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 06:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:49:36.889085 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a848143-d987-4efb-83d8-9902dca0255f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:36.889476 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a848143-d987-4efb-83d8-9902dca0255f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:36.889632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a848143-d987-4efb-83d8-9902dca0255f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:36.907575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-1a848143-d987-4efb-83d8-9902dca0255f None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:49:36.908774 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1a848143-d987-4efb-83d8-9902dca0255f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:49:36.916758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 776/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 06:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:49:37.067425 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d8f3c-2abd-461a-90ae-322f0cca2f89 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:49:37.081318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d8f3c-2abd-461a-90ae-322f0cca2f89 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:49:37.086629 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b382988-d77a-4a01-a1a5-8f83023c063a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:49:37.087261 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b382988-d77a-4a01-a1a5-8f83023c063a service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:37.087542 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b382988-d77a-4a01-a1a5-8f83023c063a service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:37.087853 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b382988-d77a-4a01-a1a5-8f83023c063a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:37.096313 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b382988-d77a-4a01-a1a5-8f83023c063a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:49:37.097836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b382988-d77a-4a01-a1a5-8f83023c063a service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:49:37.107778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 742/1518] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:49:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:49:40.545109 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70218d47-835c-4d2c-96e0-9053f9b094d4 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:40.545667 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70218d47-835c-4d2c-96e0-9053f9b094d4 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:40.545667 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70218d47-835c-4d2c-96e0-9053f9b094d4 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:40.547083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 777/1519] 10.222.0.25 () {54 vars in 960 bytes} [Thu May 12 06:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:49:40.553260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0e0cc-f584-406d-9a9d-aa7cfe21da5c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:40.553656 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0e0cc-f584-406d-9a9d-aa7cfe21da5c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:40.553816 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0e0cc-f584-406d-9a9d-aa7cfe21da5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:40.572569 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b8b0e0cc-f584-406d-9a9d-aa7cfe21da5c None None] MFA Rules not processed for user `61d2edf68b1b440097981097699bb307`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:49:40.573761 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b8b0e0cc-f584-406d-9a9d-aa7cfe21da5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:49:40.582814 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 743/1520] 10.222.0.25 () {58 vars in 1057 bytes} [Thu May 12 06:49:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:49:40.592092 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70218d47-835c-4d2c-96e0-9053f9b094d4 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:49:40.605861 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70218d47-835c-4d2c-96e0-9053f9b094d4 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:49:40.610919 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd021741-53c8-4735-b388-78ada7ed3294 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d2edf68b1b440097981097699bb307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:49:40.611580 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd021741-53c8-4735-b388-78ada7ed3294 service placement] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:40.611878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd021741-53c8-4735-b388-78ada7ed3294 service placement] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:40.612154 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd021741-53c8-4735-b388-78ada7ed3294 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:40.620656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd021741-53c8-4735-b388-78ada7ed3294 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:49:40.622223 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd021741-53c8-4735-b388-78ada7ed3294 service placement] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:49:40.632124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 778/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:49:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:49:48.384415 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feed3ed-ac97-40df-a453-9f3aa6eb6197 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:48.384983 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feed3ed-ac97-40df-a453-9f3aa6eb6197 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:48.384983 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feed3ed-ac97-40df-a453-9f3aa6eb6197 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:48.386371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 744/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 06:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:49:48.391078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b566d-9c85-4a0c-acee-8652995fbaa9 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:48.391506 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b566d-9c85-4a0c-acee-8652995fbaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:48.391644 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b566d-9c85-4a0c-acee-8652995fbaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:48.409164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-7f5b566d-9c85-4a0c-acee-8652995fbaa9 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:49:48.410352 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7f5b566d-9c85-4a0c-acee-8652995fbaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:49:48.418371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 779/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 06:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:49:48.567387 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feed3ed-ac97-40df-a453-9f3aa6eb6197 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:49:48.581515 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feed3ed-ac97-40df-a453-9f3aa6eb6197 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:49:48.586789 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7faef81-291c-43c5-936e-7c591812023b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:49:48.587446 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7faef81-291c-43c5-936e-7c591812023b service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:48.587755 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7faef81-291c-43c5-936e-7c591812023b service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:48.588029 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7faef81-291c-43c5-936e-7c591812023b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:48.595948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7faef81-291c-43c5-936e-7c591812023b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:49:48.597521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7faef81-291c-43c5-936e-7c591812023b service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:49:48.606651 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 745/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:49:49.492888 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f90b1-67c4-43f5-b93a-5f56192dbfe7 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:49.493428 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f90b1-67c4-43f5-b93a-5f56192dbfe7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:49.493428 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f90b1-67c4-43f5-b93a-5f56192dbfe7 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:49.494867 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 780/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 06:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:49:49.499637 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40103d8a-155e-45bf-b5c2-9afcffe64473 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:49.500076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40103d8a-155e-45bf-b5c2-9afcffe64473 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:49.500216 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40103d8a-155e-45bf-b5c2-9afcffe64473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:49.518861 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-40103d8a-155e-45bf-b5c2-9afcffe64473 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:49:49.520062 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-40103d8a-155e-45bf-b5c2-9afcffe64473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:49:49.527650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 746/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 06:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:49:49.676332 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f90b1-67c4-43f5-b93a-5f56192dbfe7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:49:49.690712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f90b1-67c4-43f5-b93a-5f56192dbfe7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:49:49.695997 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04772c-bfe5-4044-8aa2-a25a95cb1cd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:49:49.696625 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04772c-bfe5-4044-8aa2-a25a95cb1cd1 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:49.696906 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04772c-bfe5-4044-8aa2-a25a95cb1cd1 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:49.697180 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04772c-bfe5-4044-8aa2-a25a95cb1cd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:49.705641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04772c-bfe5-4044-8aa2-a25a95cb1cd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:49:49.707190 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04772c-bfe5-4044-8aa2-a25a95cb1cd1 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:49:49.716277 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 781/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:49:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:49:54.007492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b039713-e1f4-467f-9349-a7307201a405 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:54.008040 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b039713-e1f4-467f-9349-a7307201a405 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:54.008159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b039713-e1f4-467f-9349-a7307201a405 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:54.009423 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 747/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 06:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:49:54.014515 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574deb8e-e586-4a18-a053-fea8f7a2a90c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:54.017693 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574deb8e-e586-4a18-a053-fea8f7a2a90c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:54.017693 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574deb8e-e586-4a18-a053-fea8f7a2a90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:54.033629 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-574deb8e-e586-4a18-a053-fea8f7a2a90c None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:49:54.034876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-574deb8e-e586-4a18-a053-fea8f7a2a90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:49:54.043041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 782/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 06:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:49:54.080866 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b039713-e1f4-467f-9349-a7307201a405 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:49:54.082551 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7b039713-e1f4-467f-9349-a7307201a405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:49:54.137634 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b039713-e1f4-467f-9349-a7307201a405 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:49:54.141663 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432768db-36a6-44dc-b45a-a4993ca26f46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:49:54.142303 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432768db-36a6-44dc-b45a-a4993ca26f46 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:54.142584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432768db-36a6-44dc-b45a-a4993ca26f46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:54.142857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432768db-36a6-44dc-b45a-a4993ca26f46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:54.151928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432768db-36a6-44dc-b45a-a4993ca26f46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:49:54.155251 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432768db-36a6-44dc-b45a-a4993ca26f46 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:49:54.162694 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 748/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:49:56.374311 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279f889-4c00-4b30-a015-0ddaa77ac4dc None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:56.374870 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279f889-4c00-4b30-a015-0ddaa77ac4dc None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:56.374870 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279f889-4c00-4b30-a015-0ddaa77ac4dc None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:56.376206 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 783/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 06:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:49:56.381480 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277a731-3053-4344-81ac-778e2f3b68e6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:56.381895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277a731-3053-4344-81ac-778e2f3b68e6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:56.382044 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277a731-3053-4344-81ac-778e2f3b68e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:56.400304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2277a731-3053-4344-81ac-778e2f3b68e6 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:49:56.401501 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2277a731-3053-4344-81ac-778e2f3b68e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:49:56.409843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 749/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 06:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:49:56.444435 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279f889-4c00-4b30-a015-0ddaa77ac4dc None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:49:56.455358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279f889-4c00-4b30-a015-0ddaa77ac4dc None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:49:56.458854 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7aa0b1-7b51-42d1-a851-96a186abaeec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:49:56.459480 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aa0b1-7b51-42d1-a851-96a186abaeec service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:49:56.459798 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aa0b1-7b51-42d1-a851-96a186abaeec service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:49:56.460076 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aa0b1-7b51-42d1-a851-96a186abaeec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:49:56.469351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7aa0b1-7b51-42d1-a851-96a186abaeec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:49:56.470760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7aa0b1-7b51-42d1-a851-96a186abaeec service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:49:56.479961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 784/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:49:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:50:00.424857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc35a61-adcf-4e96-8226-24a348b4aa9b None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:50:00.425381 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc35a61-adcf-4e96-8226-24a348b4aa9b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:50:00.425381 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc35a61-adcf-4e96-8226-24a348b4aa9b None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:50:00.426750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 750/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 06:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:50:00.432025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236037e1-0e08-4bdd-9849-9ba3d73ee07a None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:50:00.432452 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236037e1-0e08-4bdd-9849-9ba3d73ee07a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:50:00.432590 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236037e1-0e08-4bdd-9849-9ba3d73ee07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:50:00.450565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-236037e1-0e08-4bdd-9849-9ba3d73ee07a None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:50:00.451789 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-236037e1-0e08-4bdd-9849-9ba3d73ee07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:50:00.460189 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 785/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 06:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:50:00.736030 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc35a61-adcf-4e96-8226-24a348b4aa9b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:50:00.737999 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-abc35a61-adcf-4e96-8226-24a348b4aa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:50:00.793898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc35a61-adcf-4e96-8226-24a348b4aa9b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:50:00.797588 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7ab4d-e198-454d-acd2-c92dbdb8b042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:50:00.798241 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7ab4d-e198-454d-acd2-c92dbdb8b042 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:50:00.798522 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7ab4d-e198-454d-acd2-c92dbdb8b042 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:50:00.798794 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7ab4d-e198-454d-acd2-c92dbdb8b042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:50:00.807871 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7ab4d-e198-454d-acd2-c92dbdb8b042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:50:00.809284 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7ab4d-e198-454d-acd2-c92dbdb8b042 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:50:00.818447 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 751/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:50:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:50:03.087878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047218dc-ac9c-40ce-b8a5-6a677a53195f None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:50:03.088408 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047218dc-ac9c-40ce-b8a5-6a677a53195f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:50:03.088408 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047218dc-ac9c-40ce-b8a5-6a677a53195f None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:50:03.089861 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 786/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 06:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:50:03.095710 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc6e80-e24b-43b6-b94c-fd5b74f6b0cc None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:50:03.096114 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc6e80-e24b-43b6-b94c-fd5b74f6b0cc None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:50:03.096254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc6e80-e24b-43b6-b94c-fd5b74f6b0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:50:03.115121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8bfc6e80-e24b-43b6-b94c-fd5b74f6b0cc None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:50:03.116354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8bfc6e80-e24b-43b6-b94c-fd5b74f6b0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:50:03.124051 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 752/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 06:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:50:03.391022 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047218dc-ac9c-40ce-b8a5-6a677a53195f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:50:03.392719 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-047218dc-ac9c-40ce-b8a5-6a677a53195f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:50:03.405256 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047218dc-ac9c-40ce-b8a5-6a677a53195f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:50:03.408746 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b96370-853b-47c1-8709-99a7fed81009 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:50:03.409376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b96370-853b-47c1-8709-99a7fed81009 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:50:03.409655 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b96370-853b-47c1-8709-99a7fed81009 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:50:03.409926 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b96370-853b-47c1-8709-99a7fed81009 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:50:03.418760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b96370-853b-47c1-8709-99a7fed81009 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:50:03.420230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b96370-853b-47c1-8709-99a7fed81009 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:50:03.429200 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 787/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:33.045254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756760e0-df59-4284-a878-63973a74475e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.046323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756760e0-df59-4284-a878-63973a74475e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.046998 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756760e0-df59-4284-a878-63973a74475e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.075582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-756760e0-df59-4284-a878-63973a74475e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:33.077352 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-756760e0-df59-4284-a878-63973a74475e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:33.092816 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 753/1540] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:51:33.103199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48479e0-97e8-453d-b8ed-fbadc8dfb2b9 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.103807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48479e0-97e8-453d-b8ed-fbadc8dfb2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.103807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48479e0-97e8-453d-b8ed-fbadc8dfb2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.132494 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d48479e0-97e8-453d-b8ed-fbadc8dfb2b9 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:33.133764 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d48479e0-97e8-453d-b8ed-fbadc8dfb2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:33.148716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 788/1541] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:33.155625 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756760e0-df59-4284-a878-63973a74475e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:33.171180 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756760e0-df59-4284-a878-63973a74475e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:33.183885 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00d2d3-74ad-436b-9b93-739d9f3ca38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:33.184980 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00d2d3-74ad-436b-9b93-739d9f3ca38c admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.185664 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00d2d3-74ad-436b-9b93-739d9f3ca38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.186177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00d2d3-74ad-436b-9b93-739d9f3ca38c admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.187173 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00d2d3-74ad-436b-9b93-739d9f3ca38c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:51:33.188907 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00d2d3-74ad-436b-9b93-739d9f3ca38c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:33.191012 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00d2d3-74ad-436b-9b93-739d9f3ca38c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:33.208373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 754/1542] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:51:33.218663 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48479e0-97e8-453d-b8ed-fbadc8dfb2b9 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:33.235069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48479e0-97e8-453d-b8ed-fbadc8dfb2b9 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:33.244379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227edc6-d592-4e7d-8373-25e7cdff2cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:33.245051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227edc6-d592-4e7d-8373-25e7cdff2cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.245335 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227edc6-d592-4e7d-8373-25e7cdff2cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.245666 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227edc6-d592-4e7d-8373-25e7cdff2cb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.246377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227edc6-d592-4e7d-8373-25e7cdff2cb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:33.248446 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227edc6-d592-4e7d-8373-25e7cdff2cb0 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:33.276096 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b875d-bb87-43c1-aec4-a7903373d3b1 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.277548 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b875d-bb87-43c1-aec4-a7903373d3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.278074 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b875d-bb87-43c1-aec4-a7903373d3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.304519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-088b875d-bb87-43c1-aec4-a7903373d3b1 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:33.306179 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-088b875d-bb87-43c1-aec4-a7903373d3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:33.322809 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 755/1543] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:33.335381 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704c9c3-9ce6-4635-9425-c06edfad7419 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.336072 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704c9c3-9ce6-4635-9425-c06edfad7419 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.336574 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704c9c3-9ce6-4635-9425-c06edfad7419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.361134 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9704c9c3-9ce6-4635-9425-c06edfad7419 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:33.362932 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9704c9c3-9ce6-4635-9425-c06edfad7419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:33.380395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 789/1544] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:51:33 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:33.382026 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706aad1-b9be-41d1-9441-6fd4adbdfdda None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.382314 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706aad1-b9be-41d1-9441-6fd4adbdfdda None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.382585 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706aad1-b9be-41d1-9441-6fd4adbdfdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.384062 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 756/1545] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:51:33.386194 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e227e4-75dc-4a1f-80f3-81baba0f0105 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.386720 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e227e4-75dc-4a1f-80f3-81baba0f0105 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.387224 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e227e4-75dc-4a1f-80f3-81baba0f0105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.415610 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-9706aad1-b9be-41d1-9441-6fd4adbdfdda None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:33.417481 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9706aad1-b9be-41d1-9441-6fd4adbdfdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:33.422370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-75e227e4-75dc-4a1f-80f3-81baba0f0105 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:33.425362 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-75e227e4-75dc-4a1f-80f3-81baba0f0105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:33.501178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 790/1546] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:33.504605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706aad1-b9be-41d1-9441-6fd4adbdfdda None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:33.504741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 757/1547] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:33.505483 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e227e4-75dc-4a1f-80f3-81baba0f0105 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:33.517521 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706aad1-b9be-41d1-9441-6fd4adbdfdda None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:33.520926 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e227e4-75dc-4a1f-80f3-81baba0f0105 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:33.522738 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67076f35-a3f8-490c-ae46-00125ad6ac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:33.523677 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67076f35-a3f8-490c-ae46-00125ad6ac0d admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.523976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67076f35-a3f8-490c-ae46-00125ad6ac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.524298 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67076f35-a3f8-490c-ae46-00125ad6ac0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.525148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67076f35-a3f8-490c-ae46-00125ad6ac0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:51:33.525551 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67076f35-a3f8-490c-ae46-00125ad6ac0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:33.526785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: WARNING py.warnings [None req-67076f35-a3f8-490c-ae46-00125ad6ac0d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 06:51:33.526785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: warnings.warn(msg) May 12 06:51:33.526785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: May 12 06:51:33.527793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67076f35-a3f8-490c-ae46-00125ad6ac0d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:33.528351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e243ee-f154-4887-8988-0e94d052240e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:33.529018 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e243ee-f154-4887-8988-0e94d052240e admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.529300 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e243ee-f154-4887-8988-0e94d052240e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.529574 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e243ee-f154-4887-8988-0e94d052240e admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.530268 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e243ee-f154-4887-8988-0e94d052240e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:33.532212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e243ee-f154-4887-8988-0e94d052240e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:33.539611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 791/1548] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:51:33.541251 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa3849-09cc-4a03-9c53-e563c27cf7d5 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.541251 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa3849-09cc-4a03-9c53-e563c27cf7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.541459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa3849-09cc-4a03-9c53-e563c27cf7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.559758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-a4aa3849-09cc-4a03-9c53-e563c27cf7d5 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:33.561230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a4aa3849-09cc-4a03-9c53-e563c27cf7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:33.569535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 792/1549] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:33.570833 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57621f1a-70bc-45e6-bec7-2335b3b18dcf None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.571114 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57621f1a-70bc-45e6-bec7-2335b3b18dcf None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.571384 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57621f1a-70bc-45e6-bec7-2335b3b18dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.590552 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-57621f1a-70bc-45e6-bec7-2335b3b18dcf None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:33.608670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-57621f1a-70bc-45e6-bec7-2335b3b18dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:33.608670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 793/1550] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:33.608670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a854d-5d56-4b88-8681-ec790e2f44b1 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.608670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a854d-5d56-4b88-8681-ec790e2f44b1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.608670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a854d-5d56-4b88-8681-ec790e2f44b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.618434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-5e8a854d-5d56-4b88-8681-ec790e2f44b1 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:33.619638 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5e8a854d-5d56-4b88-8681-ec790e2f44b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:33.628349 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 794/1551] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:33.630060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776f3d1-e45d-422a-87b5-7ecec9151178 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.630221 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776f3d1-e45d-422a-87b5-7ecec9151178 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.630577 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776f3d1-e45d-422a-87b5-7ecec9151178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.649331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d776f3d1-e45d-422a-87b5-7ecec9151178 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:33.654218 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d776f3d1-e45d-422a-87b5-7ecec9151178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:33.654352 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 758/1552] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:51:33 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:33.654352 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b5d34-286a-43d0-b5d5-1dcd48c9fd75 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.654352 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b5d34-286a-43d0-b5d5-1dcd48c9fd75 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.654352 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b5d34-286a-43d0-b5d5-1dcd48c9fd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.659497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 795/1553] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:33.661779 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ed72c-2853-4cfb-b605-792783d1817c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.662069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ed72c-2853-4cfb-b605-792783d1817c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.662346 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ed72c-2853-4cfb-b605-792783d1817c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.674206 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b75b5d34-286a-43d0-b5d5-1dcd48c9fd75 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:33.675402 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b75b5d34-286a-43d0-b5d5-1dcd48c9fd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:33.683330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6b3ed72c-2853-4cfb-b605-792783d1817c None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:33.684146 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 759/1554] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:33.684514 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6b3ed72c-2853-4cfb-b605-792783d1817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:33.684899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b5d34-286a-43d0-b5d5-1dcd48c9fd75 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:33.692594 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 796/1555] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:33.694023 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e692a61-cb51-47ac-85a5-a8e6da5cd9b9 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.694267 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e692a61-cb51-47ac-85a5-a8e6da5cd9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.694541 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e692a61-cb51-47ac-85a5-a8e6da5cd9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.694835 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b5d34-286a-43d0-b5d5-1dcd48c9fd75 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:33.699750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7c761-ebca-4085-823b-b5b1d303b6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:33.700398 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7c761-ebca-4085-823b-b5b1d303b6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.700692 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7c761-ebca-4085-823b-b5b1d303b6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.700942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7c761-ebca-4085-823b-b5b1d303b6f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.701622 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7c761-ebca-4085-823b-b5b1d303b6f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:33.702633 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: WARNING py.warnings [None req-0ad7c761-ebca-4085-823b-b5b1d303b6f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 06:51:33.702633 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: warnings.warn(msg) May 12 06:51:33.702633 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: May 12 06:51:33.703828 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7c761-ebca-4085-823b-b5b1d303b6f9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:33.711905 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-1e692a61-cb51-47ac-85a5-a8e6da5cd9b9 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:33.713406 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1e692a61-cb51-47ac-85a5-a8e6da5cd9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:33.720804 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 797/1556] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:33.721995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeea991-dabe-4224-be85-70918d15db0d None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.722332 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeea991-dabe-4224-be85-70918d15db0d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.722589 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeea991-dabe-4224-be85-70918d15db0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.741706 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-aeeea991-dabe-4224-be85-70918d15db0d None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:33.742854 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-aeeea991-dabe-4224-be85-70918d15db0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:33.753717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 798/1557] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:33.753717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a048171-bc74-45b8-acb6-c86eec85ae68 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.753717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a048171-bc74-45b8-acb6-c86eec85ae68 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.753717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a048171-bc74-45b8-acb6-c86eec85ae68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.770057 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-0a048171-bc74-45b8-acb6-c86eec85ae68 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:33.771285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0a048171-bc74-45b8-acb6-c86eec85ae68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:33.773059 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 760/1558] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:51:33 2022] POST /identity/v3/projects => generated 379 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:33.773059 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7c761-ebca-4085-823b-b5b1d303b6f9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:33.829117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 799/1559] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:33.830871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a048171-bc74-45b8-acb6-c86eec85ae68 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:33.835597 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7c761-ebca-4085-823b-b5b1d303b6f9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:33.839854 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a048171-bc74-45b8-acb6-c86eec85ae68 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:33.840196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b61cad-44a3-4a12-9adf-071c528d26ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:33.840851 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b61cad-44a3-4a12-9adf-071c528d26ce admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.841128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b61cad-44a3-4a12-9adf-071c528d26ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.841396 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b61cad-44a3-4a12-9adf-071c528d26ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.842222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b61cad-44a3-4a12-9adf-071c528d26ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:33.843861 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b61cad-44a3-4a12-9adf-071c528d26ce admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:33.844800 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cc11d-199e-4b4b-90e9-be9cac1bb880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:33.845455 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc11d-199e-4b4b-90e9-be9cac1bb880 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.845737 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc11d-199e-4b4b-90e9-be9cac1bb880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.846012 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc11d-199e-4b4b-90e9-be9cac1bb880 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.846738 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cc11d-199e-4b4b-90e9-be9cac1bb880 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:51:33.847047 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cc11d-199e-4b4b-90e9-be9cac1bb880 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:33.848657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cc11d-199e-4b4b-90e9-be9cac1bb880 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:33.853499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 761/1560] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:33.854875 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b61cad-44a3-4a12-9adf-071c528d26ce admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:33.860978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 800/1561] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:51:33.862343 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411ef14-499d-4b71-97e2-b1b0ed6f9aeb None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.862606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411ef14-499d-4b71-97e2-b1b0ed6f9aeb None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.862885 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411ef14-499d-4b71-97e2-b1b0ed6f9aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.865787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b61cad-44a3-4a12-9adf-071c528d26ce admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:33.872409 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ecfb6-7a27-43f7-a684-2b3578a4a1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:33.873057 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ecfb6-7a27-43f7-a684-2b3578a4a1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.873342 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ecfb6-7a27-43f7-a684-2b3578a4a1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.873617 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ecfb6-7a27-43f7-a684-2b3578a4a1c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.874339 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ecfb6-7a27-43f7-a684-2b3578a4a1c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:51:33.874675 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ecfb6-7a27-43f7-a684-2b3578a4a1c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:33.876311 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ecfb6-7a27-43f7-a684-2b3578a4a1c5 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:33.881283 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-8411ef14-499d-4b71-97e2-b1b0ed6f9aeb None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:33.882501 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8411ef14-499d-4b71-97e2-b1b0ed6f9aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:33.888161 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 762/1562] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:51:33.888947 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ecfb6-7a27-43f7-a684-2b3578a4a1c5 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:33.890827 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 801/1563] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:33.891605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411ef14-499d-4b71-97e2-b1b0ed6f9aeb None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:33.901427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411ef14-499d-4b71-97e2-b1b0ed6f9aeb None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:33.901659 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ecfb6-7a27-43f7-a684-2b3578a4a1c5 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:33.906037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc5840-c208-4e0e-ad81-3a28de1e2ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:33.906196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3d3d6-ad4c-489e-a3aa-4c36c5d72272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:33.906673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc5840-c208-4e0e-ad81-3a28de1e2ace admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.906794 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3d3d6-ad4c-489e-a3aa-4c36c5d72272 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.906951 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc5840-c208-4e0e-ad81-3a28de1e2ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.907056 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3d3d6-ad4c-489e-a3aa-4c36c5d72272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.907219 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc5840-c208-4e0e-ad81-3a28de1e2ace admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.907328 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3d3d6-ad4c-489e-a3aa-4c36c5d72272 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.907983 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc5840-c208-4e0e-ad81-3a28de1e2ace admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:51:33.908093 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3d3d6-ad4c-489e-a3aa-4c36c5d72272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:51:33.908279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc5840-c208-4e0e-ad81-3a28de1e2ace admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:33.908389 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3d3d6-ad4c-489e-a3aa-4c36c5d72272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:33.909848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc5840-c208-4e0e-ad81-3a28de1e2ace admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:33.909961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3d3d6-ad4c-489e-a3aa-4c36c5d72272 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:33.921922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 802/1564] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:51:33.922085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 763/1565] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:51:33.922586 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc5840-c208-4e0e-ad81-3a28de1e2ace admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:33.923133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3d3d6-ad4c-489e-a3aa-4c36c5d72272 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:33.932044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc5840-c208-4e0e-ad81-3a28de1e2ace admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:33.937450 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3d3d6-ad4c-489e-a3aa-4c36c5d72272 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:33.937771 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad36381-e266-49c2-8557-c63358c6d562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:33.938453 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad36381-e266-49c2-8557-c63358c6d562 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.938732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad36381-e266-49c2-8557-c63358c6d562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.939031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad36381-e266-49c2-8557-c63358c6d562 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.939743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad36381-e266-49c2-8557-c63358c6d562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:33.940736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: WARNING py.warnings [None req-bad36381-e266-49c2-8557-c63358c6d562 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 06:51:33.940736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: warnings.warn(msg) May 12 06:51:33.940736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: May 12 06:51:33.941923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad36381-e266-49c2-8557-c63358c6d562 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:33.942278 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284a137-d15d-4363-ba85-a825307d6889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:33.942924 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284a137-d15d-4363-ba85-a825307d6889 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.943243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284a137-d15d-4363-ba85-a825307d6889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.943515 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284a137-d15d-4363-ba85-a825307d6889 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.944315 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284a137-d15d-4363-ba85-a825307d6889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:51:33.944623 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284a137-d15d-4363-ba85-a825307d6889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:33.946230 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284a137-d15d-4363-ba85-a825307d6889 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:33.958085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 764/1566] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:51:33.963820 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284a137-d15d-4363-ba85-a825307d6889 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:33.969402 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284a137-d15d-4363-ba85-a825307d6889 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:33.974155 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc004ff-db3b-4dfe-abac-68dce498c52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:33.974795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc004ff-db3b-4dfe-abac-68dce498c52e admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:33.975081 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc004ff-db3b-4dfe-abac-68dce498c52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:33.975352 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc004ff-db3b-4dfe-abac-68dce498c52e admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:33.976138 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc004ff-db3b-4dfe-abac-68dce498c52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:33.977703 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc004ff-db3b-4dfe-abac-68dce498c52e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:33.990358 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 765/1567] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:33.990358 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc004ff-db3b-4dfe-abac-68dce498c52e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:34.000518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc004ff-db3b-4dfe-abac-68dce498c52e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:34.005095 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081542dd-0eec-47bb-a3c4-f85c68313ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:34.005669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081542dd-0eec-47bb-a3c4-f85c68313ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:34.005948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081542dd-0eec-47bb-a3c4-f85c68313ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:34.006218 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081542dd-0eec-47bb-a3c4-f85c68313ab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:34.006897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081542dd-0eec-47bb-a3c4-f85c68313ab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:34.008793 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081542dd-0eec-47bb-a3c4-f85c68313ab4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:34.013924 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 803/1568] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:51:33 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:34.013924 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad36381-e266-49c2-8557-c63358c6d562 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:34.023290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad36381-e266-49c2-8557-c63358c6d562 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:34.027999 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d8e62-62ea-4e7c-af19-533ba3cf360a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:34.028641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d8e62-62ea-4e7c-af19-533ba3cf360a admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:34.028924 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d8e62-62ea-4e7c-af19-533ba3cf360a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:34.029194 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d8e62-62ea-4e7c-af19-533ba3cf360a admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:34.029912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d8e62-62ea-4e7c-af19-533ba3cf360a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:51:34.030215 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d8e62-62ea-4e7c-af19-533ba3cf360a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:34.031827 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d8e62-62ea-4e7c-af19-533ba3cf360a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:34.044255 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 804/1569] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:51:34.045037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d8e62-62ea-4e7c-af19-533ba3cf360a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:34.054163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d8e62-62ea-4e7c-af19-533ba3cf360a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:34.059446 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c478f6-4013-4c81-aa76-638b97496d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:34.060100 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c478f6-4013-4c81-aa76-638b97496d82 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:34.060384 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c478f6-4013-4c81-aa76-638b97496d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:34.061426 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c478f6-4013-4c81-aa76-638b97496d82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:34.061426 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c478f6-4013-4c81-aa76-638b97496d82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:34.063238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c478f6-4013-4c81-aa76-638b97496d82 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:34.092872 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 766/1570] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:51:33 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:34.095845 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081542dd-0eec-47bb-a3c4-f85c68313ab4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:34.153221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081542dd-0eec-47bb-a3c4-f85c68313ab4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:34.157865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd8241-83a5-42da-99b7-ab1e564d1fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:34.158512 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd8241-83a5-42da-99b7-ab1e564d1fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:34.158791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd8241-83a5-42da-99b7-ab1e564d1fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:34.159061 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd8241-83a5-42da-99b7-ab1e564d1fd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:34.159773 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd8241-83a5-42da-99b7-ab1e564d1fd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:34.161673 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd8241-83a5-42da-99b7-ab1e564d1fd4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:34.285977 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 805/1571] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:51:34 2022] POST /identity/v3/projects => generated 381 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:34.286716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c478f6-4013-4c81-aa76-638b97496d82 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:34.317504 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 767/1572] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:51:34 2022] POST /identity/v3/projects => generated 393 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:34.317504 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd8241-83a5-42da-99b7-ab1e564d1fd4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:34.346066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c478f6-4013-4c81-aa76-638b97496d82 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:34.377697 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd8241-83a5-42da-99b7-ab1e564d1fd4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:34.382326 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2c501-08f2-4ec2-8f7e-583a29991cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:34.382979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2c501-08f2-4ec2-8f7e-583a29991cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:34.383257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2c501-08f2-4ec2-8f7e-583a29991cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:34.383527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2c501-08f2-4ec2-8f7e-583a29991cf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:34.384274 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2c501-08f2-4ec2-8f7e-583a29991cf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:34.386316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2c501-08f2-4ec2-8f7e-583a29991cf7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:34.400282 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d0d29-cecc-48c7-b3c8-0b55a99c8960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:34.400949 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d0d29-cecc-48c7-b3c8-0b55a99c8960 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:34.401835 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d0d29-cecc-48c7-b3c8-0b55a99c8960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:34.402249 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d0d29-cecc-48c7-b3c8-0b55a99c8960 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:34.403198 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d0d29-cecc-48c7-b3c8-0b55a99c8960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:34.405162 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d0d29-cecc-48c7-b3c8-0b55a99c8960 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:34.485954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 768/1573] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:51:34 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:34.486774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2c501-08f2-4ec2-8f7e-583a29991cf7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:34.520093 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 806/1574] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:51:34 2022] POST /identity/v3/projects => generated 377 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:34.520990 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d0d29-cecc-48c7-b3c8-0b55a99c8960 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:34.549966 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2c501-08f2-4ec2-8f7e-583a29991cf7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:34.583187 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d0d29-cecc-48c7-b3c8-0b55a99c8960 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:34.587780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fa76e-6146-4375-9420-4783d97d9cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:34.588453 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fa76e-6146-4375-9420-4783d97d9cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:34.589398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fa76e-6146-4375-9420-4783d97d9cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:34.589676 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fa76e-6146-4375-9420-4783d97d9cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:34.590415 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fa76e-6146-4375-9420-4783d97d9cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:34.592286 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fa76e-6146-4375-9420-4783d97d9cb6 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:34.602043 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 807/1575] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:34.602822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fa76e-6146-4375-9420-4783d97d9cb6 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:34.610369 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56ba44-e868-4f4f-9c1b-51ccfa29858c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:34.611293 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56ba44-e868-4f4f-9c1b-51ccfa29858c admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:34.611573 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56ba44-e868-4f4f-9c1b-51ccfa29858c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:34.611878 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56ba44-e868-4f4f-9c1b-51ccfa29858c admin admin] PATH_INFO: `/v3/projects/2574f9d0b3b94e2fa7a01af7a162ae29/users/af9f038ed8be415093c0049729945ce5/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:34.612299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fa76e-6146-4375-9420-4783d97d9cb6 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:34.616831 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df8813-99ae-44d2-861d-0ea3480d77ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:34.618044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df8813-99ae-44d2-861d-0ea3480d77ec admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:34.618044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df8813-99ae-44d2-861d-0ea3480d77ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:34.618044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df8813-99ae-44d2-861d-0ea3480d77ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:34.618698 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df8813-99ae-44d2-861d-0ea3480d77ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:34.620660 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df8813-99ae-44d2-861d-0ea3480d77ec admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:34.626117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56ba44-e868-4f4f-9c1b-51ccfa29858c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2574f9d0b3b94e2fa7a01af7a162ae29, user_id=af9f038ed8be415093c0049729945ce5, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:34.627145 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: WARNING py.warnings [None req-df56ba44-e868-4f4f-9c1b-51ccfa29858c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 06:51:34.627145 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: warnings.warn(msg) May 12 06:51:34.627145 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: May 12 06:51:34.629108 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56ba44-e868-4f4f-9c1b-51ccfa29858c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:34.712417 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 769/1576] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:34 2022] PUT /identity/v3/projects/2574f9d0b3b94e2fa7a01af7a162ae29/users/af9f038ed8be415093c0049729945ce5/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:34.722361 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56ba44-e868-4f4f-9c1b-51ccfa29858c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:34.727217 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 808/1577] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:51:34 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:34.727217 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df8813-99ae-44d2-861d-0ea3480d77ec admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:34.775720 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56ba44-e868-4f4f-9c1b-51ccfa29858c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:34.781006 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7dcd4-c2ad-490e-ac01-4b339794e2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:34.781462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df8813-99ae-44d2-861d-0ea3480d77ec admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:34.781862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7dcd4-c2ad-490e-ac01-4b339794e2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:34.782257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7dcd4-c2ad-490e-ac01-4b339794e2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:34.782591 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7dcd4-c2ad-490e-ac01-4b339794e2c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:34.783315 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7dcd4-c2ad-490e-ac01-4b339794e2c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:34.785264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7dcd4-c2ad-490e-ac01-4b339794e2c9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:34.786105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dba8bf-d5e6-49af-844a-e28c9228ae25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:34.786779 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dba8bf-d5e6-49af-844a-e28c9228ae25 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:34.787067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dba8bf-d5e6-49af-844a-e28c9228ae25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:34.787348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dba8bf-d5e6-49af-844a-e28c9228ae25 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:34.788081 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dba8bf-d5e6-49af-844a-e28c9228ae25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:34.790240 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dba8bf-d5e6-49af-844a-e28c9228ae25 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:34.890684 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 770/1578] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:51:34 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:34.891417 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7dcd4-c2ad-490e-ac01-4b339794e2c9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:34.900573 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7dcd4-c2ad-490e-ac01-4b339794e2c9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:34.905118 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a86fcd-3e35-4845-a6d0-bf866e6b38d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:34.905746 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a86fcd-3e35-4845-a6d0-bf866e6b38d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:34.906027 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a86fcd-3e35-4845-a6d0-bf866e6b38d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:34.906302 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a86fcd-3e35-4845-a6d0-bf866e6b38d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:34.906974 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a86fcd-3e35-4845-a6d0-bf866e6b38d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:34.908900 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a86fcd-3e35-4845-a6d0-bf866e6b38d8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:34.920255 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 809/1579] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:51:34 2022] POST /identity/v3/users => generated 291 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:34.920255 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dba8bf-d5e6-49af-844a-e28c9228ae25 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:34.929343 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dba8bf-d5e6-49af-844a-e28c9228ae25 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:34.934322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99142b56-a844-4e6d-845e-c219c6f9d8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:34.934957 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99142b56-a844-4e6d-845e-c219c6f9d8bc admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:34.935236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99142b56-a844-4e6d-845e-c219c6f9d8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:34.935512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99142b56-a844-4e6d-845e-c219c6f9d8bc admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:34.936223 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99142b56-a844-4e6d-845e-c219c6f9d8bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:34.938095 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99142b56-a844-4e6d-845e-c219c6f9d8bc admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.010215 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 771/1580] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:51:34 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:35.013972 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a86fcd-3e35-4845-a6d0-bf866e6b38d8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.021259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a86fcd-3e35-4845-a6d0-bf866e6b38d8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.025771 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8de0b-3bcf-4a44-8248-bf497e28e8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.026419 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8de0b-3bcf-4a44-8248-bf497e28e8fb admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.026700 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8de0b-3bcf-4a44-8248-bf497e28e8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.026976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8de0b-3bcf-4a44-8248-bf497e28e8fb admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.027642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8de0b-3bcf-4a44-8248-bf497e28e8fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.029543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8de0b-3bcf-4a44-8248-bf497e28e8fb admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.039721 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 810/1581] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:51:34 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:35.040626 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99142b56-a844-4e6d-845e-c219c6f9d8bc admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.049897 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99142b56-a844-4e6d-845e-c219c6f9d8bc admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.054530 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a663dbe-b20d-482c-b386-108e1466723e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.055167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a663dbe-b20d-482c-b386-108e1466723e admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.055456 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a663dbe-b20d-482c-b386-108e1466723e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.055756 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a663dbe-b20d-482c-b386-108e1466723e admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.056482 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a663dbe-b20d-482c-b386-108e1466723e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.058573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a663dbe-b20d-482c-b386-108e1466723e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.068712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 811/1582] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:35.069867 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c91c3-ac61-4981-b550-2e5d55aec8d5 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.070157 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c91c3-ac61-4981-b550-2e5d55aec8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.070432 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c91c3-ac61-4981-b550-2e5d55aec8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.096103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-db7c91c3-ac61-4981-b550-2e5d55aec8d5 None None] MFA Rules not processed for user `af9f038ed8be415093c0049729945ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:35.097388 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-db7c91c3-ac61-4981-b550-2e5d55aec8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:35.130337 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 772/1583] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:51:35 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:35.131150 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8de0b-3bcf-4a44-8248-bf497e28e8fb admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.141163 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8de0b-3bcf-4a44-8248-bf497e28e8fb admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.145608 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b703a-1521-4702-a29b-d1d261468836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.146251 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b703a-1521-4702-a29b-d1d261468836 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.146533 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b703a-1521-4702-a29b-d1d261468836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.146806 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b703a-1521-4702-a29b-d1d261468836 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.147494 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b703a-1521-4702-a29b-d1d261468836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.149434 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b703a-1521-4702-a29b-d1d261468836 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.160085 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 812/1584] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:35.160918 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c91c3-ac61-4981-b550-2e5d55aec8d5 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.171831 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c91c3-ac61-4981-b550-2e5d55aec8d5 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.176441 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97945d90-0feb-4288-a38b-3adca87fd287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.177116 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97945d90-0feb-4288-a38b-3adca87fd287 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.177399 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97945d90-0feb-4288-a38b-3adca87fd287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.177721 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97945d90-0feb-4288-a38b-3adca87fd287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.178503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97945d90-0feb-4288-a38b-3adca87fd287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.180137 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97945d90-0feb-4288-a38b-3adca87fd287 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.190286 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 813/1585] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:35.191046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97945d90-0feb-4288-a38b-3adca87fd287 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.200005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97945d90-0feb-4288-a38b-3adca87fd287 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.204553 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5f1c1-c861-42b1-bdbc-2f9df9225b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.205145 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5f1c1-c861-42b1-bdbc-2f9df9225b84 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.205430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5f1c1-c861-42b1-bdbc-2f9df9225b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.205702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5f1c1-c861-42b1-bdbc-2f9df9225b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.206389 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5f1c1-c861-42b1-bdbc-2f9df9225b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.207927 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5f1c1-c861-42b1-bdbc-2f9df9225b84 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.217096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 814/1586] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:35.217836 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5f1c1-c861-42b1-bdbc-2f9df9225b84 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.226721 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5f1c1-c861-42b1-bdbc-2f9df9225b84 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.227913 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 773/1587] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:51:35 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:35.228931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b703a-1521-4702-a29b-d1d261468836 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.231929 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e47f0-1e61-46a6-9286-26e28f6553b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.232569 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e47f0-1e61-46a6-9286-26e28f6553b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.232853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e47f0-1e61-46a6-9286-26e28f6553b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.233126 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e47f0-1e61-46a6-9286-26e28f6553b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.233843 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e47f0-1e61-46a6-9286-26e28f6553b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.235399 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e47f0-1e61-46a6-9286-26e28f6553b0 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.239061 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b703a-1521-4702-a29b-d1d261468836 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.243818 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e44bf-c0c1-4740-b173-bba3438a29fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.245538 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e44bf-c0c1-4740-b173-bba3438a29fb admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.245538 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e44bf-c0c1-4740-b173-bba3438a29fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.245892 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e44bf-c0c1-4740-b173-bba3438a29fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.246359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e44bf-c0c1-4740-b173-bba3438a29fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.246527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 815/1588] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:35.247326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e47f0-1e61-46a6-9286-26e28f6553b0 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.247985 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e44bf-c0c1-4740-b173-bba3438a29fb admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.257014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e47f0-1e61-46a6-9286-26e28f6553b0 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.258277 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 774/1589] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:35.259077 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e44bf-c0c1-4740-b173-bba3438a29fb admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.262426 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256c1f2-0e6d-440b-9179-caa34ee9139e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.263303 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256c1f2-0e6d-440b-9179-caa34ee9139e admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.263588 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256c1f2-0e6d-440b-9179-caa34ee9139e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.263899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256c1f2-0e6d-440b-9179-caa34ee9139e admin admin] PATH_INFO: `/v3/projects/a3b3fff43ea54c74bb52d76d2264d008/users/0a93626f8db64b7193772320bfb3ed5a/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.270851 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e44bf-c0c1-4740-b173-bba3438a29fb admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.275343 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2c7fb-7789-4cca-ae2e-5528918f4296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.276041 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2c7fb-7789-4cca-ae2e-5528918f4296 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.276866 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2c7fb-7789-4cca-ae2e-5528918f4296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.277139 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2c7fb-7789-4cca-ae2e-5528918f4296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.277852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2c7fb-7789-4cca-ae2e-5528918f4296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.278914 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256c1f2-0e6d-440b-9179-caa34ee9139e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b3fff43ea54c74bb52d76d2264d008, user_id=0a93626f8db64b7193772320bfb3ed5a, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.279414 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2c7fb-7789-4cca-ae2e-5528918f4296 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.281583 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256c1f2-0e6d-440b-9179-caa34ee9139e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.289678 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 775/1590] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:35.290320 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2c7fb-7789-4cca-ae2e-5528918f4296 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.299617 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2c7fb-7789-4cca-ae2e-5528918f4296 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.304268 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a22d2-331f-4358-a258-d76a6e957e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.304878 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a22d2-331f-4358-a258-d76a6e957e35 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.305162 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a22d2-331f-4358-a258-d76a6e957e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.305447 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a22d2-331f-4358-a258-d76a6e957e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.306131 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a22d2-331f-4358-a258-d76a6e957e35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.308036 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a22d2-331f-4358-a258-d76a6e957e35 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.330237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 816/1591] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:35 2022] PUT /identity/v3/projects/a3b3fff43ea54c74bb52d76d2264d008/users/0a93626f8db64b7193772320bfb3ed5a/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:35.331133 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256c1f2-0e6d-440b-9179-caa34ee9139e admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.377303 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 776/1592] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:51:35 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:35.378359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a22d2-331f-4358-a258-d76a6e957e35 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.390160 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256c1f2-0e6d-440b-9179-caa34ee9139e admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.438773 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a22d2-331f-4358-a258-d76a6e957e35 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.443515 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894e8cf-6615-4b6a-b07c-0f63dee39619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.444098 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f4c68-e4dc-42fb-8a22-0735069c4ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.444237 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894e8cf-6615-4b6a-b07c-0f63dee39619 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.444482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894e8cf-6615-4b6a-b07c-0f63dee39619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.444759 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894e8cf-6615-4b6a-b07c-0f63dee39619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.444868 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f4c68-e4dc-42fb-8a22-0735069c4ade admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.445045 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f4c68-e4dc-42fb-8a22-0735069c4ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.445294 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f4c68-e4dc-42fb-8a22-0735069c4ade admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.445490 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894e8cf-6615-4b6a-b07c-0f63dee39619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.446049 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f4c68-e4dc-42fb-8a22-0735069c4ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.447122 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894e8cf-6615-4b6a-b07c-0f63dee39619 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.447638 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f4c68-e4dc-42fb-8a22-0735069c4ade admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.457710 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 777/1593] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:35.457850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 817/1594] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:35.458251 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894e8cf-6615-4b6a-b07c-0f63dee39619 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.458376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f4c68-e4dc-42fb-8a22-0735069c4ade admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.468282 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f4c68-e4dc-42fb-8a22-0735069c4ade admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.468466 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894e8cf-6615-4b6a-b07c-0f63dee39619 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.472841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc6c88-7ec2-4468-ad02-09c26f83fbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.473050 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b73c82-f60b-4e91-8eb3-84f7d78bff92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.473474 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc6c88-7ec2-4468-ad02-09c26f83fbaa admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.473704 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b73c82-f60b-4e91-8eb3-84f7d78bff92 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.473808 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc6c88-7ec2-4468-ad02-09c26f83fbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.474007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc6c88-7ec2-4468-ad02-09c26f83fbaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.474122 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b73c82-f60b-4e91-8eb3-84f7d78bff92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.474369 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b73c82-f60b-4e91-8eb3-84f7d78bff92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.474713 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc6c88-7ec2-4468-ad02-09c26f83fbaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.475101 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b73c82-f60b-4e91-8eb3-84f7d78bff92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.476309 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc6c88-7ec2-4468-ad02-09c26f83fbaa admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.476703 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b73c82-f60b-4e91-8eb3-84f7d78bff92 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.486005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 778/1595] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:35.489725 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 818/1596] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:35.489864 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc6c88-7ec2-4468-ad02-09c26f83fbaa admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.489962 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b73c82-f60b-4e91-8eb3-84f7d78bff92 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.496666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc6c88-7ec2-4468-ad02-09c26f83fbaa admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.497415 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b73c82-f60b-4e91-8eb3-84f7d78bff92 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.501349 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81913671-2955-4930-9304-8ad5636e6a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.501982 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81913671-2955-4930-9304-8ad5636e6a41 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.502114 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad16b27-6717-4d09-930a-ca610dbcc5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.502262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81913671-2955-4930-9304-8ad5636e6a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.502538 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81913671-2955-4930-9304-8ad5636e6a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.502683 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad16b27-6717-4d09-930a-ca610dbcc5ff admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.502966 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad16b27-6717-4d09-930a-ca610dbcc5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.503238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad16b27-6717-4d09-930a-ca610dbcc5ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.503345 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81913671-2955-4930-9304-8ad5636e6a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.503985 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad16b27-6717-4d09-930a-ca610dbcc5ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.504836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81913671-2955-4930-9304-8ad5636e6a41 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.505634 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad16b27-6717-4d09-930a-ca610dbcc5ff admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.515461 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 779/1597] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:35.519776 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c982984-5964-4c0b-8f9d-5cf5d84fcf58 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.519926 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 819/1598] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:35.520046 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c982984-5964-4c0b-8f9d-5cf5d84fcf58 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.520046 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c982984-5964-4c0b-8f9d-5cf5d84fcf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.520256 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad16b27-6717-4d09-930a-ca610dbcc5ff admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.529178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad16b27-6717-4d09-930a-ca610dbcc5ff admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.533737 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878a470-51df-4a14-a5d5-73254bc57406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.534377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878a470-51df-4a14-a5d5-73254bc57406 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.534662 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878a470-51df-4a14-a5d5-73254bc57406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.534938 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878a470-51df-4a14-a5d5-73254bc57406 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.535387 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0c982984-5964-4c0b-8f9d-5cf5d84fcf58 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:35.535620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878a470-51df-4a14-a5d5-73254bc57406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.536602 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0c982984-5964-4c0b-8f9d-5cf5d84fcf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:35.537531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878a470-51df-4a14-a5d5-73254bc57406 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.544637 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 780/1599] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:35.545610 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c982984-5964-4c0b-8f9d-5cf5d84fcf58 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.554996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c982984-5964-4c0b-8f9d-5cf5d84fcf58 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.560132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2273c-8c3a-4483-a5e6-3cff2cface3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.560996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2273c-8c3a-4483-a5e6-3cff2cface3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.561276 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2273c-8c3a-4483-a5e6-3cff2cface3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.561548 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2273c-8c3a-4483-a5e6-3cff2cface3a admin admin] PATH_INFO: `/v3/projects/ecaca50e2b78466bb959545d64015071/users/340fcb8721eb4ed6b1330a1f6037da61/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.576407 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2273c-8c3a-4483-a5e6-3cff2cface3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecaca50e2b78466bb959545d64015071, user_id=340fcb8721eb4ed6b1330a1f6037da61, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.579056 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2273c-8c3a-4483-a5e6-3cff2cface3a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.615539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 820/1600] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:51:35 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:35.616511 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878a470-51df-4a14-a5d5-73254bc57406 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.626432 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878a470-51df-4a14-a5d5-73254bc57406 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.630950 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc97896-2a39-46c8-881b-48b5826036fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.631848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc97896-2a39-46c8-881b-48b5826036fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.632140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc97896-2a39-46c8-881b-48b5826036fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.632411 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc97896-2a39-46c8-881b-48b5826036fc admin admin] PATH_INFO: `/v3/projects/17e242b10baa41318b0f6cc72f0dbe24/users/349e317229ad4103a8dc5bae31e0fc0a/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.639769 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 781/1601] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:35 2022] PUT /identity/v3/projects/ecaca50e2b78466bb959545d64015071/users/340fcb8721eb4ed6b1330a1f6037da61/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:35.641898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2273c-8c3a-4483-a5e6-3cff2cface3a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.657335 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc97896-2a39-46c8-881b-48b5826036fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e242b10baa41318b0f6cc72f0dbe24, user_id=349e317229ad4103a8dc5bae31e0fc0a, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.660127 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc97896-2a39-46c8-881b-48b5826036fc admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.704904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2273c-8c3a-4483-a5e6-3cff2cface3a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.709461 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549365e2-aa3e-4398-bc06-63972cb73161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.710127 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549365e2-aa3e-4398-bc06-63972cb73161 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.710413 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549365e2-aa3e-4398-bc06-63972cb73161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.710689 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549365e2-aa3e-4398-bc06-63972cb73161 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.711417 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549365e2-aa3e-4398-bc06-63972cb73161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.713046 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549365e2-aa3e-4398-bc06-63972cb73161 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.722510 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 782/1602] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:35.723298 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549365e2-aa3e-4398-bc06-63972cb73161 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.731343 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 821/1603] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:35 2022] PUT /identity/v3/projects/17e242b10baa41318b0f6cc72f0dbe24/users/349e317229ad4103a8dc5bae31e0fc0a/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:35.734028 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc97896-2a39-46c8-881b-48b5826036fc admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.734134 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549365e2-aa3e-4398-bc06-63972cb73161 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.794993 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc97896-2a39-46c8-881b-48b5826036fc admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.795755 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1724b2f-80b1-4975-855f-3f42e41e8f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.796857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1724b2f-80b1-4975-855f-3f42e41e8f29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.797367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1724b2f-80b1-4975-855f-3f42e41e8f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.797872 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1724b2f-80b1-4975-855f-3f42e41e8f29 admin admin] PATH_INFO: `/v3/projects/b772df3ea0d9417188aab057dce4d320/users/13ef78da38e941b3a09f1de838581d54/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.800261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1609a5a-19be-4bf9-9cd3-2162f0d441d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.801181 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1609a5a-19be-4bf9-9cd3-2162f0d441d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.806083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1609a5a-19be-4bf9-9cd3-2162f0d441d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.806083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1609a5a-19be-4bf9-9cd3-2162f0d441d7 admin admin] PATH_INFO: `/v3/projects/c99ca6d9d066495aba5384420764c3d3/users/9b5f04c541a1451a93e200bf9b6a4a3e/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:35.815133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1724b2f-80b1-4975-855f-3f42e41e8f29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b772df3ea0d9417188aab057dce4d320, user_id=13ef78da38e941b3a09f1de838581d54, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.817250 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1609a5a-19be-4bf9-9cd3-2162f0d441d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c99ca6d9d066495aba5384420764c3d3, user_id=9b5f04c541a1451a93e200bf9b6a4a3e, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:35.818414 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1724b2f-80b1-4975-855f-3f42e41e8f29 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.820123 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1609a5a-19be-4bf9-9cd3-2162f0d441d7 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:35.890662 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 783/1604] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:35 2022] PUT /identity/v3/projects/b772df3ea0d9417188aab057dce4d320/users/13ef78da38e941b3a09f1de838581d54/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:35.891470 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1724b2f-80b1-4975-855f-3f42e41e8f29 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.904264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 822/1605] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:35 2022] PUT /identity/v3/projects/c99ca6d9d066495aba5384420764c3d3/users/9b5f04c541a1451a93e200bf9b6a4a3e/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:35.904264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1609a5a-19be-4bf9-9cd3-2162f0d441d7 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:35.952051 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1724b2f-80b1-4975-855f-3f42e41e8f29 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.955745 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1609a5a-19be-4bf9-9cd3-2162f0d441d7 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:35.959306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f17d1-7c40-49ca-a5c5-f66c9ef34425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:35.959990 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f17d1-7c40-49ca-a5c5-f66c9ef34425 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:35.960281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f17d1-7c40-49ca-a5c5-f66c9ef34425 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:35.960558 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f17d1-7c40-49ca-a5c5-f66c9ef34425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:36.009315 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac6ffb-a066-45d2-9ef8-dd026dcb3e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:36.010265 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac6ffb-a066-45d2-9ef8-dd026dcb3e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:36.011817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac6ffb-a066-45d2-9ef8-dd026dcb3e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:36.012105 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac6ffb-a066-45d2-9ef8-dd026dcb3e78 admin admin] PATH_INFO: `/v3/projects/91ccbfb303dc40a7a2313fe5e6ab3332/users/9f11c63feb0740aeb5283907c8b61680/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:36.020209 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f17d1-7c40-49ca-a5c5-f66c9ef34425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:36.021648 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f17d1-7c40-49ca-a5c5-f66c9ef34425 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:36.029903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac6ffb-a066-45d2-9ef8-dd026dcb3e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ccbfb303dc40a7a2313fe5e6ab3332, user_id=9f11c63feb0740aeb5283907c8b61680, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:36.032454 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac6ffb-a066-45d2-9ef8-dd026dcb3e78 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:36.032639 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 823/1606] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:36.033285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f17d1-7c40-49ca-a5c5-f66c9ef34425 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:36.042600 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f17d1-7c40-49ca-a5c5-f66c9ef34425 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:36.047461 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9421a4-912b-43eb-a669-410b71d49b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:36.048157 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9421a4-912b-43eb-a669-410b71d49b86 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:36.048440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9421a4-912b-43eb-a669-410b71d49b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:36.048714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9421a4-912b-43eb-a669-410b71d49b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:36.049445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9421a4-912b-43eb-a669-410b71d49b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:36.051018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9421a4-912b-43eb-a669-410b71d49b86 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:36.061317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 824/1607] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:36.062614 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecb999-93ec-4b71-8caf-97046f24b5ba None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:36.062906 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecb999-93ec-4b71-8caf-97046f24b5ba None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:36.063180 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecb999-93ec-4b71-8caf-97046f24b5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:36.089287 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-49ecb999-93ec-4b71-8caf-97046f24b5ba None None] MFA Rules not processed for user `340fcb8721eb4ed6b1330a1f6037da61`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:36.090475 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-49ecb999-93ec-4b71-8caf-97046f24b5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:36.143177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 784/1608] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:35 2022] PUT /identity/v3/projects/91ccbfb303dc40a7a2313fe5e6ab3332/users/9f11c63feb0740aeb5283907c8b61680/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:36.144277 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac6ffb-a066-45d2-9ef8-dd026dcb3e78 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:36.154145 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 825/1609] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:36.155761 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217d318-c3ff-4b95-8b14-19ea5f64e03e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:36.156285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217d318-c3ff-4b95-8b14-19ea5f64e03e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:36.156557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217d318-c3ff-4b95-8b14-19ea5f64e03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:36.184655 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d217d318-c3ff-4b95-8b14-19ea5f64e03e None None] MFA Rules not processed for user `349e317229ad4103a8dc5bae31e0fc0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:36.185918 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d217d318-c3ff-4b95-8b14-19ea5f64e03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:36.212807 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac6ffb-a066-45d2-9ef8-dd026dcb3e78 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:36.219933 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de3857-a290-4ac7-ad63-5c2ed24c6d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:36.220898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de3857-a290-4ac7-ad63-5c2ed24c6d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:36.221261 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de3857-a290-4ac7-ad63-5c2ed24c6d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:36.221530 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de3857-a290-4ac7-ad63-5c2ed24c6d7d admin admin] PATH_INFO: `/v3/projects/6ef9efe106ae4485a4d137377f1890e3/users/d77bf80654c24c8c8336ce395f789ccb/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:36.236545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de3857-a290-4ac7-ad63-5c2ed24c6d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef9efe106ae4485a4d137377f1890e3, user_id=d77bf80654c24c8c8336ce395f789ccb, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:36.239400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de3857-a290-4ac7-ad63-5c2ed24c6d7d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:36.252110 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 826/1610] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:36.253416 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df50e9-a0de-4c37-841f-9f486c3fa5cc None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:36.253710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df50e9-a0de-4c37-841f-9f486c3fa5cc None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:36.253990 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df50e9-a0de-4c37-841f-9f486c3fa5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:36.271168 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-59df50e9-a0de-4c37-841f-9f486c3fa5cc None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:36.276949 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-59df50e9-a0de-4c37-841f-9f486c3fa5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:36.280792 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 827/1611] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:36.281987 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675ba07-fe55-4c89-8884-a101671fc3ed None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:36.282275 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675ba07-fe55-4c89-8884-a101671fc3ed None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:36.282551 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675ba07-fe55-4c89-8884-a101671fc3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:36.308862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-b675ba07-fe55-4c89-8884-a101671fc3ed None None] MFA Rules not processed for user `9b5f04c541a1451a93e200bf9b6a4a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:36.310031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b675ba07-fe55-4c89-8884-a101671fc3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:36.370448 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 785/1612] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:36 2022] PUT /identity/v3/projects/6ef9efe106ae4485a4d137377f1890e3/users/d77bf80654c24c8c8336ce395f789ccb/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:36.370448 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de3857-a290-4ac7-ad63-5c2ed24c6d7d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:36.378665 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 828/1613] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:36.378665 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3645b1-7953-4e23-a224-1ef1d5d34e4f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:36.378665 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3645b1-7953-4e23-a224-1ef1d5d34e4f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:36.378665 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3645b1-7953-4e23-a224-1ef1d5d34e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:36.404224 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-0e3645b1-7953-4e23-a224-1ef1d5d34e4f None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:36.406406 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0e3645b1-7953-4e23-a224-1ef1d5d34e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:36.439658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de3857-a290-4ac7-ad63-5c2ed24c6d7d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:36.445322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f885955-ac61-45f5-937c-4bc5e3e147d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:36.446335 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f885955-ac61-45f5-937c-4bc5e3e147d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:36.446741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f885955-ac61-45f5-937c-4bc5e3e147d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:36.447119 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f885955-ac61-45f5-937c-4bc5e3e147d2 admin admin] PATH_INFO: `/v3/projects/8b234fa9e1d34941b4015afcb71095c5/users/1868f2e1b0a94ef195948d0fdaf53e1a/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:36.463077 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f885955-ac61-45f5-937c-4bc5e3e147d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b234fa9e1d34941b4015afcb71095c5, user_id=1868f2e1b0a94ef195948d0fdaf53e1a, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:36.465730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f885955-ac61-45f5-937c-4bc5e3e147d2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:36.470673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 829/1614] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:36.471832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3645b1-7953-4e23-a224-1ef1d5d34e4f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:36.481669 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3645b1-7953-4e23-a224-1ef1d5d34e4f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:36.486348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfce5b-ef5f-4c48-8f86-445cce070ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:36.486995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfce5b-ef5f-4c48-8f86-445cce070ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:36.487279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfce5b-ef5f-4c48-8f86-445cce070ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:36.487562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfce5b-ef5f-4c48-8f86-445cce070ee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:36.488311 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfce5b-ef5f-4c48-8f86-445cce070ee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:36.490208 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfce5b-ef5f-4c48-8f86-445cce070ee7 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:36.519411 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 786/1615] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:36 2022] PUT /identity/v3/projects/8b234fa9e1d34941b4015afcb71095c5/users/1868f2e1b0a94ef195948d0fdaf53e1a/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:36.520131 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f885955-ac61-45f5-937c-4bc5e3e147d2 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:36.576534 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 830/1616] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:51:36 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:36.576534 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfce5b-ef5f-4c48-8f86-445cce070ee7 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:36.578010 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c7dfce5b-ef5f-4c48-8f86-445cce070ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:36.583701 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f885955-ac61-45f5-937c-4bc5e3e147d2 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:36.656784 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a13d43-90dd-45b9-8dd8-c0978246d41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:36.657495 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a13d43-90dd-45b9-8dd8-c0978246d41c admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:36.657783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a13d43-90dd-45b9-8dd8-c0978246d41c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:36.658064 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a13d43-90dd-45b9-8dd8-c0978246d41c admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:36.658941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a13d43-90dd-45b9-8dd8-c0978246d41c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:36.661069 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a13d43-90dd-45b9-8dd8-c0978246d41c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:36.764029 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 787/1617] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:51:36 2022] POST /identity/v3/projects => generated 381 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:36.765312 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e1229-b5ef-4e7c-859c-92d221a0f97a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:36.765604 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e1229-b5ef-4e7c-859c-92d221a0f97a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:36.765875 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e1229-b5ef-4e7c-859c-92d221a0f97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:36.775672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfce5b-ef5f-4c48-8f86-445cce070ee7 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:36.787993 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-372e1229-b5ef-4e7c-859c-92d221a0f97a None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:36.789486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-372e1229-b5ef-4e7c-859c-92d221a0f97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:36.840308 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494368b-f354-4645-ad90-cff935be8ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:36.840971 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494368b-f354-4645-ad90-cff935be8ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:36.841249 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494368b-f354-4645-ad90-cff935be8ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:36.841521 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494368b-f354-4645-ad90-cff935be8ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:36.857113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 788/1618] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:36.857113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257c79f-fe21-43e1-be3f-7f383ed9f096 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:36.857113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257c79f-fe21-43e1-be3f-7f383ed9f096 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:36.857113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257c79f-fe21-43e1-be3f-7f383ed9f096 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:36.858913 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 789/1619] 10.222.0.25 () {54 vars in 961 bytes} [Thu May 12 06:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:51:36.859787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257c79f-fe21-43e1-be3f-7f383ed9f096 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:36.872506 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257c79f-fe21-43e1-be3f-7f383ed9f096 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:36.876567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5febeb2-155b-41d1-b55a-7e856e704682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:36.878189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5febeb2-155b-41d1-b55a-7e856e704682 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:36.878189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5febeb2-155b-41d1-b55a-7e856e704682 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:36.878189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5febeb2-155b-41d1-b55a-7e856e704682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:36.888754 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5febeb2-155b-41d1-b55a-7e856e704682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:36.890804 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5febeb2-155b-41d1-b55a-7e856e704682 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:36.901079 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 790/1620] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:36.902036 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5febeb2-155b-41d1-b55a-7e856e704682 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:36.910121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494368b-f354-4645-ad90-cff935be8ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:36.911119 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5febeb2-155b-41d1-b55a-7e856e704682 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:36.911556 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494368b-f354-4645-ad90-cff935be8ec7 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:36.917619 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa31e5-e6d9-47e6-8d12-ba836f07f019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:36.917891 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa31e5-e6d9-47e6-8d12-ba836f07f019 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:36.918086 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa31e5-e6d9-47e6-8d12-ba836f07f019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:36.918340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa31e5-e6d9-47e6-8d12-ba836f07f019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:36.919067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa31e5-e6d9-47e6-8d12-ba836f07f019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:36.920760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa31e5-e6d9-47e6-8d12-ba836f07f019 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:36.922119 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 831/1621] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:36.925081 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494368b-f354-4645-ad90-cff935be8ec7 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:36.931545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 791/1622] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:36.932464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa31e5-e6d9-47e6-8d12-ba836f07f019 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:36.938462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494368b-f354-4645-ad90-cff935be8ec7 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:36.942264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa31e5-e6d9-47e6-8d12-ba836f07f019 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:36.946137 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac3404-c6ec-4af2-acdf-330faf12b054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:36.946840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac3404-c6ec-4af2-acdf-330faf12b054 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:36.947126 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac3404-c6ec-4af2-acdf-330faf12b054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:36.947395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac3404-c6ec-4af2-acdf-330faf12b054 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:36.947665 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a378a8-87ca-432c-8b0d-6b23c8fe4f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:36.948682 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac3404-c6ec-4af2-acdf-330faf12b054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:36.948949 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a378a8-87ca-432c-8b0d-6b23c8fe4f94 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:36.949283 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a378a8-87ca-432c-8b0d-6b23c8fe4f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:36.949623 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a378a8-87ca-432c-8b0d-6b23c8fe4f94 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:36.950309 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a378a8-87ca-432c-8b0d-6b23c8fe4f94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:36.950548 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac3404-c6ec-4af2-acdf-330faf12b054 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:36.952403 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a378a8-87ca-432c-8b0d-6b23c8fe4f94 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:37.070860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 792/1623] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:51:36 2022] POST /identity/v3/users => generated 297 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:37.072595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c23ea1-7d0a-4f1d-b6a8-30830ab58875 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:37.073121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c23ea1-7d0a-4f1d-b6a8-30830ab58875 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:37.073543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c23ea1-7d0a-4f1d-b6a8-30830ab58875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:37.074547 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 832/1624] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:51:36 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:37.077584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac3404-c6ec-4af2-acdf-330faf12b054 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:37.087516 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac3404-c6ec-4af2-acdf-330faf12b054 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:37.093091 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd6479-b3f7-4ca9-bc1e-43a591983f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:37.093847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd6479-b3f7-4ca9-bc1e-43a591983f49 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:37.094124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd6479-b3f7-4ca9-bc1e-43a591983f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:37.094451 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd6479-b3f7-4ca9-bc1e-43a591983f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:37.095397 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-04c23ea1-7d0a-4f1d-b6a8-30830ab58875 None None] MFA Rules not processed for user `bbcd54a927bf46f183b50fbda677868d`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:37.096644 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-04c23ea1-7d0a-4f1d-b6a8-30830ab58875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:37.105050 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd6479-b3f7-4ca9-bc1e-43a591983f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:37.106743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd6479-b3f7-4ca9-bc1e-43a591983f49 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:37.116710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 833/1625] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:37.117696 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd6479-b3f7-4ca9-bc1e-43a591983f49 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:37.128670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd6479-b3f7-4ca9-bc1e-43a591983f49 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:37.135178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83689890-3174-4566-a85c-fc982db4b5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:37.135178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83689890-3174-4566-a85c-fc982db4b5ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:37.135178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83689890-3174-4566-a85c-fc982db4b5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:37.135574 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83689890-3174-4566-a85c-fc982db4b5ae admin admin] PATH_INFO: `/v3/projects/8b234fa9e1d34941b4015afcb71095c5/users/1868f2e1b0a94ef195948d0fdaf53e1a/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:37.137670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83689890-3174-4566-a85c-fc982db4b5ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b234fa9e1d34941b4015afcb71095c5, user_id=1868f2e1b0a94ef195948d0fdaf53e1a, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:37.141429 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83689890-3174-4566-a85c-fc982db4b5ae admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:37.165742 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 834/1626] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:37 2022] PUT /identity/v3/projects/8b234fa9e1d34941b4015afcb71095c5/users/1868f2e1b0a94ef195948d0fdaf53e1a/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:37.168318 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83689890-3174-4566-a85c-fc982db4b5ae admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:37.181677 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 793/1627] 10.222.0.25 () {58 vars in 1058 bytes} [Thu May 12 06:51:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:37.183311 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c23ea1-7d0a-4f1d-b6a8-30830ab58875 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:37.193540 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c23ea1-7d0a-4f1d-b6a8-30830ab58875 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:37.242385 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83689890-3174-4566-a85c-fc982db4b5ae admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:37.250651 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820efbe3-147c-4bc0-8538-32303ee548d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:37.251566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820efbe3-147c-4bc0-8538-32303ee548d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:37.252366 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820efbe3-147c-4bc0-8538-32303ee548d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:37.253086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820efbe3-147c-4bc0-8538-32303ee548d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:37.254117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820efbe3-147c-4bc0-8538-32303ee548d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:37.255952 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820efbe3-147c-4bc0-8538-32303ee548d2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:37.278694 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bd9ca-919e-499d-af8d-c9cca5eb82e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:37.279198 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 835/1628] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:37.280059 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bd9ca-919e-499d-af8d-c9cca5eb82e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:37.286690 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bd9ca-919e-499d-af8d-c9cca5eb82e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:37.286847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873de873-4b24-405c-a6db-26f2351db7a2 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:37.286963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bd9ca-919e-499d-af8d-c9cca5eb82e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:37.287126 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873de873-4b24-405c-a6db-26f2351db7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:37.287126 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873de873-4b24-405c-a6db-26f2351db7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:37.287338 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bd9ca-919e-499d-af8d-c9cca5eb82e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:37.287338 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bd9ca-919e-499d-af8d-c9cca5eb82e0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:37.300308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 794/1629] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:37.301395 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bd9ca-919e-499d-af8d-c9cca5eb82e0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:37.316986 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-873de873-4b24-405c-a6db-26f2351db7a2 None None] MFA Rules not processed for user `1868f2e1b0a94ef195948d0fdaf53e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:37.330628 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-873de873-4b24-405c-a6db-26f2351db7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:37.417378 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bd9ca-919e-499d-af8d-c9cca5eb82e0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:37.424269 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfb64a-8556-4144-b2e5-7bf1bd6eb1ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:37.425054 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfb64a-8556-4144-b2e5-7bf1bd6eb1ed service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:37.425337 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfb64a-8556-4144-b2e5-7bf1bd6eb1ed service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:37.425640 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfb64a-8556-4144-b2e5-7bf1bd6eb1ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:37.435494 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 836/1630] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:37.437136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873de873-4b24-405c-a6db-26f2351db7a2 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:37.450071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873de873-4b24-405c-a6db-26f2351db7a2 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:37.456492 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fd579-0331-48d0-ac62-d494bf952367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:37.457451 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fd579-0331-48d0-ac62-d494bf952367 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:37.457742 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fd579-0331-48d0-ac62-d494bf952367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:37.458018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fd579-0331-48d0-ac62-d494bf952367 admin admin] PATH_INFO: `/v3/projects/1b25fc4c036a4229aba8fb22ea40ffec/users/1196e5fdbd9c4b5d9464670cabb8ba93/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:37.477578 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9fd579-0331-48d0-ac62-d494bf952367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b25fc4c036a4229aba8fb22ea40ffec, user_id=1196e5fdbd9c4b5d9464670cabb8ba93, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:37.482445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9fd579-0331-48d0-ac62-d494bf952367 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:37.489722 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfb64a-8556-4144-b2e5-7bf1bd6eb1ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:37.491670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfb64a-8556-4144-b2e5-7bf1bd6eb1ed service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:37.503456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 795/1631] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:37.506090 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfb64a-8556-4144-b2e5-7bf1bd6eb1ed service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:37.519092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfb64a-8556-4144-b2e5-7bf1bd6eb1ed service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:37.531824 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a7d76-147c-463e-ab8a-79e8aa5c66ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:37.532800 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a7d76-147c-463e-ab8a-79e8aa5c66ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:37.533089 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a7d76-147c-463e-ab8a-79e8aa5c66ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:37.533380 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a7d76-147c-463e-ab8a-79e8aa5c66ff admin admin] PATH_INFO: `/v3/projects/a8c1151f59854a688639667cd8c07575/users/4df2c64c32ab4cf48240bebeafd19ac0/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:37.556628 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a7d76-147c-463e-ab8a-79e8aa5c66ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c1151f59854a688639667cd8c07575, user_id=4df2c64c32ab4cf48240bebeafd19ac0, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:37.559906 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a7d76-147c-463e-ab8a-79e8aa5c66ff admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:37.636730 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 837/1632] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:37 2022] PUT /identity/v3/projects/1b25fc4c036a4229aba8fb22ea40ffec/users/1196e5fdbd9c4b5d9464670cabb8ba93/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:37.646179 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129343f-6d7f-446b-b9b7-9d5315934719 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:37.648724 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129343f-6d7f-446b-b9b7-9d5315934719 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:37.649198 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129343f-6d7f-446b-b9b7-9d5315934719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:37.662075 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 796/1633] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:37 2022] PUT /identity/v3/projects/a8c1151f59854a688639667cd8c07575/users/4df2c64c32ab4cf48240bebeafd19ac0/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:37.666493 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a7d76-147c-463e-ab8a-79e8aa5c66ff admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:37.776249 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-2129343f-6d7f-446b-b9b7-9d5315934719 None None] MFA Rules not processed for user `0a93626f8db64b7193772320bfb3ed5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:37.777486 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2129343f-6d7f-446b-b9b7-9d5315934719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:37.790792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a7d76-147c-463e-ab8a-79e8aa5c66ff admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:37.802112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b6d58-89fa-49a8-985c-52a1f357aa98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:37.803301 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b6d58-89fa-49a8-985c-52a1f357aa98 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:37.803611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b6d58-89fa-49a8-985c-52a1f357aa98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:37.803894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b6d58-89fa-49a8-985c-52a1f357aa98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:37.939461 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b6d58-89fa-49a8-985c-52a1f357aa98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:37.950989 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 838/1634] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:37.952423 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129343f-6d7f-446b-b9b7-9d5315934719 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:37.954434 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b6d58-89fa-49a8-985c-52a1f357aa98 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:37.996665 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 797/1635] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:37.998543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b6d58-89fa-49a8-985c-52a1f357aa98 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:38.087102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129343f-6d7f-446b-b9b7-9d5315934719 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:38.096091 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b6d58-89fa-49a8-985c-52a1f357aa98 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:38.096423 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd90708-d1b9-4dd2-9b39-de192c7f19f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:38.097337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd90708-d1b9-4dd2-9b39-de192c7f19f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:38.097874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd90708-d1b9-4dd2-9b39-de192c7f19f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:38.098379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd90708-d1b9-4dd2-9b39-de192c7f19f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:38.099322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd90708-d1b9-4dd2-9b39-de192c7f19f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:38.101129 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41ba9b-2478-4441-a393-eeb9b4afcce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:38.101765 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd90708-d1b9-4dd2-9b39-de192c7f19f8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:38.101881 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41ba9b-2478-4441-a393-eeb9b4afcce8 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:38.102176 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41ba9b-2478-4441-a393-eeb9b4afcce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:38.102453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41ba9b-2478-4441-a393-eeb9b4afcce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:38.103179 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41ba9b-2478-4441-a393-eeb9b4afcce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:38.104894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41ba9b-2478-4441-a393-eeb9b4afcce8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:38.117574 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 839/1636] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:38.120426 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48412ce-f638-4ea0-b52c-8fc9995c23d7 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:38.120987 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48412ce-f638-4ea0-b52c-8fc9995c23d7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:38.121570 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48412ce-f638-4ea0-b52c-8fc9995c23d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:38.138702 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 798/1637] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:38.139792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41ba9b-2478-4441-a393-eeb9b4afcce8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:38.158722 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-c48412ce-f638-4ea0-b52c-8fc9995c23d7 None None] MFA Rules not processed for user `0a93626f8db64b7193772320bfb3ed5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:38.160019 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c48412ce-f638-4ea0-b52c-8fc9995c23d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:38.160746 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41ba9b-2478-4441-a393-eeb9b4afcce8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:38.178053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5cfe9-b4f1-44f1-be34-92cf029e8631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:38.179311 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5cfe9-b4f1-44f1-be34-92cf029e8631 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:38.179650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5cfe9-b4f1-44f1-be34-92cf029e8631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:38.180033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5cfe9-b4f1-44f1-be34-92cf029e8631 admin admin] PATH_INFO: `/v3/projects/1b25fc4c036a4229aba8fb22ea40ffec/users/1196e5fdbd9c4b5d9464670cabb8ba93/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:38.183234 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5cfe9-b4f1-44f1-be34-92cf029e8631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b25fc4c036a4229aba8fb22ea40ffec, user_id=1196e5fdbd9c4b5d9464670cabb8ba93, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:38.186581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 840/1638] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:38.187466 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48412ce-f638-4ea0-b52c-8fc9995c23d7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:38.188313 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5cfe9-b4f1-44f1-be34-92cf029e8631 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:38.212751 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48412ce-f638-4ea0-b52c-8fc9995c23d7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:38.213185 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 799/1639] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:38 2022] PUT /identity/v3/projects/1b25fc4c036a4229aba8fb22ea40ffec/users/1196e5fdbd9c4b5d9464670cabb8ba93/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:38.213910 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5cfe9-b4f1-44f1-be34-92cf029e8631 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:38.300320 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088fa52-df1d-41fb-8cfd-6cb40208b1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:38.301668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088fa52-df1d-41fb-8cfd-6cb40208b1f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:38.301953 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088fa52-df1d-41fb-8cfd-6cb40208b1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:38.302229 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088fa52-df1d-41fb-8cfd-6cb40208b1f2 admin admin] PATH_INFO: `/v3/projects/a8c1151f59854a688639667cd8c07575/users/4df2c64c32ab4cf48240bebeafd19ac0/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:38.304706 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088fa52-df1d-41fb-8cfd-6cb40208b1f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c1151f59854a688639667cd8c07575, user_id=4df2c64c32ab4cf48240bebeafd19ac0, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:38.309467 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088fa52-df1d-41fb-8cfd-6cb40208b1f2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:38.322702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 841/1640] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:38 2022] PUT /identity/v3/projects/a8c1151f59854a688639667cd8c07575/users/4df2c64c32ab4cf48240bebeafd19ac0/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:38.324442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f0b12-0703-4bda-8179-1cdfbd6cc09a None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:38.330082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f0b12-0703-4bda-8179-1cdfbd6cc09a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:38.330082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f0b12-0703-4bda-8179-1cdfbd6cc09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:38.379179 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4a2f0b12-0703-4bda-8179-1cdfbd6cc09a None None] MFA Rules not processed for user `1196e5fdbd9c4b5d9464670cabb8ba93`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:38.380611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4a2f0b12-0703-4bda-8179-1cdfbd6cc09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:38.381373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5cfe9-b4f1-44f1-be34-92cf029e8631 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:38.454232 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10353a-6f3d-4f71-ac84-8139b165d29f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:38.454895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10353a-6f3d-4f71-ac84-8139b165d29f service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:38.455171 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10353a-6f3d-4f71-ac84-8139b165d29f service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:38.455564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10353a-6f3d-4f71-ac84-8139b165d29f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:38.458251 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 842/1641] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:38.461192 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f77af-8c92-42c4-8d1c-6a6885e4df14 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:38.461485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f77af-8c92-42c4-8d1c-6a6885e4df14 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:38.461857 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f77af-8c92-42c4-8d1c-6a6885e4df14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:38.494324 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-0f0f77af-8c92-42c4-8d1c-6a6885e4df14 None None] MFA Rules not processed for user `4df2c64c32ab4cf48240bebeafd19ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:38.496406 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0f0f77af-8c92-42c4-8d1c-6a6885e4df14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:38.524929 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10353a-6f3d-4f71-ac84-8139b165d29f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:38.526931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10353a-6f3d-4f71-ac84-8139b165d29f service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:38.550871 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 800/1642] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:38.558422 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10353a-6f3d-4f71-ac84-8139b165d29f service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:38.592240 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 843/1643] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:38 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:38.593624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948290a-be2a-4da4-a894-8ab95bc7cf77 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:38.594010 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948290a-be2a-4da4-a894-8ab95bc7cf77 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:38.594291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948290a-be2a-4da4-a894-8ab95bc7cf77 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:38.596555 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 844/1644] 10.222.0.25 () {54 vars in 961 bytes} [Thu May 12 06:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:51:38.605234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948290a-be2a-4da4-a894-8ab95bc7cf77 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:38.642773 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10353a-6f3d-4f71-ac84-8139b165d29f service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:38.650308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9f3a8-a87d-436b-be6f-25e3bbd94b34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:38.651814 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9f3a8-a87d-436b-be6f-25e3bbd94b34 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:38.651814 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9f3a8-a87d-436b-be6f-25e3bbd94b34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:38.652103 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9f3a8-a87d-436b-be6f-25e3bbd94b34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:38.685290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948290a-be2a-4da4-a894-8ab95bc7cf77 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:38.691156 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405f79c-fd21-4c56-826b-4abbdd49fa27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:38.691865 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405f79c-fd21-4c56-826b-4abbdd49fa27 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:38.692152 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405f79c-fd21-4c56-826b-4abbdd49fa27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:38.692431 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405f79c-fd21-4c56-826b-4abbdd49fa27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:38.710972 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405f79c-fd21-4c56-826b-4abbdd49fa27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:38.712707 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405f79c-fd21-4c56-826b-4abbdd49fa27 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:38.731532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 845/1645] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:38.732241 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9f3a8-a87d-436b-be6f-25e3bbd94b34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:38.735131 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9f3a8-a87d-436b-be6f-25e3bbd94b34 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:38.735299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e11b1-0b47-4fef-8bec-7a64171a9229 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:38.735529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e11b1-0b47-4fef-8bec-7a64171a9229 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:38.738198 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e11b1-0b47-4fef-8bec-7a64171a9229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:38.750720 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 801/1646] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:38.764447 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f95ba-23a6-4ddc-b48c-1e23807caa7b None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:38.772120 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f95ba-23a6-4ddc-b48c-1e23807caa7b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:38.772120 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f95ba-23a6-4ddc-b48c-1e23807caa7b None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:38.772120 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 802/1647] 10.222.0.25 () {54 vars in 912 bytes} [Thu May 12 06:51:38 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:51:38.775296 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a37a2-0f0e-418a-95e1-8b6992f98ece None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:38.776311 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a37a2-0f0e-418a-95e1-8b6992f98ece None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:38.776818 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a37a2-0f0e-418a-95e1-8b6992f98ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:38.797072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6d0e11b1-0b47-4fef-8bec-7a64171a9229 None None] MFA Rules not processed for user `bbcd54a927bf46f183b50fbda677868d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:38.798196 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6d0e11b1-0b47-4fef-8bec-7a64171a9229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:38.808767 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-da8a37a2-0f0e-418a-95e1-8b6992f98ece None None] MFA Rules not processed for user `bbcd54a927bf46f183b50fbda677868d`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:38.810700 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-da8a37a2-0f0e-418a-95e1-8b6992f98ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:38.820527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 803/1648] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 12 06:51:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:51:38.822858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 846/1649] 10.222.0.25 () {58 vars in 1058 bytes} [Thu May 12 06:51:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:38.824106 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda54b7-3ec6-4d28-944e-a63737b4da87 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:38.824462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda54b7-3ec6-4d28-944e-a63737b4da87 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:38.824808 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda54b7-3ec6-4d28-944e-a63737b4da87 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:38.826842 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 804/1650] 10.222.0.25 () {54 vars in 912 bytes} [Thu May 12 06:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:51:38.835118 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda54b7-3ec6-4d28-944e-a63737b4da87 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:38.839495 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ffda54b7-3ec6-4d28-944e-a63737b4da87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:38.839802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08888474-c01e-4f8a-90b4-1c91c23847dc None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:38.842659 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08888474-c01e-4f8a-90b4-1c91c23847dc None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:38.843056 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08888474-c01e-4f8a-90b4-1c91c23847dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:38.870683 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-08888474-c01e-4f8a-90b4-1c91c23847dc None None] MFA Rules not processed for user `bbcd54a927bf46f183b50fbda677868d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:38.872555 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-08888474-c01e-4f8a-90b4-1c91c23847dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:38.882645 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 847/1651] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 12 06:51:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:38.883639 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08888474-c01e-4f8a-90b4-1c91c23847dc None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:38.893444 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08888474-c01e-4f8a-90b4-1c91c23847dc None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:38.897618 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25739082-61f6-4457-b9bd-8b782f58a4aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:38.898378 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25739082-61f6-4457-b9bd-8b782f58a4aa service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:38.898765 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25739082-61f6-4457-b9bd-8b782f58a4aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:38.899269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25739082-61f6-4457-b9bd-8b782f58a4aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:38.916753 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25739082-61f6-4457-b9bd-8b782f58a4aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:38.922074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25739082-61f6-4457-b9bd-8b782f58a4aa service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:38.933227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda54b7-3ec6-4d28-944e-a63737b4da87 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:38.937052 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5ed30-6940-4b0f-90ec-e54a6506f3e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a08d8e39f6f42bc9b93dd6d2311bcbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:38.937715 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5ed30-6940-4b0f-90ec-e54a6506f3e8 service glance] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:38.937999 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5ed30-6940-4b0f-90ec-e54a6506f3e8 service glance] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:38.938272 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5ed30-6940-4b0f-90ec-e54a6506f3e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:38.940160 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 848/1652] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:38 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:38.955996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5ed30-6940-4b0f-90ec-e54a6506f3e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:38.960420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5ed30-6940-4b0f-90ec-e54a6506f3e8 service glance] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:38.986531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 805/1653] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:39.125706 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25739082-61f6-4457-b9bd-8b782f58a4aa service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:39.137366 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25739082-61f6-4457-b9bd-8b782f58a4aa service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:39.142947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38dedb6-4243-4d54-be96-d260285abc27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:39.144071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38dedb6-4243-4d54-be96-d260285abc27 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:39.144689 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38dedb6-4243-4d54-be96-d260285abc27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:39.145200 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38dedb6-4243-4d54-be96-d260285abc27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:39.159908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38dedb6-4243-4d54-be96-d260285abc27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:39.161803 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38dedb6-4243-4d54-be96-d260285abc27 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:39.189394 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 849/1654] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:39.502444 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aadb00-bd83-4d30-bd63-bf33cf76b17c None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:39.502962 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aadb00-bd83-4d30-bd63-bf33cf76b17c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:39.503063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aadb00-bd83-4d30-bd63-bf33cf76b17c None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:39.505027 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 806/1655] 10.222.0.25 () {54 vars in 912 bytes} [Thu May 12 06:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:51:39.511588 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940e17d-67a1-4d63-aa06-0b9910a0bd4f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:39.512186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940e17d-67a1-4d63-aa06-0b9910a0bd4f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:39.512186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940e17d-67a1-4d63-aa06-0b9910a0bd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:39.657844 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aadb00-bd83-4d30-bd63-bf33cf76b17c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:39.659073 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-8940e17d-67a1-4d63-aa06-0b9910a0bd4f None None] MFA Rules not processed for user `5a9cbec1af6545fcb34425dce87d0ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:39.660676 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8940e17d-67a1-4d63-aa06-0b9910a0bd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:39.673052 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aadb00-bd83-4d30-bd63-bf33cf76b17c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:39.686039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213312a-6517-40a6-8721-d09469575b5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:39.686716 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213312a-6517-40a6-8721-d09469575b5f service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:39.686999 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213312a-6517-40a6-8721-d09469575b5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:39.687274 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213312a-6517-40a6-8721-d09469575b5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:39.752542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 850/1656] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 12 06:51:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:51:39.801512 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213312a-6517-40a6-8721-d09469575b5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:39.806041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940e17d-67a1-4d63-aa06-0b9910a0bd4f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:39.819476 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940e17d-67a1-4d63-aa06-0b9910a0bd4f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:39.821308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213312a-6517-40a6-8721-d09469575b5f service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:39.832502 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd9fb5-e8b2-4afc-8a20-fe3b1d7dc660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:39.833483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd9fb5-e8b2-4afc-8a20-fe3b1d7dc660 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:39.833705 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd9fb5-e8b2-4afc-8a20-fe3b1d7dc660 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:39.835556 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd9fb5-e8b2-4afc-8a20-fe3b1d7dc660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:39.850619 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 807/1657] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:39.856452 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd9fb5-e8b2-4afc-8a20-fe3b1d7dc660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:39.859078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd9fb5-e8b2-4afc-8a20-fe3b1d7dc660 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:39.874232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 851/1658] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:40.066429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213312a-6517-40a6-8721-d09469575b5f service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:40.201630 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213312a-6517-40a6-8721-d09469575b5f service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:40.210175 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40475118-fe5b-4987-be25-331578f1fc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:40.211717 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40475118-fe5b-4987-be25-331578f1fc27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:40.219621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40475118-fe5b-4987-be25-331578f1fc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:40.219621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40475118-fe5b-4987-be25-331578f1fc27 admin admin] PATH_INFO: `/v3/users/9b5f04c541a1451a93e200bf9b6a4a3e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:40.219621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40475118-fe5b-4987-be25-331578f1fc27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b5f04c541a1451a93e200bf9b6a4a3e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:40.219621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: WARNING py.warnings [None req-40475118-fe5b-4987-be25-331578f1fc27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 06:51:40.219621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: warnings.warn(msg) May 12 06:51:40.219621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: May 12 06:51:40.219621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40475118-fe5b-4987-be25-331578f1fc27 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:40.518034 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-40475118-fe5b-4987-be25-331578f1fc27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b5f04c541a1451a93e200bf9b6a4a3e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:40.518034 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-40475118-fe5b-4987-be25-331578f1fc27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b5f04c541a1451a93e200bf9b6a4a3e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:40.790440 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-40475118-fe5b-4987-be25-331578f1fc27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b5f04c541a1451a93e200bf9b6a4a3e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:40.790440 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-40475118-fe5b-4987-be25-331578f1fc27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b5f04c541a1451a93e200bf9b6a4a3e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:40.790440 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-40475118-fe5b-4987-be25-331578f1fc27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b5f04c541a1451a93e200bf9b6a4a3e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:40.790440 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 808/1659] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:51:40 2022] DELETE /identity/v3/users/9b5f04c541a1451a93e200bf9b6a4a3e => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:40.793119 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67a60d-15bb-4197-ba30-7ba47191c96d None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:40.793119 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67a60d-15bb-4197-ba30-7ba47191c96d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:40.793119 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67a60d-15bb-4197-ba30-7ba47191c96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:40.831257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6e67a60d-15bb-4197-ba30-7ba47191c96d None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:40.832692 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6e67a60d-15bb-4197-ba30-7ba47191c96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:40.941099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 852/1660] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:40.948413 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40475118-fe5b-4987-be25-331578f1fc27 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:40.950000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-40475118-fe5b-4987-be25-331578f1fc27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:41.092698 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67a60d-15bb-4197-ba30-7ba47191c96d None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:41.094253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6e67a60d-15bb-4197-ba30-7ba47191c96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:41.106334 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40475118-fe5b-4987-be25-331578f1fc27 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:41.114772 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae726cb0-e86f-42a5-bb67-f250e5d3159b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:41.117387 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae726cb0-e86f-42a5-bb67-f250e5d3159b service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:41.118915 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae726cb0-e86f-42a5-bb67-f250e5d3159b service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:41.119340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae726cb0-e86f-42a5-bb67-f250e5d3159b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:41.176447 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae726cb0-e86f-42a5-bb67-f250e5d3159b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:41.177931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae726cb0-e86f-42a5-bb67-f250e5d3159b service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:41.207745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 809/1661] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:41.207745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510f3ab-d0c7-4712-ab2f-a146221edb75 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:41.207745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510f3ab-d0c7-4712-ab2f-a146221edb75 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:41.211758 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510f3ab-d0c7-4712-ab2f-a146221edb75 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:41.211758 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 810/1662] 10.222.0.25 () {54 vars in 960 bytes} [Thu May 12 06:51:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:51:41.233398 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f9cc4-cfee-428d-b97c-affd4918f987 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:41.233770 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f9cc4-cfee-428d-b97c-affd4918f987 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:41.234120 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f9cc4-cfee-428d-b97c-affd4918f987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:41.330775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-399f9cc4-cfee-428d-b97c-affd4918f987 None None] MFA Rules not processed for user `61d2edf68b1b440097981097699bb307`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:41.337044 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-399f9cc4-cfee-428d-b97c-affd4918f987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:41.380887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67a60d-15bb-4197-ba30-7ba47191c96d None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:41.390016 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ab7d7-e052-4c2c-bccf-99e2ca6b3bd9 tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196e5fdbd9c4b5d9464670cabb8ba93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b25fc4c036a4229aba8fb22ea40ffec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:41.390752 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ab7d7-e052-4c2c-bccf-99e2ca6b3bd9 tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:41.391192 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ab7d7-e052-4c2c-bccf-99e2ca6b3bd9 tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:41.391399 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ab7d7-e052-4c2c-bccf-99e2ca6b3bd9 tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:41.393990 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ab7d7-e052-4c2c-bccf-99e2ca6b3bd9 tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:51:41.394317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ab7d7-e052-4c2c-bccf-99e2ca6b3bd9 tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:41.403973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ab7d7-e052-4c2c-bccf-99e2ca6b3bd9 tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:41.441391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 853/1663] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:51:41.442512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ab7d7-e052-4c2c-bccf-99e2ca6b3bd9 tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:41.458450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ab7d7-e052-4c2c-bccf-99e2ca6b3bd9 tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:41.480510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89f88f-38cb-4c03-aa7e-4d65d8c465fe tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196e5fdbd9c4b5d9464670cabb8ba93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b25fc4c036a4229aba8fb22ea40ffec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:41.484709 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89f88f-38cb-4c03-aa7e-4d65d8c465fe tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:41.484709 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89f88f-38cb-4c03-aa7e-4d65d8c465fe tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:41.484709 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89f88f-38cb-4c03-aa7e-4d65d8c465fe tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:41.484709 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89f88f-38cb-4c03-aa7e-4d65d8c465fe tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:41.487971 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89f88f-38cb-4c03-aa7e-4d65d8c465fe tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:41.488585 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 811/1664] 10.222.0.25 () {58 vars in 1057 bytes} [Thu May 12 06:51:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:41.497589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f9cc4-cfee-428d-b97c-affd4918f987 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:41.513922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f9cc4-cfee-428d-b97c-affd4918f987 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:41.519376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd19de7-6bba-4d85-bb3e-8b1e590826e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d2edf68b1b440097981097699bb307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:41.521817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd19de7-6bba-4d85-bb3e-8b1e590826e4 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:41.521817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd19de7-6bba-4d85-bb3e-8b1e590826e4 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:41.521817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd19de7-6bba-4d85-bb3e-8b1e590826e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:41.524200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bcd19de7-6bba-4d85-bb3e-8b1e590826e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:41.540470 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd19de7-6bba-4d85-bb3e-8b1e590826e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:41.545066 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd19de7-6bba-4d85-bb3e-8b1e590826e4 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:41.565085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 812/1665] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:41.610738 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 854/1666] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:51:41 2022] POST /identity/v3/projects => generated 354 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:41.616184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd19de7-6bba-4d85-bb3e-8b1e590826e4 service placement] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:41.641340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd19de7-6bba-4d85-bb3e-8b1e590826e4 service placement] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:41.824069 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530c550-cee7-4953-8809-c81d3127f1b9 tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196e5fdbd9c4b5d9464670cabb8ba93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b25fc4c036a4229aba8fb22ea40ffec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:41.824786 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530c550-cee7-4953-8809-c81d3127f1b9 tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:41.825171 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530c550-cee7-4953-8809-c81d3127f1b9 tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:41.825464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530c550-cee7-4953-8809-c81d3127f1b9 tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:41.826298 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530c550-cee7-4953-8809-c81d3127f1b9 tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:51:41.826678 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530c550-cee7-4953-8809-c81d3127f1b9 tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:41.830708 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530c550-cee7-4953-8809-c81d3127f1b9 tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:41.870518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 813/1667] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:51:42.140568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89f88f-38cb-4c03-aa7e-4d65d8c465fe tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:42.156893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89f88f-38cb-4c03-aa7e-4d65d8c465fe tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:42.201301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd4cfa-ccc4-4530-b0d5-c9e0219b369f tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196e5fdbd9c4b5d9464670cabb8ba93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b25fc4c036a4229aba8fb22ea40ffec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:42.202189 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd4cfa-ccc4-4530-b0d5-c9e0219b369f tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:42.202491 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd4cfa-ccc4-4530-b0d5-c9e0219b369f tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:42.202797 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd4cfa-ccc4-4530-b0d5-c9e0219b369f tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] PATH_INFO: `/v3/projects/c760b5cb7552450e8bec3f49fae010b3` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:42.204546 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd4cfa-ccc4-4530-b0d5-c9e0219b369f tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c760b5cb7552450e8bec3f49fae010b3)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:42.206800 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: WARNING py.warnings [None req-56cd4cfa-ccc4-4530-b0d5-c9e0219b369f tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 06:51:42.206800 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: warnings.warn(msg) May 12 06:51:42.206800 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: May 12 06:51:42.215898 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd4cfa-ccc4-4530-b0d5-c9e0219b369f tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:42.465469 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-56cd4cfa-ccc4-4530-b0d5-c9e0219b369f tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c760b5cb7552450e8bec3f49fae010b3', 'request_id': 'req-56cd4cfa-ccc4-4530-b0d5-c9e0219b369f'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:42.530065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-56cd4cfa-ccc4-4530-b0d5-c9e0219b369f tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c760b5cb7552450e8bec3f49fae010b3', 'request_id': 'req-56cd4cfa-ccc4-4530-b0d5-c9e0219b369f'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:42.536884 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-56cd4cfa-ccc4-4530-b0d5-c9e0219b369f tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c760b5cb7552450e8bec3f49fae010b3', 'request_id': 'req-56cd4cfa-ccc4-4530-b0d5-c9e0219b369f'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:42.577678 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-56cd4cfa-ccc4-4530-b0d5-c9e0219b369f tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] The token cache is being invalidate because project c760b5cb7552450e8bec3f49fae010b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:51:42.577894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-56cd4cfa-ccc4-4530-b0d5-c9e0219b369f tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:42.578573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-56cd4cfa-ccc4-4530-b0d5-c9e0219b369f tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:42.583336 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 855/1668] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:51:42 2022] DELETE /identity/v3/projects/c760b5cb7552450e8bec3f49fae010b3 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:42.741920 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530c550-cee7-4953-8809-c81d3127f1b9 tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:42.743958 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0530c550-cee7-4953-8809-c81d3127f1b9 tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:42.904447 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530c550-cee7-4953-8809-c81d3127f1b9 tempest-VolumeQuotaClassesTest-1824744096 tempest-VolumeQuotaClassesTest-1824744096-project-admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:43.060838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61269917-c0d6-42e4-b10d-4411e196ccf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:43.061752 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61269917-c0d6-42e4-b10d-4411e196ccf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:43.062040 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61269917-c0d6-42e4-b10d-4411e196ccf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:43.062356 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61269917-c0d6-42e4-b10d-4411e196ccf2 admin admin] PATH_INFO: `/v3/projects/c99ca6d9d066495aba5384420764c3d3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:43.066403 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61269917-c0d6-42e4-b10d-4411e196ccf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c99ca6d9d066495aba5384420764c3d3)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:43.068404 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61269917-c0d6-42e4-b10d-4411e196ccf2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:43.267827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-61269917-c0d6-42e4-b10d-4411e196ccf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c99ca6d9d066495aba5384420764c3d3', 'request_id': 'req-61269917-c0d6-42e4-b10d-4411e196ccf2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:43.393771 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-61269917-c0d6-42e4-b10d-4411e196ccf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c99ca6d9d066495aba5384420764c3d3', 'request_id': 'req-61269917-c0d6-42e4-b10d-4411e196ccf2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:43.402075 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-61269917-c0d6-42e4-b10d-4411e196ccf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c99ca6d9d066495aba5384420764c3d3', 'request_id': 'req-61269917-c0d6-42e4-b10d-4411e196ccf2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:43.451653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-61269917-c0d6-42e4-b10d-4411e196ccf2 admin admin] The token cache is being invalidate because project c99ca6d9d066495aba5384420764c3d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:51:43.452874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-61269917-c0d6-42e4-b10d-4411e196ccf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:43.456468 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-61269917-c0d6-42e4-b10d-4411e196ccf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:43.461492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 814/1669] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:51:42 2022] DELETE /identity/v3/projects/c99ca6d9d066495aba5384420764c3d3 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:43.466692 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eb392-8127-476f-b6cb-17278b21c5cb None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:43.467639 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eb392-8127-476f-b6cb-17278b21c5cb None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:43.468140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eb392-8127-476f-b6cb-17278b21c5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:43.514474 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4a7eb392-8127-476f-b6cb-17278b21c5cb None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:43.517191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4a7eb392-8127-476f-b6cb-17278b21c5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:43.573900 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61269917-c0d6-42e4-b10d-4411e196ccf2 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:43.575674 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-61269917-c0d6-42e4-b10d-4411e196ccf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:43.655185 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 856/1670] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:51:43.666649 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1509cdf-9685-44f5-97ca-cf7664434474 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:43.667265 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1509cdf-9685-44f5-97ca-cf7664434474 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:43.667754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1509cdf-9685-44f5-97ca-cf7664434474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:43.720629 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-c1509cdf-9685-44f5-97ca-cf7664434474 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:43.720629 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c1509cdf-9685-44f5-97ca-cf7664434474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:43.739768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61269917-c0d6-42e4-b10d-4411e196ccf2 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:43.740634 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 857/1671] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:43.745267 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1509cdf-9685-44f5-97ca-cf7664434474 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:43.749956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2cdf6-782b-4c5a-9e9d-a59fe464077e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:43.750903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2cdf6-782b-4c5a-9e9d-a59fe464077e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:43.751456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2cdf6-782b-4c5a-9e9d-a59fe464077e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:43.751955 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2cdf6-782b-4c5a-9e9d-a59fe464077e admin admin] PATH_INFO: `/v3/users/349e317229ad4103a8dc5bae31e0fc0a` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:43.753693 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2cdf6-782b-4c5a-9e9d-a59fe464077e admin admin] RBAC: Authorizing `identity:delete_user(user_id=349e317229ad4103a8dc5bae31e0fc0a)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:43.756478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2cdf6-782b-4c5a-9e9d-a59fe464077e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:43.761749 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1509cdf-9685-44f5-97ca-cf7664434474 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:43.767239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3429762-61c9-4f16-9f57-1ce5f31047e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:43.767938 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3429762-61c9-4f16-9f57-1ce5f31047e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:43.768222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3429762-61c9-4f16-9f57-1ce5f31047e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:43.768496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3429762-61c9-4f16-9f57-1ce5f31047e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:43.769235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3429762-61c9-4f16-9f57-1ce5f31047e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:51:43.769605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3429762-61c9-4f16-9f57-1ce5f31047e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:43.771632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3429762-61c9-4f16-9f57-1ce5f31047e9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:43.811503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 858/1672] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:51:43.816669 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3429762-61c9-4f16-9f57-1ce5f31047e9 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:43.843715 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3429762-61c9-4f16-9f57-1ce5f31047e9 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:43.873610 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845e8fd-5eea-49eb-912f-f86dddbd02f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:43.873760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845e8fd-5eea-49eb-912f-f86dddbd02f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:43.874069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845e8fd-5eea-49eb-912f-f86dddbd02f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:43.875495 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845e8fd-5eea-49eb-912f-f86dddbd02f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:43.876476 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845e8fd-5eea-49eb-912f-f86dddbd02f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:43.881598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845e8fd-5eea-49eb-912f-f86dddbd02f2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:44.019235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 859/1673] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:51:43 2022] POST /identity/v3/projects => generated 405 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:51:44.025067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845e8fd-5eea-49eb-912f-f86dddbd02f2 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:44.050423 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ecc2cdf6-782b-4c5a-9e9d-a59fe464077e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '349e317229ad4103a8dc5bae31e0fc0a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:44.051301 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ecc2cdf6-782b-4c5a-9e9d-a59fe464077e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '349e317229ad4103a8dc5bae31e0fc0a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:44.095188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ecc2cdf6-782b-4c5a-9e9d-a59fe464077e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '349e317229ad4103a8dc5bae31e0fc0a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:44.095763 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ecc2cdf6-782b-4c5a-9e9d-a59fe464077e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '349e317229ad4103a8dc5bae31e0fc0a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:44.123587 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ecc2cdf6-782b-4c5a-9e9d-a59fe464077e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '349e317229ad4103a8dc5bae31e0fc0a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:44.189034 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845e8fd-5eea-49eb-912f-f86dddbd02f2 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:44.200254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf2af3-9d66-419a-a06c-7ebfff5d6bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:44.200970 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf2af3-9d66-419a-a06c-7ebfff5d6bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:44.201269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf2af3-9d66-419a-a06c-7ebfff5d6bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:44.201527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf2af3-9d66-419a-a06c-7ebfff5d6bd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:44.202245 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf2af3-9d66-419a-a06c-7ebfff5d6bd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:44.204208 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf2af3-9d66-419a-a06c-7ebfff5d6bd5 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:44.267535 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 815/1674] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:51:43 2022] DELETE /identity/v3/users/349e317229ad4103a8dc5bae31e0fc0a => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:51:44.271770 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3e51b-52d1-471e-9cff-55a7126f473f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:44.272123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3e51b-52d1-471e-9cff-55a7126f473f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:44.272597 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3e51b-52d1-471e-9cff-55a7126f473f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:44.327671 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-fec3e51b-52d1-471e-9cff-55a7126f473f None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:44.329856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fec3e51b-52d1-471e-9cff-55a7126f473f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:44.393976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 860/1675] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:51:44 2022] POST /identity/v3/users => generated 303 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:51:44.398697 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf2af3-9d66-419a-a06c-7ebfff5d6bd5 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:44.399787 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7aaf2af3-9d66-419a-a06c-7ebfff5d6bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:44.438418 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf2af3-9d66-419a-a06c-7ebfff5d6bd5 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:44.546555 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 816/1676] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:51:44.557979 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664e547-e438-43fe-9dae-8a5ac3a45777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:44.559415 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664e547-e438-43fe-9dae-8a5ac3a45777 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:44.560095 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664e547-e438-43fe-9dae-8a5ac3a45777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:44.560818 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664e547-e438-43fe-9dae-8a5ac3a45777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:44.561798 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664e547-e438-43fe-9dae-8a5ac3a45777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:44.563647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664e547-e438-43fe-9dae-8a5ac3a45777 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:44.582616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3e51b-52d1-471e-9cff-55a7126f473f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:44.583952 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 861/1677] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 06:51:44.584667 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fec3e51b-52d1-471e-9cff-55a7126f473f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:44.587536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664e547-e438-43fe-9dae-8a5ac3a45777 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:44.623167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664e547-e438-43fe-9dae-8a5ac3a45777 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:44.631040 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548d821-52eb-4a16-a1ba-8903a3dcfc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:44.631891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548d821-52eb-4a16-a1ba-8903a3dcfc48 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:44.632448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548d821-52eb-4a16-a1ba-8903a3dcfc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:44.632827 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548d821-52eb-4a16-a1ba-8903a3dcfc48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:44.635648 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548d821-52eb-4a16-a1ba-8903a3dcfc48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:44.637303 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548d821-52eb-4a16-a1ba-8903a3dcfc48 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:44.654888 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 862/1678] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:44.660019 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548d821-52eb-4a16-a1ba-8903a3dcfc48 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:44.688328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548d821-52eb-4a16-a1ba-8903a3dcfc48 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:44.700348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b4934-a4e2-432a-88bb-bb8706544b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:44.701729 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b4934-a4e2-432a-88bb-bb8706544b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:44.702307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b4934-a4e2-432a-88bb-bb8706544b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:44.702773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b4934-a4e2-432a-88bb-bb8706544b94 admin admin] PATH_INFO: `/v3/projects/4f265b2fb4b24c31a9073f04a11d6eba/users/17fd2b0c5f2149b18d9339eb5937134c/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:44.715767 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3e51b-52d1-471e-9cff-55a7126f473f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:44.730376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b4934-a4e2-432a-88bb-bb8706544b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f265b2fb4b24c31a9073f04a11d6eba, user_id=17fd2b0c5f2149b18d9339eb5937134c, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:44.732466 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7e86c-853c-48b1-9bcc-1d2ba546e333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:44.733142 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7e86c-853c-48b1-9bcc-1d2ba546e333 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:44.733427 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7e86c-853c-48b1-9bcc-1d2ba546e333 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:44.733695 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7e86c-853c-48b1-9bcc-1d2ba546e333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:44.753433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b4934-a4e2-432a-88bb-bb8706544b94 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:44.766060 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7e86c-853c-48b1-9bcc-1d2ba546e333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:44.767518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7e86c-853c-48b1-9bcc-1d2ba546e333 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:44.791422 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 817/1679] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 06:51:44.920889 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 863/1680] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:44 2022] PUT /identity/v3/projects/4f265b2fb4b24c31a9073f04a11d6eba/users/17fd2b0c5f2149b18d9339eb5937134c/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:44.939938 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69826473-059f-4e12-96ac-556634614d49 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:44.940268 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69826473-059f-4e12-96ac-556634614d49 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:44.940840 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69826473-059f-4e12-96ac-556634614d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:44.977074 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-69826473-059f-4e12-96ac-556634614d49 None None] MFA Rules not processed for user `17fd2b0c5f2149b18d9339eb5937134c`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:44.979341 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-69826473-059f-4e12-96ac-556634614d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:45.072057 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 818/1681] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:45.076533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b4934-a4e2-432a-88bb-bb8706544b94 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:45.204203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b4934-a4e2-432a-88bb-bb8706544b94 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:45.215555 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60791a70-2770-486c-8eb5-ec6328749473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:45.216308 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60791a70-2770-486c-8eb5-ec6328749473 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:45.216583 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60791a70-2770-486c-8eb5-ec6328749473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:45.216867 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60791a70-2770-486c-8eb5-ec6328749473 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:45.221225 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60791a70-2770-486c-8eb5-ec6328749473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:45.227046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60791a70-2770-486c-8eb5-ec6328749473 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:45.342362 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 864/1682] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:51:45 2022] POST /identity/v3/projects => generated 405 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:51:45.347268 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69826473-059f-4e12-96ac-556634614d49 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:45.370541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69826473-059f-4e12-96ac-556634614d49 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:45.483109 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933580d-4a38-4c3f-b174-6450e76d11f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:45.484338 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933580d-4a38-4c3f-b174-6450e76d11f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:45.484627 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933580d-4a38-4c3f-b174-6450e76d11f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:45.484901 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933580d-4a38-4c3f-b174-6450e76d11f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:45.486103 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933580d-4a38-4c3f-b174-6450e76d11f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:45.488380 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933580d-4a38-4c3f-b174-6450e76d11f1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:45.616781 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 819/1683] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:51:45 2022] POST /identity/v3/users => generated 309 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:45.621340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60791a70-2770-486c-8eb5-ec6328749473 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:45.634340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60791a70-2770-486c-8eb5-ec6328749473 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:45.659148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f66ac-c844-4c6f-9340-8265d59e24d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:45.659881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f66ac-c844-4c6f-9340-8265d59e24d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:45.660199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f66ac-c844-4c6f-9340-8265d59e24d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:45.660436 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f66ac-c844-4c6f-9340-8265d59e24d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:45.661180 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f66ac-c844-4c6f-9340-8265d59e24d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:45.662786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f66ac-c844-4c6f-9340-8265d59e24d9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:45.693410 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 865/1684] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:45.698200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933580d-4a38-4c3f-b174-6450e76d11f1 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:45.719265 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933580d-4a38-4c3f-b174-6450e76d11f1 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:45.738200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede9621-5acc-4128-831a-2863638e3577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:45.739072 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede9621-5acc-4128-831a-2863638e3577 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:45.739514 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede9621-5acc-4128-831a-2863638e3577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:45.739830 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede9621-5acc-4128-831a-2863638e3577 admin admin] PATH_INFO: `/v3/projects/dc3b8da9a3b045ceacf02f1d1ea78b95/users/66d40960101d433e99f878f8d6375262/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:45.775359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede9621-5acc-4128-831a-2863638e3577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc3b8da9a3b045ceacf02f1d1ea78b95, user_id=66d40960101d433e99f878f8d6375262, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:45.778700 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede9621-5acc-4128-831a-2863638e3577 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:45.880871 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 820/1685] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:45 2022] PUT /identity/v3/projects/dc3b8da9a3b045ceacf02f1d1ea78b95/users/66d40960101d433e99f878f8d6375262/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:45.886093 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f66ac-c844-4c6f-9340-8265d59e24d9 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:45.896401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f66ac-c844-4c6f-9340-8265d59e24d9 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:45.979868 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14a90b-caca-47e2-83ea-6c267597b5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:45.981071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14a90b-caca-47e2-83ea-6c267597b5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:45.981487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14a90b-caca-47e2-83ea-6c267597b5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:45.981893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14a90b-caca-47e2-83ea-6c267597b5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:45.982781 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14a90b-caca-47e2-83ea-6c267597b5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:45.984594 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14a90b-caca-47e2-83ea-6c267597b5b1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:46.008576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede9621-5acc-4128-831a-2863638e3577 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:46.014500 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 866/1686] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:46.019751 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede9621-5acc-4128-831a-2863638e3577 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:46.037214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d6394-9dbc-4fcb-889c-8686abff5d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:46.044314 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d6394-9dbc-4fcb-889c-8686abff5d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:46.044314 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d6394-9dbc-4fcb-889c-8686abff5d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:46.044314 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d6394-9dbc-4fcb-889c-8686abff5d2e admin admin] PATH_INFO: `/v3/projects/dc3b8da9a3b045ceacf02f1d1ea78b95/users/66d40960101d433e99f878f8d6375262/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:46.044907 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d6394-9dbc-4fcb-889c-8686abff5d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc3b8da9a3b045ceacf02f1d1ea78b95, user_id=66d40960101d433e99f878f8d6375262, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:46.047586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d6394-9dbc-4fcb-889c-8686abff5d2e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:46.085193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 821/1687] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:46 2022] PUT /identity/v3/projects/dc3b8da9a3b045ceacf02f1d1ea78b95/users/66d40960101d433e99f878f8d6375262/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:51:46.088365 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64153ad7-5bf3-4535-921d-f14a034e5e8b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:46.088365 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64153ad7-5bf3-4535-921d-f14a034e5e8b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:46.088365 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64153ad7-5bf3-4535-921d-f14a034e5e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:46.147094 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-64153ad7-5bf3-4535-921d-f14a034e5e8b None None] MFA Rules not processed for user `66d40960101d433e99f878f8d6375262`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:46.148667 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-64153ad7-5bf3-4535-921d-f14a034e5e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:46.245198 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d6394-9dbc-4fcb-889c-8686abff5d2e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:46.247711 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-809d6394-9dbc-4fcb-889c-8686abff5d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:46.295794 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 867/1688] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:46 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:46.305507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64153ad7-5bf3-4535-921d-f14a034e5e8b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:46.311398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-64153ad7-5bf3-4535-921d-f14a034e5e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:46.428972 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d6394-9dbc-4fcb-889c-8686abff5d2e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:46.443057 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dad0aa-0492-4684-a1a7-fa47feba8991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:46.445868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dad0aa-0492-4684-a1a7-fa47feba8991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:46.448527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dad0aa-0492-4684-a1a7-fa47feba8991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:46.449502 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dad0aa-0492-4684-a1a7-fa47feba8991 admin admin] PATH_INFO: `/v3/projects/17e242b10baa41318b0f6cc72f0dbe24` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:46.452388 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dad0aa-0492-4684-a1a7-fa47feba8991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17e242b10baa41318b0f6cc72f0dbe24)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:46.459162 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dad0aa-0492-4684-a1a7-fa47feba8991 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:46.513377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64153ad7-5bf3-4535-921d-f14a034e5e8b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:46.523789 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06857b4a-07a4-4183-bedd-397b664de62c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:46.527303 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06857b4a-07a4-4183-bedd-397b664de62c service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:46.527303 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06857b4a-07a4-4183-bedd-397b664de62c service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:46.527303 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06857b4a-07a4-4183-bedd-397b664de62c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:46.550021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06857b4a-07a4-4183-bedd-397b664de62c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:46.555873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06857b4a-07a4-4183-bedd-397b664de62c service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:46.578641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 868/1689] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:46 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 06:51:46.676263 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b3dad0aa-0492-4684-a1a7-fa47feba8991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17e242b10baa41318b0f6cc72f0dbe24', 'request_id': 'req-b3dad0aa-0492-4684-a1a7-fa47feba8991'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:46.761260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b3dad0aa-0492-4684-a1a7-fa47feba8991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17e242b10baa41318b0f6cc72f0dbe24', 'request_id': 'req-b3dad0aa-0492-4684-a1a7-fa47feba8991'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:46.772583 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b3dad0aa-0492-4684-a1a7-fa47feba8991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17e242b10baa41318b0f6cc72f0dbe24', 'request_id': 'req-b3dad0aa-0492-4684-a1a7-fa47feba8991'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:46.810006 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b3dad0aa-0492-4684-a1a7-fa47feba8991 admin admin] The token cache is being invalidate because project 17e242b10baa41318b0f6cc72f0dbe24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:51:46.813586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b3dad0aa-0492-4684-a1a7-fa47feba8991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:46.813586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b3dad0aa-0492-4684-a1a7-fa47feba8991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:46.813961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 822/1690] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:51:46 2022] DELETE /identity/v3/projects/17e242b10baa41318b0f6cc72f0dbe24 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:46.818005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06857b4a-07a4-4183-bedd-397b664de62c service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:46.837104 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06857b4a-07a4-4183-bedd-397b664de62c service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:46.954638 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6fa14-0008-4e1b-b752-5bdadce52262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:46.955548 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6fa14-0008-4e1b-b752-5bdadce52262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:46.955865 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6fa14-0008-4e1b-b752-5bdadce52262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:46.956152 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6fa14-0008-4e1b-b752-5bdadce52262 admin admin] PATH_INFO: `/v3/users/1196e5fdbd9c4b5d9464670cabb8ba93` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:46.968765 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6fa14-0008-4e1b-b752-5bdadce52262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1196e5fdbd9c4b5d9464670cabb8ba93)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:46.970835 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6fa14-0008-4e1b-b752-5bdadce52262 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:47.216949 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-4ce6fa14-0008-4e1b-b752-5bdadce52262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1196e5fdbd9c4b5d9464670cabb8ba93'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:47.217815 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-4ce6fa14-0008-4e1b-b752-5bdadce52262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1196e5fdbd9c4b5d9464670cabb8ba93'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:47.218457 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-4ce6fa14-0008-4e1b-b752-5bdadce52262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1196e5fdbd9c4b5d9464670cabb8ba93'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:47.274732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-4ce6fa14-0008-4e1b-b752-5bdadce52262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1196e5fdbd9c4b5d9464670cabb8ba93'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:47.296106 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-4ce6fa14-0008-4e1b-b752-5bdadce52262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1196e5fdbd9c4b5d9464670cabb8ba93'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:47.366173 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 869/1691] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:51:46 2022] DELETE /identity/v3/users/1196e5fdbd9c4b5d9464670cabb8ba93 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:47.586680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dad0aa-0492-4684-a1a7-fa47feba8991 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:47.588273 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b3dad0aa-0492-4684-a1a7-fa47feba8991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:47.611802 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dad0aa-0492-4684-a1a7-fa47feba8991 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:47.831970 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c86c4f-7bf2-4435-a824-29b478c4a798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:47.833872 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c86c4f-7bf2-4435-a824-29b478c4a798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:47.835282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c86c4f-7bf2-4435-a824-29b478c4a798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:47.836361 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c86c4f-7bf2-4435-a824-29b478c4a798 admin admin] PATH_INFO: `/v3/users/17fd2b0c5f2149b18d9339eb5937134c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:47.839047 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c86c4f-7bf2-4435-a824-29b478c4a798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17fd2b0c5f2149b18d9339eb5937134c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:47.842632 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c86c4f-7bf2-4435-a824-29b478c4a798 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:48.131997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-35c86c4f-7bf2-4435-a824-29b478c4a798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17fd2b0c5f2149b18d9339eb5937134c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:48.137098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-35c86c4f-7bf2-4435-a824-29b478c4a798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17fd2b0c5f2149b18d9339eb5937134c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:48.174843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-35c86c4f-7bf2-4435-a824-29b478c4a798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17fd2b0c5f2149b18d9339eb5937134c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:48.176432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-35c86c4f-7bf2-4435-a824-29b478c4a798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17fd2b0c5f2149b18d9339eb5937134c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:48.193800 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-35c86c4f-7bf2-4435-a824-29b478c4a798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17fd2b0c5f2149b18d9339eb5937134c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:48.305136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 823/1692] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:51:47 2022] DELETE /identity/v3/users/17fd2b0c5f2149b18d9339eb5937134c => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:48.310619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f8ed1-ecd1-4392-9790-c2e3fd15b139 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:48.310955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f8ed1-ecd1-4392-9790-c2e3fd15b139 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:48.311126 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f8ed1-ecd1-4392-9790-c2e3fd15b139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:48.363483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-981f8ed1-ecd1-4392-9790-c2e3fd15b139 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:48.364777 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-981f8ed1-ecd1-4392-9790-c2e3fd15b139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:48.534340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 870/1693] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:48.561621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c86c4f-7bf2-4435-a824-29b478c4a798 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:48.563201 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-35c86c4f-7bf2-4435-a824-29b478c4a798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:48.711829 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c86c4f-7bf2-4435-a824-29b478c4a798 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:48.721769 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2936c-5cf2-4f2e-869a-d18c38e80ae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:48.722501 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2936c-5cf2-4f2e-869a-d18c38e80ae5 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:48.722774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2936c-5cf2-4f2e-869a-d18c38e80ae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:48.723050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2936c-5cf2-4f2e-869a-d18c38e80ae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:48.766792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2936c-5cf2-4f2e-869a-d18c38e80ae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:48.768375 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2936c-5cf2-4f2e-869a-d18c38e80ae5 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:48.782874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 824/1694] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:48.963969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dde140-863d-4d93-9283-93755abb8952 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:48.964268 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dde140-863d-4d93-9283-93755abb8952 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:48.964551 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dde140-863d-4d93-9283-93755abb8952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:49.018710 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2936c-5cf2-4f2e-869a-d18c38e80ae5 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:49.020360 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7ea2936c-5cf2-4f2e-869a-d18c38e80ae5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:49.035789 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d6dde140-863d-4d93-9283-93755abb8952 None None] MFA Rules not processed for user `d77bf80654c24c8c8336ce395f789ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:49.037242 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d6dde140-863d-4d93-9283-93755abb8952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:49.042334 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2936c-5cf2-4f2e-869a-d18c38e80ae5 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:49.055255 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f7b6f-4841-423c-b438-408aee632aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:49.058262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f7b6f-4841-423c-b438-408aee632aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:49.058262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f7b6f-4841-423c-b438-408aee632aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:49.058892 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f7b6f-4841-423c-b438-408aee632aa9 admin admin] PATH_INFO: `/v3/projects/1b25fc4c036a4229aba8fb22ea40ffec` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:49.068378 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f7b6f-4841-423c-b438-408aee632aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b25fc4c036a4229aba8fb22ea40ffec)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:49.072703 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f7b6f-4841-423c-b438-408aee632aa9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:49.192781 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 871/1695] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:49.213760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dde140-863d-4d93-9283-93755abb8952 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:49.215421 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d6dde140-863d-4d93-9283-93755abb8952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:49.314367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-990f7b6f-4841-423c-b438-408aee632aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b25fc4c036a4229aba8fb22ea40ffec', 'request_id': 'req-990f7b6f-4841-423c-b438-408aee632aa9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:49.362444 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dde140-863d-4d93-9283-93755abb8952 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:49.418409 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-990f7b6f-4841-423c-b438-408aee632aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b25fc4c036a4229aba8fb22ea40ffec', 'request_id': 'req-990f7b6f-4841-423c-b438-408aee632aa9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:49.429560 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-990f7b6f-4841-423c-b438-408aee632aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b25fc4c036a4229aba8fb22ea40ffec', 'request_id': 'req-990f7b6f-4841-423c-b438-408aee632aa9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:49.464422 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-990f7b6f-4841-423c-b438-408aee632aa9 admin admin] The token cache is being invalidate because project 1b25fc4c036a4229aba8fb22ea40ffec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:51:49.464422 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-990f7b6f-4841-423c-b438-408aee632aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:49.464422 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-990f7b6f-4841-423c-b438-408aee632aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:49.464422 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 825/1696] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:51:49 2022] DELETE /identity/v3/projects/1b25fc4c036a4229aba8fb22ea40ffec => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:49.470433 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d765b-f266-466b-81e8-1141eefa0aef None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:49.470729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d765b-f266-466b-81e8-1141eefa0aef None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:49.471067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d765b-f266-466b-81e8-1141eefa0aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:49.505729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-322d765b-f266-466b-81e8-1141eefa0aef None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:49.506996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-322d765b-f266-466b-81e8-1141eefa0aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:49.637512 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 826/1697] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:49.638336 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836074f-3f15-4852-a2ce-7e2969b0af36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:49.639273 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836074f-3f15-4852-a2ce-7e2969b0af36 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:49.639665 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836074f-3f15-4852-a2ce-7e2969b0af36 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:49.640031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836074f-3f15-4852-a2ce-7e2969b0af36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:49.645383 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9a92e-92d2-4e5b-965a-03c63a5b3cec None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:49.646432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9a92e-92d2-4e5b-965a-03c63a5b3cec None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:49.646432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9a92e-92d2-4e5b-965a-03c63a5b3cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:49.649552 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3836074f-3f15-4852-a2ce-7e2969b0af36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:49.712859 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-bfc9a92e-92d2-4e5b-965a-03c63a5b3cec None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:49.715767 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bfc9a92e-92d2-4e5b-965a-03c63a5b3cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:49.756791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 827/1698] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:49.767067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9a92e-92d2-4e5b-965a-03c63a5b3cec None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:49.784182 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9a92e-92d2-4e5b-965a-03c63a5b3cec None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:49.802187 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836074f-3f15-4852-a2ce-7e2969b0af36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:49.802491 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836074f-3f15-4852-a2ce-7e2969b0af36 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:49.813315 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa99888-f742-47c9-88a7-572efea42e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:49.814572 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa99888-f742-47c9-88a7-572efea42e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:49.815563 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa99888-f742-47c9-88a7-572efea42e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:49.815908 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa99888-f742-47c9-88a7-572efea42e3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:49.816747 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 872/1699] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:49.828445 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa99888-f742-47c9-88a7-572efea42e3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:51:49.829026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa99888-f742-47c9-88a7-572efea42e3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:49.834001 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa99888-f742-47c9-88a7-572efea42e3e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:49.855202 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836074f-3f15-4852-a2ce-7e2969b0af36 service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:49.877194 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 828/1700] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:51:49.882458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836074f-3f15-4852-a2ce-7e2969b0af36 service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:49.894272 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31ec43-aac6-4e3e-8720-83d4b7bdbeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:49.896585 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31ec43-aac6-4e3e-8720-83d4b7bdbeda admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:49.897152 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31ec43-aac6-4e3e-8720-83d4b7bdbeda admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:49.898713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31ec43-aac6-4e3e-8720-83d4b7bdbeda admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:49.900427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31ec43-aac6-4e3e-8720-83d4b7bdbeda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:49.905328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31ec43-aac6-4e3e-8720-83d4b7bdbeda admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:50.043647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 873/1701] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:51:49 2022] POST /identity/v3/projects => generated 399 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:50.048164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa99888-f742-47c9-88a7-572efea42e3e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:50.070852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa99888-f742-47c9-88a7-572efea42e3e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:50.133594 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31ec43-aac6-4e3e-8720-83d4b7bdbeda admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:50.136355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9f31ec43-aac6-4e3e-8720-83d4b7bdbeda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:50.268252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422896e-2784-461b-8253-1f253dcd43af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:50.269046 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422896e-2784-461b-8253-1f253dcd43af admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:50.269225 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422896e-2784-461b-8253-1f253dcd43af admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:50.269499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422896e-2784-461b-8253-1f253dcd43af admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:50.270208 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422896e-2784-461b-8253-1f253dcd43af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:50.272416 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422896e-2784-461b-8253-1f253dcd43af admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:50.388685 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31ec43-aac6-4e3e-8720-83d4b7bdbeda admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:50.389352 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 829/1702] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:51:50 2022] POST /identity/v3/users => generated 300 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:50.393199 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422896e-2784-461b-8253-1f253dcd43af admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:50.416725 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f46ced-765e-45fd-9627-a791a8e8f527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:50.417631 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f46ced-765e-45fd-9627-a791a8e8f527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:50.417913 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f46ced-765e-45fd-9627-a791a8e8f527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:50.418190 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f46ced-765e-45fd-9627-a791a8e8f527 admin admin] PATH_INFO: `/v3/projects/4f265b2fb4b24c31a9073f04a11d6eba` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:50.420019 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422896e-2784-461b-8253-1f253dcd43af admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:50.422988 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f46ced-765e-45fd-9627-a791a8e8f527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f265b2fb4b24c31a9073f04a11d6eba)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:50.427510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f46ced-765e-45fd-9627-a791a8e8f527 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:50.440469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da3440-3cdf-4f70-baf3-f05736263021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:50.441366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da3440-3cdf-4f70-baf3-f05736263021 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:50.441618 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da3440-3cdf-4f70-baf3-f05736263021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:50.441905 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da3440-3cdf-4f70-baf3-f05736263021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:50.442656 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da3440-3cdf-4f70-baf3-f05736263021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:50.444604 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da3440-3cdf-4f70-baf3-f05736263021 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:50.464789 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 830/1703] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:50.468715 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da3440-3cdf-4f70-baf3-f05736263021 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:50.487587 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da3440-3cdf-4f70-baf3-f05736263021 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:50.520099 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cf160-ea5a-43bf-af59-a2136a4722a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:50.520826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cf160-ea5a-43bf-af59-a2136a4722a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:50.521133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cf160-ea5a-43bf-af59-a2136a4722a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:50.521428 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cf160-ea5a-43bf-af59-a2136a4722a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:50.522184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cf160-ea5a-43bf-af59-a2136a4722a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:50.523875 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cf160-ea5a-43bf-af59-a2136a4722a7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:50.577001 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 831/1704] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 06:51:50.577969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cf160-ea5a-43bf-af59-a2136a4722a7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:50.604727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cf160-ea5a-43bf-af59-a2136a4722a7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:50.630471 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe56de-7012-490e-a077-321f80960443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:50.631477 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe56de-7012-490e-a077-321f80960443 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:50.637365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe56de-7012-490e-a077-321f80960443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:50.637535 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe56de-7012-490e-a077-321f80960443 admin admin] PATH_INFO: `/v3/projects/fc26ed1545ad4912a3d8baf032ad4cab/users/708893f8cce249b186fa123459fb5443/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:50.670205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe56de-7012-490e-a077-321f80960443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc26ed1545ad4912a3d8baf032ad4cab, user_id=708893f8cce249b186fa123459fb5443, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:50.673206 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe56de-7012-490e-a077-321f80960443 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:50.690732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-24f46ced-765e-45fd-9627-a791a8e8f527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f265b2fb4b24c31a9073f04a11d6eba', 'request_id': 'req-24f46ced-765e-45fd-9627-a791a8e8f527'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:50.753705 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 832/1705] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:50 2022] PUT /identity/v3/projects/fc26ed1545ad4912a3d8baf032ad4cab/users/708893f8cce249b186fa123459fb5443/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:50.764701 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-24f46ced-765e-45fd-9627-a791a8e8f527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f265b2fb4b24c31a9073f04a11d6eba', 'request_id': 'req-24f46ced-765e-45fd-9627-a791a8e8f527'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:50.769551 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6e655-49db-4eab-a115-e6b029d8c382 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:50.770529 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6e655-49db-4eab-a115-e6b029d8c382 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:50.773542 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6e655-49db-4eab-a115-e6b029d8c382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:50.780626 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-24f46ced-765e-45fd-9627-a791a8e8f527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f265b2fb4b24c31a9073f04a11d6eba', 'request_id': 'req-24f46ced-765e-45fd-9627-a791a8e8f527'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:50.820885 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-24f46ced-765e-45fd-9627-a791a8e8f527 admin admin] The token cache is being invalidate because project 4f265b2fb4b24c31a9073f04a11d6eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:51:50.821473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-24f46ced-765e-45fd-9627-a791a8e8f527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:50.824102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-24f46ced-765e-45fd-9627-a791a8e8f527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:50.826931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 874/1706] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:51:50 2022] DELETE /identity/v3/projects/4f265b2fb4b24c31a9073f04a11d6eba => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:50.834970 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f46ced-765e-45fd-9627-a791a8e8f527 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:50.834970 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-24f46ced-765e-45fd-9627-a791a8e8f527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:50.864409 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b6c6e655-49db-4eab-a115-e6b029d8c382 None None] MFA Rules not processed for user `708893f8cce249b186fa123459fb5443`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:50.865312 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b6c6e655-49db-4eab-a115-e6b029d8c382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:51.026649 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f46ced-765e-45fd-9627-a791a8e8f527 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:51.081168 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 833/1707] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:51.082229 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6e655-49db-4eab-a115-e6b029d8c382 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:51.083738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b6c6e655-49db-4eab-a115-e6b029d8c382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:51.218069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7e56f-7b08-4805-9003-c68b47333f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:51.219586 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7e56f-7b08-4805-9003-c68b47333f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:51.220240 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7e56f-7b08-4805-9003-c68b47333f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:51.222081 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6e655-49db-4eab-a115-e6b029d8c382 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:51.222625 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7e56f-7b08-4805-9003-c68b47333f27 admin admin] PATH_INFO: `/v3/users/66d40960101d433e99f878f8d6375262` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:51.224421 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7e56f-7b08-4805-9003-c68b47333f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66d40960101d433e99f878f8d6375262)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:51.227267 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7e56f-7b08-4805-9003-c68b47333f27 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:51.231622 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d604e8-9980-49f4-9022-de6fec43ed14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:51.234089 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d604e8-9980-49f4-9022-de6fec43ed14 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:51.234751 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d604e8-9980-49f4-9022-de6fec43ed14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:51.235345 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d604e8-9980-49f4-9022-de6fec43ed14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:51.238229 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d604e8-9980-49f4-9022-de6fec43ed14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:51.245515 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d604e8-9980-49f4-9022-de6fec43ed14 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:51.370783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 834/1708] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:51:51 2022] POST /identity/v3/projects => generated 399 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:51:51.378184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eab8f6-0a1f-4eae-b4ab-2b801580cb65 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:51.378485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eab8f6-0a1f-4eae-b4ab-2b801580cb65 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:51.378764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eab8f6-0a1f-4eae-b4ab-2b801580cb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:51.424591 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-47eab8f6-0a1f-4eae-b4ab-2b801580cb65 None None] MFA Rules not processed for user `13ef78da38e941b3a09f1de838581d54`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:51.425809 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-47eab8f6-0a1f-4eae-b4ab-2b801580cb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:51.441695 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-77e7e56f-7b08-4805-9003-c68b47333f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66d40960101d433e99f878f8d6375262'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:51.444302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-77e7e56f-7b08-4805-9003-c68b47333f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66d40960101d433e99f878f8d6375262'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:51.446288 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-77e7e56f-7b08-4805-9003-c68b47333f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66d40960101d433e99f878f8d6375262'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:51.481084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-77e7e56f-7b08-4805-9003-c68b47333f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66d40960101d433e99f878f8d6375262'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:51.495460 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-77e7e56f-7b08-4805-9003-c68b47333f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66d40960101d433e99f878f8d6375262'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:51.597292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 875/1709] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:51:50 2022] DELETE /identity/v3/users/66d40960101d433e99f878f8d6375262 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:51:51.597292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a00c2-0215-429d-a05c-be1aacc4b4ec None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:51.597292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a00c2-0215-429d-a05c-be1aacc4b4ec None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:51.597292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a00c2-0215-429d-a05c-be1aacc4b4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:51.612082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 835/1710] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:51.612082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eab8f6-0a1f-4eae-b4ab-2b801580cb65 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:51.612082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-47eab8f6-0a1f-4eae-b4ab-2b801580cb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:51.679774 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d96a00c2-0215-429d-a05c-be1aacc4b4ec None None] MFA Rules not processed for user `9f11c63feb0740aeb5283907c8b61680`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:51.682411 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d96a00c2-0215-429d-a05c-be1aacc4b4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:51.793984 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eab8f6-0a1f-4eae-b4ab-2b801580cb65 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:51.943524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 876/1711] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:51.967968 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872210bc-91a9-40ed-b61c-e728bad67af9 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:51.971920 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872210bc-91a9-40ed-b61c-e728bad67af9 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:51.972250 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872210bc-91a9-40ed-b61c-e728bad67af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:52.026598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-872210bc-91a9-40ed-b61c-e728bad67af9 None None] MFA Rules not processed for user `13ef78da38e941b3a09f1de838581d54`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:52.029699 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-872210bc-91a9-40ed-b61c-e728bad67af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:52.037610 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aaccbf-7ad7-47cc-a0c9-f6f86adc18ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:52.041284 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aaccbf-7ad7-47cc-a0c9-f6f86adc18ac admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:52.041416 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aaccbf-7ad7-47cc-a0c9-f6f86adc18ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:52.041775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aaccbf-7ad7-47cc-a0c9-f6f86adc18ac admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:52.045239 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aaccbf-7ad7-47cc-a0c9-f6f86adc18ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:52.049847 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aaccbf-7ad7-47cc-a0c9-f6f86adc18ac admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:52.189374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 877/1712] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:52.190183 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872210bc-91a9-40ed-b61c-e728bad67af9 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:52.199393 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-872210bc-91a9-40ed-b61c-e728bad67af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:52.218417 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 836/1713] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:51:51 2022] POST /identity/v3/users => generated 306 bytes in 614 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:52.223161 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e802eb-d1c8-48de-a4b2-9e4b6929a403 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:52.225260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e802eb-d1c8-48de-a4b2-9e4b6929a403 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:52.226680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e802eb-d1c8-48de-a4b2-9e4b6929a403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:52.295905 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c0e802eb-d1c8-48de-a4b2-9e4b6929a403 None None] MFA Rules not processed for user `7a25a3f2c9a148a1ae73e519070b190b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:52.297493 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c0e802eb-d1c8-48de-a4b2-9e4b6929a403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:52.361167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872210bc-91a9-40ed-b61c-e728bad67af9 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:52.400826 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13c715-3244-4b08-ba95-4187afa82503 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:52.401519 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13c715-3244-4b08-ba95-4187afa82503 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:52.401808 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13c715-3244-4b08-ba95-4187afa82503 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:52.402086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13c715-3244-4b08-ba95-4187afa82503 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:52.429993 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13c715-3244-4b08-ba95-4187afa82503 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:52.435905 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13c715-3244-4b08-ba95-4187afa82503 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:52.464671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 878/1714] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:52.466402 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13c715-3244-4b08-ba95-4187afa82503 service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:52.470188 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6f13c715-3244-4b08-ba95-4187afa82503 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:52.491157 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13c715-3244-4b08-ba95-4187afa82503 service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:52.497910 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 837/1715] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 12 06:51:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:52.500394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e802eb-d1c8-48de-a4b2-9e4b6929a403 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:52.504377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5d653-1e29-4970-ae49-db579f2202a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:52.505289 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5d653-1e29-4970-ae49-db579f2202a5 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:52.506774 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5d653-1e29-4970-ae49-db579f2202a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:52.507213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5d653-1e29-4970-ae49-db579f2202a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:52.518770 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5d653-1e29-4970-ae49-db579f2202a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:52.520797 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5d653-1e29-4970-ae49-db579f2202a5 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:52.553315 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 879/1716] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:52.560822 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e802eb-d1c8-48de-a4b2-9e4b6929a403 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:52.593955 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbb097-1ec1-40e4-824e-2f5d4b2abb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:52.594672 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbb097-1ec1-40e4-824e-2f5d4b2abb84 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:52.595216 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbb097-1ec1-40e4-824e-2f5d4b2abb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:52.595496 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbb097-1ec1-40e4-824e-2f5d4b2abb84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:52.604934 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bbb097-1ec1-40e4-824e-2f5d4b2abb84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:52.604934 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bbb097-1ec1-40e4-824e-2f5d4b2abb84 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:52.630657 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 838/1717] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:52.634236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5d653-1e29-4970-ae49-db579f2202a5 service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:52.671264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5d653-1e29-4970-ae49-db579f2202a5 service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:52.679739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02d558-5c46-4d5b-b848-dffc626e72e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:52.680915 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02d558-5c46-4d5b-b848-dffc626e72e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:52.681379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02d558-5c46-4d5b-b848-dffc626e72e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:52.681825 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02d558-5c46-4d5b-b848-dffc626e72e8 admin admin] PATH_INFO: `/v3/projects/55aac0f1d37344aba2616dfd47196687/users/daeb1fafcfd6438b9de16ed1fa878575/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:52.699414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02d558-5c46-4d5b-b848-dffc626e72e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55aac0f1d37344aba2616dfd47196687, user_id=daeb1fafcfd6438b9de16ed1fa878575, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:52.702708 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02d558-5c46-4d5b-b848-dffc626e72e8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:52.762750 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 880/1718] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:52 2022] PUT /identity/v3/projects/55aac0f1d37344aba2616dfd47196687/users/daeb1fafcfd6438b9de16ed1fa878575/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:52.766721 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbb097-1ec1-40e4-824e-2f5d4b2abb84 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:52.791172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbb097-1ec1-40e4-824e-2f5d4b2abb84 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:52.865616 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02d558-5c46-4d5b-b848-dffc626e72e8 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:52.867078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7b02d558-5c46-4d5b-b848-dffc626e72e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:52.901360 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d1c00-c44a-438b-b32e-6f4cf7203254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:52.902275 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d1c00-c44a-438b-b32e-6f4cf7203254 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:52.903171 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d1c00-c44a-438b-b32e-6f4cf7203254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:52.903671 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d1c00-c44a-438b-b32e-6f4cf7203254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:52.904612 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d1c00-c44a-438b-b32e-6f4cf7203254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:52.907083 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d1c00-c44a-438b-b32e-6f4cf7203254 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:52.927751 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 839/1719] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:52.932704 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d1c00-c44a-438b-b32e-6f4cf7203254 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:52.966276 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d1c00-c44a-438b-b32e-6f4cf7203254 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:52.987352 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0834e46-df09-4407-aaee-d7be544278a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:52.991236 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0834e46-df09-4407-aaee-d7be544278a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:52.992224 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0834e46-df09-4407-aaee-d7be544278a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:52.994815 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0834e46-df09-4407-aaee-d7be544278a4 admin admin] PATH_INFO: `/v3/projects/55aac0f1d37344aba2616dfd47196687/users/daeb1fafcfd6438b9de16ed1fa878575/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:52.999494 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0834e46-df09-4407-aaee-d7be544278a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55aac0f1d37344aba2616dfd47196687, user_id=daeb1fafcfd6438b9de16ed1fa878575, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:53.008084 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0834e46-df09-4407-aaee-d7be544278a4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:53.031778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02d558-5c46-4d5b-b848-dffc626e72e8 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:53.041329 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 840/1720] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:52 2022] PUT /identity/v3/projects/55aac0f1d37344aba2616dfd47196687/users/daeb1fafcfd6438b9de16ed1fa878575/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:53.054661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db8f16-9ab5-46fb-ac11-4de17c7acd23 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:53.055461 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db8f16-9ab5-46fb-ac11-4de17c7acd23 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:53.056070 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db8f16-9ab5-46fb-ac11-4de17c7acd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:53.108728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d1db8f16-9ab5-46fb-ac11-4de17c7acd23 None None] MFA Rules not processed for user `daeb1fafcfd6438b9de16ed1fa878575`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:53.110944 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d1db8f16-9ab5-46fb-ac11-4de17c7acd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:53.147526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6e39c-f719-4fff-a116-758f94441d80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9882820f88349cb8fa2e3d457b19959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:53.148424 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6e39c-f719-4fff-a116-758f94441d80 service swift] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:53.150673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6e39c-f719-4fff-a116-758f94441d80 service swift] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:53.151474 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6e39c-f719-4fff-a116-758f94441d80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:53.238165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 841/1721] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:53 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:53.249776 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db8f16-9ab5-46fb-ac11-4de17c7acd23 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:53.252965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d1db8f16-9ab5-46fb-ac11-4de17c7acd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:53.279532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6e39c-f719-4fff-a116-758f94441d80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:53.280692 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6e39c-f719-4fff-a116-758f94441d80 service swift] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:53.292694 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 881/1722] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 12 06:51:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 06:51:53.416312 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db8f16-9ab5-46fb-ac11-4de17c7acd23 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:53.425596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa7109-47ac-43b7-8a5a-0a6a7386bf2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:53.427680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa7109-47ac-43b7-8a5a-0a6a7386bf2e service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:53.428191 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa7109-47ac-43b7-8a5a-0a6a7386bf2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:53.429225 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa7109-47ac-43b7-8a5a-0a6a7386bf2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:53.455094 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa7109-47ac-43b7-8a5a-0a6a7386bf2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:53.459009 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa7109-47ac-43b7-8a5a-0a6a7386bf2e service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:53.491814 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 842/1723] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:53 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:53.653026 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85845427-9d25-4055-b4cc-1683a237a437 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:53.653943 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85845427-9d25-4055-b4cc-1683a237a437 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:53.654405 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85845427-9d25-4055-b4cc-1683a237a437 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:53.656396 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 882/1724] 10.222.0.25 () {54 vars in 912 bytes} [Thu May 12 06:51:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:51:53.673014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba72e2-3050-45d8-a188-ae4203cc39cc None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:53.673014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba72e2-3050-45d8-a188-ae4203cc39cc None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:53.673014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba72e2-3050-45d8-a188-ae4203cc39cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:53.737472 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a3ba72e2-3050-45d8-a188-ae4203cc39cc None None] MFA Rules not processed for user `5a9cbec1af6545fcb34425dce87d0ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:53.740874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a3ba72e2-3050-45d8-a188-ae4203cc39cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:53.755037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85845427-9d25-4055-b4cc-1683a237a437 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:53.782251 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85845427-9d25-4055-b4cc-1683a237a437 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:53.796402 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfa48c-1050-40e4-bb2b-079d2a791f01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:53.797100 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfa48c-1050-40e4-bb2b-079d2a791f01 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:53.806841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfa48c-1050-40e4-bb2b-079d2a791f01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:53.814159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfa48c-1050-40e4-bb2b-079d2a791f01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:53.824262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e5cfa48c-1050-40e4-bb2b-079d2a791f01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:53.902192 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 843/1725] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 12 06:51:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:51:53.939126 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba72e2-3050-45d8-a188-ae4203cc39cc None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:53.941288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a3ba72e2-3050-45d8-a188-ae4203cc39cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:53.966150 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba72e2-3050-45d8-a188-ae4203cc39cc None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:53.974401 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b21c9-f94e-4a1a-aeed-624afc24b5c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:53.975496 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b21c9-f94e-4a1a-aeed-624afc24b5c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:53.975763 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b21c9-f94e-4a1a-aeed-624afc24b5c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:53.976046 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b21c9-f94e-4a1a-aeed-624afc24b5c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:54.000404 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b21c9-f94e-4a1a-aeed-624afc24b5c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:54.000404 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b21c9-f94e-4a1a-aeed-624afc24b5c9 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:54.021888 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 844/1726] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 06:51:54.126861 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfa48c-1050-40e4-bb2b-079d2a791f01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:54.128709 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfa48c-1050-40e4-bb2b-079d2a791f01 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:54.152652 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 883/1727] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:51:54.263848 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b21c9-f94e-4a1a-aeed-624afc24b5c9 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:54.266568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ee6b21c9-f94e-4a1a-aeed-624afc24b5c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:54.362234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfa48c-1050-40e4-bb2b-079d2a791f01 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:54.364030 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e5cfa48c-1050-40e4-bb2b-079d2a791f01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:54.472536 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b21c9-f94e-4a1a-aeed-624afc24b5c9 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:54.489907 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c998cb-ba5d-4aee-87ab-d475db13568d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:54.492478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c998cb-ba5d-4aee-87ab-d475db13568d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:54.492770 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c998cb-ba5d-4aee-87ab-d475db13568d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:54.493050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c998cb-ba5d-4aee-87ab-d475db13568d admin admin] PATH_INFO: `/v3/users/af9f038ed8be415093c0049729945ce5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:54.496003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c998cb-ba5d-4aee-87ab-d475db13568d admin admin] RBAC: Authorizing `identity:delete_user(user_id=af9f038ed8be415093c0049729945ce5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:54.503116 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c998cb-ba5d-4aee-87ab-d475db13568d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:54.812088 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfa48c-1050-40e4-bb2b-079d2a791f01 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:54.812088 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef38bf-c0e7-4f47-8ca0-bf43bed28a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:54.812088 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef38bf-c0e7-4f47-8ca0-bf43bed28a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:54.812088 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef38bf-c0e7-4f47-8ca0-bf43bed28a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:54.813510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef38bf-c0e7-4f47-8ca0-bf43bed28a3b admin admin] PATH_INFO: `/v3/projects/dc3b8da9a3b045ceacf02f1d1ea78b95` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:54.813510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef38bf-c0e7-4f47-8ca0-bf43bed28a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc3b8da9a3b045ceacf02f1d1ea78b95)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:54.813510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef38bf-c0e7-4f47-8ca0-bf43bed28a3b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:55.081274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a4ef38bf-c0e7-4f47-8ca0-bf43bed28a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc3b8da9a3b045ceacf02f1d1ea78b95', 'request_id': 'req-a4ef38bf-c0e7-4f47-8ca0-bf43bed28a3b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:55.094465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c3c998cb-ba5d-4aee-87ab-d475db13568d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af9f038ed8be415093c0049729945ce5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:55.099407 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c3c998cb-ba5d-4aee-87ab-d475db13568d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af9f038ed8be415093c0049729945ce5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:55.135966 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a4ef38bf-c0e7-4f47-8ca0-bf43bed28a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc3b8da9a3b045ceacf02f1d1ea78b95', 'request_id': 'req-a4ef38bf-c0e7-4f47-8ca0-bf43bed28a3b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:55.142805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a4ef38bf-c0e7-4f47-8ca0-bf43bed28a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc3b8da9a3b045ceacf02f1d1ea78b95', 'request_id': 'req-a4ef38bf-c0e7-4f47-8ca0-bf43bed28a3b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:55.146360 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c3c998cb-ba5d-4aee-87ab-d475db13568d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af9f038ed8be415093c0049729945ce5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:55.148023 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c3c998cb-ba5d-4aee-87ab-d475db13568d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af9f038ed8be415093c0049729945ce5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:55.164977 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c3c998cb-ba5d-4aee-87ab-d475db13568d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af9f038ed8be415093c0049729945ce5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:55.209235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a4ef38bf-c0e7-4f47-8ca0-bf43bed28a3b admin admin] The token cache is being invalidate because project dc3b8da9a3b045ceacf02f1d1ea78b95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:51:55.209525 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a4ef38bf-c0e7-4f47-8ca0-bf43bed28a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:55.211273 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a4ef38bf-c0e7-4f47-8ca0-bf43bed28a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:55.224024 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 884/1728] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:51:54 2022] DELETE /identity/v3/projects/dc3b8da9a3b045ceacf02f1d1ea78b95 => generated 0 bytes in 858 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:55.225962 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52cb27-c2d5-4bc1-ae90-1d165601fa92 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:55.226855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52cb27-c2d5-4bc1-ae90-1d165601fa92 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:55.227294 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52cb27-c2d5-4bc1-ae90-1d165601fa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:55.267089 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 845/1729] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:51:54 2022] DELETE /identity/v3/users/af9f038ed8be415093c0049729945ce5 => generated 0 bytes in 1005 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:55.271878 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74f3fe-4166-466a-83d3-8489a2f2e93c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:55.272377 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74f3fe-4166-466a-83d3-8489a2f2e93c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:55.272889 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74f3fe-4166-466a-83d3-8489a2f2e93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:55.292226 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-5f52cb27-c2d5-4bc1-ae90-1d165601fa92 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:55.297350 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5f52cb27-c2d5-4bc1-ae90-1d165601fa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:55.333044 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3c74f3fe-4166-466a-83d3-8489a2f2e93c None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:55.334200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3c74f3fe-4166-466a-83d3-8489a2f2e93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:55.423977 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 885/1730] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:55.425575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10534b88-c075-4a83-954f-6922551538c4 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:55.425867 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10534b88-c075-4a83-954f-6922551538c4 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:55.426142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10534b88-c075-4a83-954f-6922551538c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:55.476406 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-10534b88-c075-4a83-954f-6922551538c4 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:55.489884 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-10534b88-c075-4a83-954f-6922551538c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:55.511405 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 886/1731] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:55.516217 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10534b88-c075-4a83-954f-6922551538c4 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:55.540812 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10534b88-c075-4a83-954f-6922551538c4 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:55.556991 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d78065-ef60-418d-bba2-578eab6c3ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:55.557744 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d78065-ef60-418d-bba2-578eab6c3ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:55.558382 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d78065-ef60-418d-bba2-578eab6c3ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:55.558792 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d78065-ef60-418d-bba2-578eab6c3ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:55.560102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d78065-ef60-418d-bba2-578eab6c3ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:51:55.560579 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d78065-ef60-418d-bba2-578eab6c3ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:55.565434 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 846/1732] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:55.579483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d78065-ef60-418d-bba2-578eab6c3ee5 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:55.628972 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 887/1733] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:51:55.635104 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74f3fe-4166-466a-83d3-8489a2f2e93c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:55.659945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74f3fe-4166-466a-83d3-8489a2f2e93c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:55.672463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349faee-ae4d-41b7-bfea-508acc37ce26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:55.674836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349faee-ae4d-41b7-bfea-508acc37ce26 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:55.675228 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349faee-ae4d-41b7-bfea-508acc37ce26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:55.676598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349faee-ae4d-41b7-bfea-508acc37ce26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:55.677501 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349faee-ae4d-41b7-bfea-508acc37ce26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:55.682417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d78065-ef60-418d-bba2-578eab6c3ee5 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:55.684102 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349faee-ae4d-41b7-bfea-508acc37ce26 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:55.684916 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-86d78065-ef60-418d-bba2-578eab6c3ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:55.838840 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 847/1734] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:51:55 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:55.840902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b7b0a-6672-425e-be72-2cdf57472c39 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:55.842052 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b7b0a-6672-425e-be72-2cdf57472c39 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:55.843142 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b7b0a-6672-425e-be72-2cdf57472c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:55.899232 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c02b7b0a-6672-425e-be72-2cdf57472c39 None None] MFA Rules not processed for user `d77bf80654c24c8c8336ce395f789ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:55.901985 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c02b7b0a-6672-425e-be72-2cdf57472c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:55.905854 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d78065-ef60-418d-bba2-578eab6c3ee5 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:56.021841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383b7cf-3c94-4091-add0-5e9cac0a2885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:56.022881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383b7cf-3c94-4091-add0-5e9cac0a2885 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:56.023081 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383b7cf-3c94-4091-add0-5e9cac0a2885 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:56.023357 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383b7cf-3c94-4091-add0-5e9cac0a2885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:56.042205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 848/1735] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:56.045447 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b7b0a-6672-425e-be72-2cdf57472c39 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:56.213469 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383b7cf-3c94-4091-add0-5e9cac0a2885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:56.228823 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383b7cf-3c94-4091-add0-5e9cac0a2885 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:56.229312 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b7b0a-6672-425e-be72-2cdf57472c39 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:56.237632 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7942fa-fb10-4802-a9ce-7844add03b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:56.242315 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7942fa-fb10-4802-a9ce-7844add03b78 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:56.242826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7942fa-fb10-4802-a9ce-7844add03b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:56.243318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7942fa-fb10-4802-a9ce-7844add03b78 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:56.244596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7942fa-fb10-4802-a9ce-7844add03b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:56.252197 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7942fa-fb10-4802-a9ce-7844add03b78 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:56.261977 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 888/1736] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 06:51:56.351932 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 849/1737] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:51:56 2022] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:56.355142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383b7cf-3c94-4091-add0-5e9cac0a2885 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:56.371912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383b7cf-3c94-4091-add0-5e9cac0a2885 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:56.389618 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bed7f9-7f6a-4297-9660-1bb39475d81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:56.392373 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bed7f9-7f6a-4297-9660-1bb39475d81e admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:56.392373 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bed7f9-7f6a-4297-9660-1bb39475d81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:56.392588 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bed7f9-7f6a-4297-9660-1bb39475d81e admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:56.404036 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bed7f9-7f6a-4297-9660-1bb39475d81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:56.420388 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bed7f9-7f6a-4297-9660-1bb39475d81e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:56.443135 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 889/1738] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:56.443934 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7942fa-fb10-4802-a9ce-7844add03b78 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:56.460099 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7942fa-fb10-4802-a9ce-7844add03b78 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:56.476753 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8145d04-cb30-4465-b18d-d4d2fd003fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:56.477554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8145d04-cb30-4465-b18d-d4d2fd003fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:56.477975 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8145d04-cb30-4465-b18d-d4d2fd003fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:56.478357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8145d04-cb30-4465-b18d-d4d2fd003fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:56.479218 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8145d04-cb30-4465-b18d-d4d2fd003fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:56.481192 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8145d04-cb30-4465-b18d-d4d2fd003fa6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:56.506877 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 850/1739] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:56.509052 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bed7f9-7f6a-4297-9660-1bb39475d81e admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:56.526673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bed7f9-7f6a-4297-9660-1bb39475d81e admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:56.536717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c805a-b646-4ae0-bdb9-504c7ac272c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:56.538342 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c805a-b646-4ae0-bdb9-504c7ac272c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:56.538576 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c805a-b646-4ae0-bdb9-504c7ac272c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:56.538955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c805a-b646-4ae0-bdb9-504c7ac272c5 admin admin] PATH_INFO: `/v3/projects/751cdf841b8a4b55a84e37ecaeb3c54e/users/07aa5eabe3414884a5e8ba8092257fb1/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:56.542789 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062e72d-1e86-41bd-9d2c-a12f08c2dd30 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:56.543200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062e72d-1e86-41bd-9d2c-a12f08c2dd30 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:56.543572 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062e72d-1e86-41bd-9d2c-a12f08c2dd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:56.597662 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b062e72d-1e86-41bd-9d2c-a12f08c2dd30 None None] MFA Rules not processed for user `5a9cbec1af6545fcb34425dce87d0ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:56.599332 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b062e72d-1e86-41bd-9d2c-a12f08c2dd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:56.603279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c805a-b646-4ae0-bdb9-504c7ac272c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=751cdf841b8a4b55a84e37ecaeb3c54e, user_id=07aa5eabe3414884a5e8ba8092257fb1, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:56.608160 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c805a-b646-4ae0-bdb9-504c7ac272c5 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:56.684813 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 851/1740] 10.222.0.23 () {58 vars in 1015 bytes} [Thu May 12 06:51:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:51:56.748356 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062e72d-1e86-41bd-9d2c-a12f08c2dd30 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:56.760693 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062e72d-1e86-41bd-9d2c-a12f08c2dd30 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:56.769844 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 890/1741] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:56 2022] PUT /identity/v3/projects/751cdf841b8a4b55a84e37ecaeb3c54e/users/07aa5eabe3414884a5e8ba8092257fb1/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:56.780472 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23538cf2-8102-4c3f-80d9-8076c13be5f7 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:56.781185 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23538cf2-8102-4c3f-80d9-8076c13be5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:56.781390 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23538cf2-8102-4c3f-80d9-8076c13be5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:56.909842 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-23538cf2-8102-4c3f-80d9-8076c13be5f7 None None] MFA Rules not processed for user `07aa5eabe3414884a5e8ba8092257fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:56.914870 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-23538cf2-8102-4c3f-80d9-8076c13be5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:57.038774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0419aa7-d2f7-4259-9240-858418e54486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:57.039746 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0419aa7-d2f7-4259-9240-858418e54486 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:57.040142 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0419aa7-d2f7-4259-9240-858418e54486 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:57.041069 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0419aa7-d2f7-4259-9240-858418e54486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:57.073573 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0419aa7-d2f7-4259-9240-858418e54486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:57.075453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0419aa7-d2f7-4259-9240-858418e54486 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:57.133412 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 852/1742] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 06:51:57.145906 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3707a09-4800-4040-bd6f-cce18b7c117d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:57.150468 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3707a09-4800-4040-bd6f-cce18b7c117d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:57.150856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3707a09-4800-4040-bd6f-cce18b7c117d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:57.192389 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 891/1743] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:57.197325 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23538cf2-8102-4c3f-80d9-8076c13be5f7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:57.284204 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c3707a09-4800-4040-bd6f-cce18b7c117d None None] MFA Rules not processed for user `13ef78da38e941b3a09f1de838581d54`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:57.294849 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c3707a09-4800-4040-bd6f-cce18b7c117d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:57.495739 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 853/1744] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:57.517364 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23538cf2-8102-4c3f-80d9-8076c13be5f7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:57.573211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61c42c-f3c0-449d-813a-a78060a40fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:57.573872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61c42c-f3c0-449d-813a-a78060a40fce admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:57.580188 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61c42c-f3c0-449d-813a-a78060a40fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:57.581755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61c42c-f3c0-449d-813a-a78060a40fce admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:57.582551 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61c42c-f3c0-449d-813a-a78060a40fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:57.593399 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61c42c-f3c0-449d-813a-a78060a40fce admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:57.781108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 892/1745] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:51:57 2022] POST /identity/v3/projects => generated 387 bytes in 585 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:57.786736 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3707a09-4800-4040-bd6f-cce18b7c117d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:57.816654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3707a09-4800-4040-bd6f-cce18b7c117d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:58.038292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4759ff-dc20-4ddf-ab22-bc25d013aebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:58.039924 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4759ff-dc20-4ddf-ab22-bc25d013aebe admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:58.040267 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4759ff-dc20-4ddf-ab22-bc25d013aebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:58.040602 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4759ff-dc20-4ddf-ab22-bc25d013aebe admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:58.041330 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4759ff-dc20-4ddf-ab22-bc25d013aebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:58.053921 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4759ff-dc20-4ddf-ab22-bc25d013aebe admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:58.308397 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 854/1746] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:51:57 2022] POST /identity/v3/users => generated 300 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:51:58.309755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61c42c-f3c0-449d-813a-a78060a40fce admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:58.335541 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61c42c-f3c0-449d-813a-a78060a40fce admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:58.362801 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2dfb4-7807-4515-8199-16e6af02103e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:58.363622 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2dfb4-7807-4515-8199-16e6af02103e admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:58.364114 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2dfb4-7807-4515-8199-16e6af02103e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:58.364546 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2dfb4-7807-4515-8199-16e6af02103e admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:58.365402 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2dfb4-7807-4515-8199-16e6af02103e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:58.367374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2dfb4-7807-4515-8199-16e6af02103e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:58.384861 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 893/1747] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:58.388445 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4759ff-dc20-4ddf-ab22-bc25d013aebe admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:58.422665 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4759ff-dc20-4ddf-ab22-bc25d013aebe admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:58.434412 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c6034-c65e-4a62-85ba-34dbc126996c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:58.436726 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c6034-c65e-4a62-85ba-34dbc126996c admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:58.438368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c6034-c65e-4a62-85ba-34dbc126996c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:58.438896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c6034-c65e-4a62-85ba-34dbc126996c admin admin] PATH_INFO: `/v3/projects/7ec5859c81fb4b7c8b50dd44b4e25eea/users/c66d0796ad24429a96613553f8caf645/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:58.479733 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c6034-c65e-4a62-85ba-34dbc126996c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec5859c81fb4b7c8b50dd44b4e25eea, user_id=c66d0796ad24429a96613553f8caf645, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:58.486884 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c6034-c65e-4a62-85ba-34dbc126996c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:58.589458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 855/1748] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:58 2022] PUT /identity/v3/projects/7ec5859c81fb4b7c8b50dd44b4e25eea/users/c66d0796ad24429a96613553f8caf645/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:51:58.593365 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2dfb4-7807-4515-8199-16e6af02103e admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:58.624903 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2dfb4-7807-4515-8199-16e6af02103e admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:58.730690 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2c29a-2d5f-4a46-b6f9-95cfbf91f057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:58.731552 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2c29a-2d5f-4a46-b6f9-95cfbf91f057 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:58.732143 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2c29a-2d5f-4a46-b6f9-95cfbf91f057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:58.732526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2c29a-2d5f-4a46-b6f9-95cfbf91f057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:58.733569 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2c29a-2d5f-4a46-b6f9-95cfbf91f057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:58.735639 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2c29a-2d5f-4a46-b6f9-95cfbf91f057 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:58.751666 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 894/1749] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:51:58.755842 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c6034-c65e-4a62-85ba-34dbc126996c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:58.772489 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c6034-c65e-4a62-85ba-34dbc126996c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:58.784659 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ea631-9e30-4035-8684-9a9938cacbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:58.785894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ea631-9e30-4035-8684-9a9938cacbff admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:58.801137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ea631-9e30-4035-8684-9a9938cacbff admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:58.801137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ea631-9e30-4035-8684-9a9938cacbff admin admin] PATH_INFO: `/v3/projects/7ec5859c81fb4b7c8b50dd44b4e25eea/users/c66d0796ad24429a96613553f8caf645/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:58.809226 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ea631-9e30-4035-8684-9a9938cacbff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec5859c81fb4b7c8b50dd44b4e25eea, user_id=c66d0796ad24429a96613553f8caf645, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:58.817311 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ea631-9e30-4035-8684-9a9938cacbff admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:58.859009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2c29a-2d5f-4a46-b6f9-95cfbf91f057 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:58.871033 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-15a2c29a-2d5f-4a46-b6f9-95cfbf91f057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:58.893369 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 856/1750] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:51:58 2022] PUT /identity/v3/projects/7ec5859c81fb4b7c8b50dd44b4e25eea/users/c66d0796ad24429a96613553f8caf645/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:58.897240 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b94908-dca6-411f-a4a2-205cdd23194a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:58.898108 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b94908-dca6-411f-a4a2-205cdd23194a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:58.899147 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b94908-dca6-411f-a4a2-205cdd23194a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:58.932946 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2c29a-2d5f-4a46-b6f9-95cfbf91f057 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:58.980720 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c0b94908-dca6-411f-a4a2-205cdd23194a None None] MFA Rules not processed for user `c66d0796ad24429a96613553f8caf645`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:51:58.982706 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c0b94908-dca6-411f-a4a2-205cdd23194a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:59.161853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80578950-a431-4ff3-9a54-04710ceff9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:59.164050 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80578950-a431-4ff3-9a54-04710ceff9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:59.165549 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80578950-a431-4ff3-9a54-04710ceff9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:59.169820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80578950-a431-4ff3-9a54-04710ceff9ab admin admin] PATH_INFO: `/v3/projects/2574f9d0b3b94e2fa7a01af7a162ae29` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:59.172563 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80578950-a431-4ff3-9a54-04710ceff9ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2574f9d0b3b94e2fa7a01af7a162ae29)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:59.174896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80578950-a431-4ff3-9a54-04710ceff9ab admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:59.254669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 857/1751] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:51:59.266400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b94908-dca6-411f-a4a2-205cdd23194a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:59.267899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c0b94908-dca6-411f-a4a2-205cdd23194a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:59.404791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b94908-dca6-411f-a4a2-205cdd23194a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:59.453585 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-80578950-a431-4ff3-9a54-04710ceff9ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2574f9d0b3b94e2fa7a01af7a162ae29', 'request_id': 'req-80578950-a431-4ff3-9a54-04710ceff9ab'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:59.524084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-80578950-a431-4ff3-9a54-04710ceff9ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2574f9d0b3b94e2fa7a01af7a162ae29', 'request_id': 'req-80578950-a431-4ff3-9a54-04710ceff9ab'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:59.534123 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-80578950-a431-4ff3-9a54-04710ceff9ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2574f9d0b3b94e2fa7a01af7a162ae29', 'request_id': 'req-80578950-a431-4ff3-9a54-04710ceff9ab'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:59.561268 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a2c1f-b9b9-4c47-ae8c-1b303a1a21bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:59.561981 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a2c1f-b9b9-4c47-ae8c-1b303a1a21bb service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:59.562256 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a2c1f-b9b9-4c47-ae8c-1b303a1a21bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:59.562527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a2c1f-b9b9-4c47-ae8c-1b303a1a21bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:59.574215 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-80578950-a431-4ff3-9a54-04710ceff9ab admin admin] The token cache is being invalidate because project 2574f9d0b3b94e2fa7a01af7a162ae29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:51:59.574532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-80578950-a431-4ff3-9a54-04710ceff9ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:59.578336 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-80578950-a431-4ff3-9a54-04710ceff9ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:51:59.583059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 895/1752] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:51:58 2022] DELETE /identity/v3/projects/2574f9d0b3b94e2fa7a01af7a162ae29 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:51:59.613501 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80578950-a431-4ff3-9a54-04710ceff9ab admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:51:59.623328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-80578950-a431-4ff3-9a54-04710ceff9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:51:59.845789 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a2c1f-b9b9-4c47-ae8c-1b303a1a21bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:59.852098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a2c1f-b9b9-4c47-ae8c-1b303a1a21bb service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:51:59.891066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80578950-a431-4ff3-9a54-04710ceff9ab admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:51:59.907212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 858/1753] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:51:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 06:51:59.907860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb1e89-f619-41ea-8959-cd48c8553199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:51:59.910511 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb1e89-f619-41ea-8959-cd48c8553199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:59.910912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b580b-0dc2-4c95-95aa-43e0095c3d9f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:51:59.911700 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b580b-0dc2-4c95-95aa-43e0095c3d9f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:59.912150 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb1e89-f619-41ea-8959-cd48c8553199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:51:59.912320 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b580b-0dc2-4c95-95aa-43e0095c3d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:59.913473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb1e89-f619-41ea-8959-cd48c8553199 admin admin] PATH_INFO: `/v3/users/1868f2e1b0a94ef195948d0fdaf53e1a` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:51:59.918795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb1e89-f619-41ea-8959-cd48c8553199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1868f2e1b0a94ef195948d0fdaf53e1a)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:51:59.922726 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb1e89-f619-41ea-8959-cd48c8553199 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:00.049188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ba6b580b-0dc2-4c95-95aa-43e0095c3d9f None None] MFA Rules not processed for user `9f11c63feb0740aeb5283907c8b61680`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:00.059251 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ba6b580b-0dc2-4c95-95aa-43e0095c3d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:00.157958 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-84cb1e89-f619-41ea-8959-cd48c8553199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1868f2e1b0a94ef195948d0fdaf53e1a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:00.160854 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-84cb1e89-f619-41ea-8959-cd48c8553199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1868f2e1b0a94ef195948d0fdaf53e1a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:00.164115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-84cb1e89-f619-41ea-8959-cd48c8553199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1868f2e1b0a94ef195948d0fdaf53e1a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:00.215072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-84cb1e89-f619-41ea-8959-cd48c8553199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1868f2e1b0a94ef195948d0fdaf53e1a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:00.245451 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-84cb1e89-f619-41ea-8959-cd48c8553199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1868f2e1b0a94ef195948d0fdaf53e1a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:00.253484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 859/1754] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:51:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:00.255816 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b580b-0dc2-4c95-95aa-43e0095c3d9f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:00.258310 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ba6b580b-0dc2-4c95-95aa-43e0095c3d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:00.292062 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b580b-0dc2-4c95-95aa-43e0095c3d9f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:00.299830 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438d120-3502-4d59-82c5-33794ae5aba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:00.302349 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438d120-3502-4d59-82c5-33794ae5aba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:00.302349 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438d120-3502-4d59-82c5-33794ae5aba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:00.302349 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438d120-3502-4d59-82c5-33794ae5aba5 admin admin] PATH_INFO: `/v3/users/07aa5eabe3414884a5e8ba8092257fb1` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:00.307435 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438d120-3502-4d59-82c5-33794ae5aba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07aa5eabe3414884a5e8ba8092257fb1)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:00.310552 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438d120-3502-4d59-82c5-33794ae5aba5 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:00.341754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 896/1755] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:51:59 2022] DELETE /identity/v3/users/1868f2e1b0a94ef195948d0fdaf53e1a => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:00.632376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1438d120-3502-4d59-82c5-33794ae5aba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07aa5eabe3414884a5e8ba8092257fb1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:00.638670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1438d120-3502-4d59-82c5-33794ae5aba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07aa5eabe3414884a5e8ba8092257fb1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:00.694380 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1438d120-3502-4d59-82c5-33794ae5aba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07aa5eabe3414884a5e8ba8092257fb1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:00.700180 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1438d120-3502-4d59-82c5-33794ae5aba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07aa5eabe3414884a5e8ba8092257fb1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:00.717309 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1438d120-3502-4d59-82c5-33794ae5aba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07aa5eabe3414884a5e8ba8092257fb1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:00.848940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 860/1756] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:00 2022] DELETE /identity/v3/users/07aa5eabe3414884a5e8ba8092257fb1 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:00.854177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf314a-1696-4122-b166-c157e676b733 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:00.855324 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf314a-1696-4122-b166-c157e676b733 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:00.856007 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf314a-1696-4122-b166-c157e676b733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:00.909949 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6fcf314a-1696-4122-b166-c157e676b733 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:00.912136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6fcf314a-1696-4122-b166-c157e676b733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:01.196093 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 897/1757] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:52:01.613068 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438d120-3502-4d59-82c5-33794ae5aba5 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:01.616124 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1438d120-3502-4d59-82c5-33794ae5aba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:01.780729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438d120-3502-4d59-82c5-33794ae5aba5 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:01.797587 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c1b60-f8d6-46a9-92bc-acf64abfa6b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:01.800279 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c1b60-f8d6-46a9-92bc-acf64abfa6b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:01.801768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c1b60-f8d6-46a9-92bc-acf64abfa6b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:01.803301 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c1b60-f8d6-46a9-92bc-acf64abfa6b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:01.829108 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c1b60-f8d6-46a9-92bc-acf64abfa6b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:01.830849 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c1b60-f8d6-46a9-92bc-acf64abfa6b4 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:01.864109 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 861/1758] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:02.272078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf314a-1696-4122-b166-c157e676b733 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:02.275349 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6fcf314a-1696-4122-b166-c157e676b733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:02.305153 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf314a-1696-4122-b166-c157e676b733 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:02.315578 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936015d-c83b-47bb-b309-219ea144531d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:02.316512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936015d-c83b-47bb-b309-219ea144531d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:02.317104 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936015d-c83b-47bb-b309-219ea144531d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:02.317526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936015d-c83b-47bb-b309-219ea144531d admin admin] PATH_INFO: `/v3/users/708893f8cce249b186fa123459fb5443` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:02.327860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936015d-c83b-47bb-b309-219ea144531d admin admin] RBAC: Authorizing `identity:delete_user(user_id=708893f8cce249b186fa123459fb5443)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:02.330108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936015d-c83b-47bb-b309-219ea144531d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:02.584065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3936015d-c83b-47bb-b309-219ea144531d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '708893f8cce249b186fa123459fb5443'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:02.585817 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3936015d-c83b-47bb-b309-219ea144531d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '708893f8cce249b186fa123459fb5443'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:02.589036 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3936015d-c83b-47bb-b309-219ea144531d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '708893f8cce249b186fa123459fb5443'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:02.639244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3936015d-c83b-47bb-b309-219ea144531d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '708893f8cce249b186fa123459fb5443'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:02.670772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3936015d-c83b-47bb-b309-219ea144531d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '708893f8cce249b186fa123459fb5443'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:02.755395 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c1b60-f8d6-46a9-92bc-acf64abfa6b4 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:02.757313 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4c6c1b60-f8d6-46a9-92bc-acf64abfa6b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:02.776803 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 898/1759] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:02 2022] DELETE /identity/v3/users/708893f8cce249b186fa123459fb5443 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:02.782552 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c1b60-f8d6-46a9-92bc-acf64abfa6b4 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:02.788071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf47491-f68b-4d1e-9788-26564c2d1b59 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:02.788689 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf47491-f68b-4d1e-9788-26564c2d1b59 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:02.789137 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf47491-f68b-4d1e-9788-26564c2d1b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:02.851582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-2cf47491-f68b-4d1e-9788-26564c2d1b59 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:02.856442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2cf47491-f68b-4d1e-9788-26564c2d1b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:02.905661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630bf75-6ecf-4fb0-8df3-e1eb7ff60504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:02.906590 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630bf75-6ecf-4fb0-8df3-e1eb7ff60504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:02.906905 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630bf75-6ecf-4fb0-8df3-e1eb7ff60504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:02.907205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630bf75-6ecf-4fb0-8df3-e1eb7ff60504 admin admin] PATH_INFO: `/v3/projects/8b234fa9e1d34941b4015afcb71095c5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:02.909237 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630bf75-6ecf-4fb0-8df3-e1eb7ff60504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b234fa9e1d34941b4015afcb71095c5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:02.911391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630bf75-6ecf-4fb0-8df3-e1eb7ff60504 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:03.088708 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d630bf75-6ecf-4fb0-8df3-e1eb7ff60504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b234fa9e1d34941b4015afcb71095c5', 'request_id': 'req-d630bf75-6ecf-4fb0-8df3-e1eb7ff60504'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:03.146167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 899/1760] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:52:03.186127 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d630bf75-6ecf-4fb0-8df3-e1eb7ff60504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b234fa9e1d34941b4015afcb71095c5', 'request_id': 'req-d630bf75-6ecf-4fb0-8df3-e1eb7ff60504'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:03.194567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d630bf75-6ecf-4fb0-8df3-e1eb7ff60504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b234fa9e1d34941b4015afcb71095c5', 'request_id': 'req-d630bf75-6ecf-4fb0-8df3-e1eb7ff60504'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:03.239236 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d630bf75-6ecf-4fb0-8df3-e1eb7ff60504 admin admin] The token cache is being invalidate because project 8b234fa9e1d34941b4015afcb71095c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:03.239236 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d630bf75-6ecf-4fb0-8df3-e1eb7ff60504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:03.239472 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d630bf75-6ecf-4fb0-8df3-e1eb7ff60504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:03.239589 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05314e5-c527-494d-b807-aac8c8698220 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:03.240184 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05314e5-c527-494d-b807-aac8c8698220 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:03.240605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05314e5-c527-494d-b807-aac8c8698220 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:03.242589 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 900/1761] 10.222.0.25 () {54 vars in 921 bytes} [Thu May 12 06:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:52:03.247256 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 862/1762] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:02 2022] DELETE /identity/v3/projects/8b234fa9e1d34941b4015afcb71095c5 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:03.248860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9879c80-0033-424c-8635-c4b3d3cf240a None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:03.249306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9879c80-0033-424c-8635-c4b3d3cf240a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:03.249721 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9879c80-0033-424c-8635-c4b3d3cf240a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:03.304422 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630bf75-6ecf-4fb0-8df3-e1eb7ff60504 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:03.306193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d630bf75-6ecf-4fb0-8df3-e1eb7ff60504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:03.338388 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d9879c80-0033-424c-8635-c4b3d3cf240a None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:03.355476 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d9879c80-0033-424c-8635-c4b3d3cf240a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:03.510713 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630bf75-6ecf-4fb0-8df3-e1eb7ff60504 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:03.524307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 901/1763] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:52:03.526734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059f84d-7a6c-46fe-92dd-69b8fbb3e0cc None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:03.527222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059f84d-7a6c-46fe-92dd-69b8fbb3e0cc None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:03.527837 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059f84d-7a6c-46fe-92dd-69b8fbb3e0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:03.532861 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b3168-c229-43d1-ab30-86d00cf1b72c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:03.533536 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b3168-c229-43d1-ab30-86d00cf1b72c service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:03.538263 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b3168-c229-43d1-ab30-86d00cf1b72c service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:03.538263 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b3168-c229-43d1-ab30-86d00cf1b72c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:03.538263 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-793b3168-c229-43d1-ab30-86d00cf1b72c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:03.573544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-1059f84d-7a6c-46fe-92dd-69b8fbb3e0cc None None] MFA Rules not processed for user `bbcd54a927bf46f183b50fbda677868d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:03.573628 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b3168-c229-43d1-ab30-86d00cf1b72c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:03.575223 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1059f84d-7a6c-46fe-92dd-69b8fbb3e0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:03.579715 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b3168-c229-43d1-ab30-86d00cf1b72c service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:03.620136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 863/1764] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:03.625428 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cabfd-6e66-4921-aed3-a4b71e4a3b06 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:03.625792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cabfd-6e66-4921-aed3-a4b71e4a3b06 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:03.630262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cabfd-6e66-4921-aed3-a4b71e4a3b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:03.683864 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-313cabfd-6e66-4921-aed3-a4b71e4a3b06 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:03.685421 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-313cabfd-6e66-4921-aed3-a4b71e4a3b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:03.719179 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 864/1765] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:03.720388 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cabfd-6e66-4921-aed3-a4b71e4a3b06 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:03.725864 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-313cabfd-6e66-4921-aed3-a4b71e4a3b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:03.753305 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 902/1766] 10.222.0.25 () {58 vars in 1018 bytes} [Thu May 12 06:52:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:03.754032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059f84d-7a6c-46fe-92dd-69b8fbb3e0cc None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:03.780391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cabfd-6e66-4921-aed3-a4b71e4a3b06 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:03.784314 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059f84d-7a6c-46fe-92dd-69b8fbb3e0cc None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:03.806944 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e0855-4e56-42e5-9a26-1ef3fb999a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:03.808392 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e0855-4e56-42e5-9a26-1ef3fb999a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:03.809562 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e0855-4e56-42e5-9a26-1ef3fb999a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:03.810104 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e0855-4e56-42e5-9a26-1ef3fb999a30 admin admin] PATH_INFO: `/v3/projects/751cdf841b8a4b55a84e37ecaeb3c54e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:03.812891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d727fe7-6372-4fb9-a2f0-b91a8730b957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:03.813674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d727fe7-6372-4fb9-a2f0-b91a8730b957 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:03.813958 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d727fe7-6372-4fb9-a2f0-b91a8730b957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:03.814230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d727fe7-6372-4fb9-a2f0-b91a8730b957 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:03.814515 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e0855-4e56-42e5-9a26-1ef3fb999a30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=751cdf841b8a4b55a84e37ecaeb3c54e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:03.814974 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d727fe7-6372-4fb9-a2f0-b91a8730b957 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:52:03.815291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d727fe7-6372-4fb9-a2f0-b91a8730b957 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:03.817081 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d727fe7-6372-4fb9-a2f0-b91a8730b957 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:03.820544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e0855-4e56-42e5-9a26-1ef3fb999a30 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:03.862119 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 903/1767] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:52:03.867059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d727fe7-6372-4fb9-a2f0-b91a8730b957 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:03.889346 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d727fe7-6372-4fb9-a2f0-b91a8730b957 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:03.904498 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d615b4d-6132-44b0-b1bf-cc22b5b5b547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:03.905250 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d615b4d-6132-44b0-b1bf-cc22b5b5b547 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:03.905603 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d615b4d-6132-44b0-b1bf-cc22b5b5b547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:03.905879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d615b4d-6132-44b0-b1bf-cc22b5b5b547 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:03.906733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d615b4d-6132-44b0-b1bf-cc22b5b5b547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:03.908837 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d615b4d-6132-44b0-b1bf-cc22b5b5b547 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:04.016463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-596e0855-4e56-42e5-9a26-1ef3fb999a30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '751cdf841b8a4b55a84e37ecaeb3c54e', 'request_id': 'req-596e0855-4e56-42e5-9a26-1ef3fb999a30'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:04.019392 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 904/1768] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:03 2022] POST /identity/v3/projects => generated 363 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:52:04.023760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d615b4d-6132-44b0-b1bf-cc22b5b5b547 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:04.146373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-596e0855-4e56-42e5-9a26-1ef3fb999a30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '751cdf841b8a4b55a84e37ecaeb3c54e', 'request_id': 'req-596e0855-4e56-42e5-9a26-1ef3fb999a30'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:04.157138 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-596e0855-4e56-42e5-9a26-1ef3fb999a30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '751cdf841b8a4b55a84e37ecaeb3c54e', 'request_id': 'req-596e0855-4e56-42e5-9a26-1ef3fb999a30'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:04.213169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-596e0855-4e56-42e5-9a26-1ef3fb999a30 admin admin] The token cache is being invalidate because project 751cdf841b8a4b55a84e37ecaeb3c54e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:04.215184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-596e0855-4e56-42e5-9a26-1ef3fb999a30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:04.219075 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-596e0855-4e56-42e5-9a26-1ef3fb999a30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:04.223266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 865/1769] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:03 2022] DELETE /identity/v3/projects/751cdf841b8a4b55a84e37ecaeb3c54e => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:04.229033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e0855-4e56-42e5-9a26-1ef3fb999a30 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:04.233146 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-596e0855-4e56-42e5-9a26-1ef3fb999a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:04.286811 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d615b4d-6132-44b0-b1bf-cc22b5b5b547 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:04.315278 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a10b7-d947-4e8a-ba17-01b77c0f1c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:04.316013 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a10b7-d947-4e8a-ba17-01b77c0f1c7b admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:04.316296 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a10b7-d947-4e8a-ba17-01b77c0f1c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:04.316571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a10b7-d947-4e8a-ba17-01b77c0f1c7b admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:04.317832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a10b7-d947-4e8a-ba17-01b77c0f1c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:04.319850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a10b7-d947-4e8a-ba17-01b77c0f1c7b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:04.485302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 905/1770] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:04 2022] POST /identity/v3/users => generated 282 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:04.486092 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a10b7-d947-4e8a-ba17-01b77c0f1c7b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:04.492887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1f4a10b7-d947-4e8a-ba17-01b77c0f1c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:04.515134 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e0855-4e56-42e5-9a26-1ef3fb999a30 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:04.552648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef1a11-c828-432f-b5b5-702d1f1e7389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:04.553755 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef1a11-c828-432f-b5b5-702d1f1e7389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:04.554099 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef1a11-c828-432f-b5b5-702d1f1e7389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:04.554362 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef1a11-c828-432f-b5b5-702d1f1e7389 admin admin] PATH_INFO: `/v3/users/c66d0796ad24429a96613553f8caf645` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:04.557915 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef1a11-c828-432f-b5b5-702d1f1e7389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66d0796ad24429a96613553f8caf645)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:04.559594 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a10b7-d947-4e8a-ba17-01b77c0f1c7b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:04.566440 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef1a11-c828-432f-b5b5-702d1f1e7389 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:04.569549 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdaf4b4-8a24-451e-8974-c1c2ed01109c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:04.570241 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaf4b4-8a24-451e-8974-c1c2ed01109c admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:04.570689 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaf4b4-8a24-451e-8974-c1c2ed01109c admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:04.570968 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaf4b4-8a24-451e-8974-c1c2ed01109c admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:04.572561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdaf4b4-8a24-451e-8974-c1c2ed01109c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:04.575207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdaf4b4-8a24-451e-8974-c1c2ed01109c admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:04.599986 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 906/1771] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:04.599986 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdaf4b4-8a24-451e-8974-c1c2ed01109c admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:04.601920 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8fdaf4b4-8a24-451e-8974-c1c2ed01109c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:04.832864 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-32ef1a11-c828-432f-b5b5-702d1f1e7389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66d0796ad24429a96613553f8caf645'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:04.835171 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-32ef1a11-c828-432f-b5b5-702d1f1e7389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66d0796ad24429a96613553f8caf645'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:04.889285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdaf4b4-8a24-451e-8974-c1c2ed01109c admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:04.891372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-32ef1a11-c828-432f-b5b5-702d1f1e7389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66d0796ad24429a96613553f8caf645'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:04.905280 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-32ef1a11-c828-432f-b5b5-702d1f1e7389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66d0796ad24429a96613553f8caf645'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:04.929119 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc0556-3be5-48b4-8e4c-e2e9d2b2954c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:04.929796 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc0556-3be5-48b4-8e4c-e2e9d2b2954c service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:04.930083 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc0556-3be5-48b4-8e4c-e2e9d2b2954c service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:04.930352 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc0556-3be5-48b4-8e4c-e2e9d2b2954c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:04.939195 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-32ef1a11-c828-432f-b5b5-702d1f1e7389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66d0796ad24429a96613553f8caf645'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:04.947552 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-48bc0556-3be5-48b4-8e4c-e2e9d2b2954c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:04.979371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc0556-3be5-48b4-8e4c-e2e9d2b2954c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:04.980911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc0556-3be5-48b4-8e4c-e2e9d2b2954c service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:05.046179 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 866/1772] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:04 2022] DELETE /identity/v3/users/c66d0796ad24429a96613553f8caf645 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:52:05.048214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef1a11-c828-432f-b5b5-702d1f1e7389 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:05.053545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-32ef1a11-c828-432f-b5b5-702d1f1e7389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:05.064060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 907/1773] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:05.197308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef1a11-c828-432f-b5b5-702d1f1e7389 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:05.214076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e750547-b997-42cf-bd84-9e5f171a2eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:05.215101 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e750547-b997-42cf-bd84-9e5f171a2eeb admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:05.215793 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e750547-b997-42cf-bd84-9e5f171a2eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:05.216268 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e750547-b997-42cf-bd84-9e5f171a2eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:05.217450 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e750547-b997-42cf-bd84-9e5f171a2eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:05.219337 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e750547-b997-42cf-bd84-9e5f171a2eeb admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:05.260261 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 867/1774] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:05.264642 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc0556-3be5-48b4-8e4c-e2e9d2b2954c service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:05.302789 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc0556-3be5-48b4-8e4c-e2e9d2b2954c service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:05.321523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506f85a-0dc8-4249-b1d7-67dcef812a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:05.322523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506f85a-0dc8-4249-b1d7-67dcef812a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:05.322695 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506f85a-0dc8-4249-b1d7-67dcef812a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:05.323119 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506f85a-0dc8-4249-b1d7-67dcef812a75 admin admin] PATH_INFO: `/v3/projects/14a9d2b078e84edc9f1bcc5de2bb4a1c/users/2be4aea432f14d1498157b13091709cd/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:05.361435 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e750547-b997-42cf-bd84-9e5f171a2eeb admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:05.364504 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6e750547-b997-42cf-bd84-9e5f171a2eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:05.404008 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506f85a-0dc8-4249-b1d7-67dcef812a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a9d2b078e84edc9f1bcc5de2bb4a1c, user_id=2be4aea432f14d1498157b13091709cd, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:05.407876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506f85a-0dc8-4249-b1d7-67dcef812a75 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:05.428875 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e750547-b997-42cf-bd84-9e5f171a2eeb admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:05.479894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0a165-d2ba-40ec-9e1b-ce64101929b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:05.480787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0a165-d2ba-40ec-9e1b-ce64101929b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:05.486083 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0a165-d2ba-40ec-9e1b-ce64101929b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:05.486083 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0a165-d2ba-40ec-9e1b-ce64101929b8 admin admin] PATH_INFO: `/v3/projects/fc26ed1545ad4912a3d8baf032ad4cab` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:05.486083 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0a165-d2ba-40ec-9e1b-ce64101929b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc26ed1545ad4912a3d8baf032ad4cab)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:05.486083 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0a165-d2ba-40ec-9e1b-ce64101929b8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:05.527004 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 908/1775] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:05 2022] PUT /identity/v3/projects/14a9d2b078e84edc9f1bcc5de2bb4a1c/users/2be4aea432f14d1498157b13091709cd/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:05.529950 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195c9d6-a4c2-4325-bc0b-092c51efd1fb None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:05.530414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195c9d6-a4c2-4325-bc0b-092c51efd1fb None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:05.530695 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195c9d6-a4c2-4325-bc0b-092c51efd1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:05.600042 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-7195c9d6-a4c2-4325-bc0b-092c51efd1fb None None] MFA Rules not processed for user `2be4aea432f14d1498157b13091709cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:05.604248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7195c9d6-a4c2-4325-bc0b-092c51efd1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:05.762843 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 909/1776] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:05.763873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195c9d6-a4c2-4325-bc0b-092c51efd1fb None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:05.800301 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1ed0a165-d2ba-40ec-9e1b-ce64101929b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc26ed1545ad4912a3d8baf032ad4cab', 'request_id': 'req-1ed0a165-d2ba-40ec-9e1b-ce64101929b8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:05.914694 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195c9d6-a4c2-4325-bc0b-092c51efd1fb None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:05.941510 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1ed0a165-d2ba-40ec-9e1b-ce64101929b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc26ed1545ad4912a3d8baf032ad4cab', 'request_id': 'req-1ed0a165-d2ba-40ec-9e1b-ce64101929b8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:05.949092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1ed0a165-d2ba-40ec-9e1b-ce64101929b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc26ed1545ad4912a3d8baf032ad4cab', 'request_id': 'req-1ed0a165-d2ba-40ec-9e1b-ce64101929b8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:05.989731 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1ed0a165-d2ba-40ec-9e1b-ce64101929b8 admin admin] The token cache is being invalidate because project fc26ed1545ad4912a3d8baf032ad4cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:05.991296 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1ed0a165-d2ba-40ec-9e1b-ce64101929b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:05.995730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1ed0a165-d2ba-40ec-9e1b-ce64101929b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:06.000918 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 868/1777] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:05 2022] DELETE /identity/v3/projects/fc26ed1545ad4912a3d8baf032ad4cab => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:06.005359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0a165-d2ba-40ec-9e1b-ce64101929b8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:06.010226 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1ed0a165-d2ba-40ec-9e1b-ce64101929b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:06.117563 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a7022-9d3c-4c74-910e-25d27c698d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:06.118535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a7022-9d3c-4c74-910e-25d27c698d8b admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:06.119104 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a7022-9d3c-4c74-910e-25d27c698d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:06.119502 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a7022-9d3c-4c74-910e-25d27c698d8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:06.120486 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a7022-9d3c-4c74-910e-25d27c698d8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:06.122893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a7022-9d3c-4c74-910e-25d27c698d8b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:06.289192 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 910/1778] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:05 2022] POST /identity/v3/projects => generated 363 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:06.293323 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a7022-9d3c-4c74-910e-25d27c698d8b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:06.298330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-de0a7022-9d3c-4c74-910e-25d27c698d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:06.506376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0a165-d2ba-40ec-9e1b-ce64101929b8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:06.521674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a7022-9d3c-4c74-910e-25d27c698d8b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:06.522443 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece1e05-432b-4739-a380-1fd51d524c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:06.523455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece1e05-432b-4739-a380-1fd51d524c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:06.523765 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece1e05-432b-4739-a380-1fd51d524c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:06.524149 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece1e05-432b-4739-a380-1fd51d524c6a admin admin] PATH_INFO: `/v3/users/daeb1fafcfd6438b9de16ed1fa878575` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:06.525955 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece1e05-432b-4739-a380-1fd51d524c6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=daeb1fafcfd6438b9de16ed1fa878575)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:06.529056 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece1e05-432b-4739-a380-1fd51d524c6a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:06.530498 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939b70e-a380-41e0-9cf9-a34c2a602a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:06.537535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939b70e-a380-41e0-9cf9-a34c2a602a7e admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:06.537535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939b70e-a380-41e0-9cf9-a34c2a602a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:06.537535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939b70e-a380-41e0-9cf9-a34c2a602a7e admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:06.537535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939b70e-a380-41e0-9cf9-a34c2a602a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:06.566280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939b70e-a380-41e0-9cf9-a34c2a602a7e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:06.728937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 911/1779] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:06 2022] POST /identity/v3/users => generated 288 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:06.729780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939b70e-a380-41e0-9cf9-a34c2a602a7e admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:06.733688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2939b70e-a380-41e0-9cf9-a34c2a602a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:06.757362 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dece1e05-432b-4739-a380-1fd51d524c6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daeb1fafcfd6438b9de16ed1fa878575'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:06.758266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dece1e05-432b-4739-a380-1fd51d524c6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daeb1fafcfd6438b9de16ed1fa878575'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:06.775998 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dece1e05-432b-4739-a380-1fd51d524c6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daeb1fafcfd6438b9de16ed1fa878575'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:06.777480 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939b70e-a380-41e0-9cf9-a34c2a602a7e admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:06.788687 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14a93a-94f8-4c3d-b1e9-f0ef9b57928a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:06.791185 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14a93a-94f8-4c3d-b1e9-f0ef9b57928a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:06.793504 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dece1e05-432b-4739-a380-1fd51d524c6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daeb1fafcfd6438b9de16ed1fa878575'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:06.793726 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14a93a-94f8-4c3d-b1e9-f0ef9b57928a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:06.793726 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14a93a-94f8-4c3d-b1e9-f0ef9b57928a admin admin] PATH_INFO: `/v3/projects/7ec5859c81fb4b7c8b50dd44b4e25eea` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:06.795305 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14a93a-94f8-4c3d-b1e9-f0ef9b57928a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ec5859c81fb4b7c8b50dd44b4e25eea)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:06.797806 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14a93a-94f8-4c3d-b1e9-f0ef9b57928a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:06.825046 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dece1e05-432b-4739-a380-1fd51d524c6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daeb1fafcfd6438b9de16ed1fa878575'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:06.911123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 869/1780] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:06 2022] DELETE /identity/v3/users/daeb1fafcfd6438b9de16ed1fa878575 => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:06.912581 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece1e05-432b-4739-a380-1fd51d524c6a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:06.917839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-dece1e05-432b-4739-a380-1fd51d524c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:06.980144 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-6b14a93a-94f8-4c3d-b1e9-f0ef9b57928a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ec5859c81fb4b7c8b50dd44b4e25eea', 'request_id': 'req-6b14a93a-94f8-4c3d-b1e9-f0ef9b57928a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:07.078396 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-6b14a93a-94f8-4c3d-b1e9-f0ef9b57928a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ec5859c81fb4b7c8b50dd44b4e25eea', 'request_id': 'req-6b14a93a-94f8-4c3d-b1e9-f0ef9b57928a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:07.086172 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-6b14a93a-94f8-4c3d-b1e9-f0ef9b57928a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ec5859c81fb4b7c8b50dd44b4e25eea', 'request_id': 'req-6b14a93a-94f8-4c3d-b1e9-f0ef9b57928a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:07.117124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-6b14a93a-94f8-4c3d-b1e9-f0ef9b57928a admin admin] The token cache is being invalidate because project 7ec5859c81fb4b7c8b50dd44b4e25eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:07.117433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-6b14a93a-94f8-4c3d-b1e9-f0ef9b57928a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:07.118246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-6b14a93a-94f8-4c3d-b1e9-f0ef9b57928a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:07.120282 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 912/1781] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:06 2022] DELETE /identity/v3/projects/7ec5859c81fb4b7c8b50dd44b4e25eea => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:07.132469 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaedc45-868f-4613-a1db-d3b50207f84f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:07.132759 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaedc45-868f-4613-a1db-d3b50207f84f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:07.133040 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaedc45-868f-4613-a1db-d3b50207f84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:07.134811 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece1e05-432b-4739-a380-1fd51d524c6a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:07.169095 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-ddaedc45-868f-4613-a1db-d3b50207f84f None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:07.177663 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ddaedc45-868f-4613-a1db-d3b50207f84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:07.265531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9281c-0b54-4850-93b9-7ca2667fecd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:07.266793 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9281c-0b54-4850-93b9-7ca2667fecd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:07.267414 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9281c-0b54-4850-93b9-7ca2667fecd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:07.268979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9281c-0b54-4850-93b9-7ca2667fecd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:07.270151 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9281c-0b54-4850-93b9-7ca2667fecd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:07.273482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9281c-0b54-4850-93b9-7ca2667fecd3 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:07.291908 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 870/1782] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:07.296229 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9281c-0b54-4850-93b9-7ca2667fecd3 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:07.301714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e1c9281c-0b54-4850-93b9-7ca2667fecd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:07.333841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9281c-0b54-4850-93b9-7ca2667fecd3 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:07.338482 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 913/1783] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:07.345589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39e654-1443-4002-bb8d-8f28af29f638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:07.346922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6384bf-e188-455a-9c50-013b54834186 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:07.347220 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6384bf-e188-455a-9c50-013b54834186 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:07.347506 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6384bf-e188-455a-9c50-013b54834186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:07.355784 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39e654-1443-4002-bb8d-8f28af29f638 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:07.356376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39e654-1443-4002-bb8d-8f28af29f638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:07.356894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39e654-1443-4002-bb8d-8f28af29f638 admin admin] PATH_INFO: `/v3/projects/2f97f6fce87d4d80adef3fc207cbeeae/users/2bb4b07ad48142b2801557c303132027/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:07.392182 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4b6384bf-e188-455a-9c50-013b54834186 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:07.396655 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39e654-1443-4002-bb8d-8f28af29f638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f97f6fce87d4d80adef3fc207cbeeae, user_id=2bb4b07ad48142b2801557c303132027, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:07.401994 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39e654-1443-4002-bb8d-8f28af29f638 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:07.404446 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4b6384bf-e188-455a-9c50-013b54834186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:07.424455 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 914/1784] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:52:07.428524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6384bf-e188-455a-9c50-013b54834186 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:07.464629 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6384bf-e188-455a-9c50-013b54834186 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:07.473872 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 871/1785] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:07 2022] PUT /identity/v3/projects/2f97f6fce87d4d80adef3fc207cbeeae/users/2bb4b07ad48142b2801557c303132027/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:52:07.478323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39e654-1443-4002-bb8d-8f28af29f638 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:07.479195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfd3ab-e2a4-4120-86be-ce901dcd3035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:07.480048 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfd3ab-e2a4-4120-86be-ce901dcd3035 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:07.480434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfd3ab-e2a4-4120-86be-ce901dcd3035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:07.480814 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfd3ab-e2a4-4120-86be-ce901dcd3035 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:07.482502 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bfd3ab-e2a4-4120-86be-ce901dcd3035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:52:07.483133 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bfd3ab-e2a4-4120-86be-ce901dcd3035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:07.484896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bfd3ab-e2a4-4120-86be-ce901dcd3035 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:07.503002 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 915/1786] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:52:07.519973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfd3ab-e2a4-4120-86be-ce901dcd3035 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:07.554379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfd3ab-e2a4-4120-86be-ce901dcd3035 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:07.574790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39e654-1443-4002-bb8d-8f28af29f638 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:07.580259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf585a7-08df-48eb-a541-da5e07eed8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:07.580904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf585a7-08df-48eb-a541-da5e07eed8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:07.581184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf585a7-08df-48eb-a541-da5e07eed8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:07.581506 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf585a7-08df-48eb-a541-da5e07eed8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:07.582521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf585a7-08df-48eb-a541-da5e07eed8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:07.583940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf585a7-08df-48eb-a541-da5e07eed8d7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:07.595386 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 872/1787] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:07.599405 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf585a7-08df-48eb-a541-da5e07eed8d7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:07.611930 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf585a7-08df-48eb-a541-da5e07eed8d7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:07.637829 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98507370-096c-4f4e-b194-c45756383d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:07.638799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98507370-096c-4f4e-b194-c45756383d4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:07.639082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98507370-096c-4f4e-b194-c45756383d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:07.639401 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98507370-096c-4f4e-b194-c45756383d4a admin admin] PATH_INFO: `/v3/projects/2f97f6fce87d4d80adef3fc207cbeeae/users/2bb4b07ad48142b2801557c303132027/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:07.655676 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98507370-096c-4f4e-b194-c45756383d4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f97f6fce87d4d80adef3fc207cbeeae, user_id=2bb4b07ad48142b2801557c303132027, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:07.661770 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98507370-096c-4f4e-b194-c45756383d4a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:07.708087 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 873/1788] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:07 2022] PUT /identity/v3/projects/2f97f6fce87d4d80adef3fc207cbeeae/users/2bb4b07ad48142b2801557c303132027/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:07.719889 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f3d25-03da-4825-98e5-fe918af14175 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:07.720400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f3d25-03da-4825-98e5-fe918af14175 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:07.720849 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f3d25-03da-4825-98e5-fe918af14175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:07.750370 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d654ecc-15c5-4d55-b212-3ab750aef0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:07.753099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d654ecc-15c5-4d55-b212-3ab750aef0fc admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:07.754367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d654ecc-15c5-4d55-b212-3ab750aef0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:07.755670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d654ecc-15c5-4d55-b212-3ab750aef0fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:07.758330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d654ecc-15c5-4d55-b212-3ab750aef0fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:07.766394 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d654ecc-15c5-4d55-b212-3ab750aef0fc admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:07.770355 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6b0f3d25-03da-4825-98e5-fe918af14175 None None] MFA Rules not processed for user `2bb4b07ad48142b2801557c303132027`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:07.772627 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6b0f3d25-03da-4825-98e5-fe918af14175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:07.918828 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 916/1789] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:07 2022] POST /identity/v3/projects => generated 385 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:07.919051 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 874/1790] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:07 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:07.922796 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d654ecc-15c5-4d55-b212-3ab750aef0fc admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:07.932369 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f3d25-03da-4825-98e5-fe918af14175 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:07.934737 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6b0f3d25-03da-4825-98e5-fe918af14175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:08.056376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f3d25-03da-4825-98e5-fe918af14175 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:08.076762 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d654ecc-15c5-4d55-b212-3ab750aef0fc admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:08.082635 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d13ebd-b705-4bac-81c4-cdc4df95154b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:08.083484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d13ebd-b705-4bac-81c4-cdc4df95154b admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:08.083930 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d13ebd-b705-4bac-81c4-cdc4df95154b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:08.084283 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d13ebd-b705-4bac-81c4-cdc4df95154b admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:08.085512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d13ebd-b705-4bac-81c4-cdc4df95154b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:08.087869 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d13ebd-b705-4bac-81c4-cdc4df95154b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:08.147120 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7450b65-1965-4793-8e05-47631e473a39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:08.147120 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7450b65-1965-4793-8e05-47631e473a39 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:08.147120 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7450b65-1965-4793-8e05-47631e473a39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:08.147120 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7450b65-1965-4793-8e05-47631e473a39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:08.204265 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 917/1791] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:07 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:08.206107 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d13ebd-b705-4bac-81c4-cdc4df95154b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:08.240353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d13ebd-b705-4bac-81c4-cdc4df95154b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:08.252576 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09543b-bca7-4090-89de-d826eadd2bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:08.254186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09543b-bca7-4090-89de-d826eadd2bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:08.254770 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09543b-bca7-4090-89de-d826eadd2bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:08.255197 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09543b-bca7-4090-89de-d826eadd2bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:08.256608 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09543b-bca7-4090-89de-d826eadd2bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:08.260648 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09543b-bca7-4090-89de-d826eadd2bf4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:08.289308 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 918/1792] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:08.295898 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09543b-bca7-4090-89de-d826eadd2bf4 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:08.300776 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7450b65-1965-4793-8e05-47631e473a39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:08.303087 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7450b65-1965-4793-8e05-47631e473a39 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:08.334884 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09543b-bca7-4090-89de-d826eadd2bf4 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:08.353257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 875/1793] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:07 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:08.360896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b81c2c-3f00-45ff-a362-7858f8e01500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:08.361818 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b81c2c-3f00-45ff-a362-7858f8e01500 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:08.362225 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b81c2c-3f00-45ff-a362-7858f8e01500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:08.364215 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b81c2c-3f00-45ff-a362-7858f8e01500 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:08.364717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b81c2c-3f00-45ff-a362-7858f8e01500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:08.368900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b81c2c-3f00-45ff-a362-7858f8e01500 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:08.393120 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 919/1794] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:08.397563 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7450b65-1965-4793-8e05-47631e473a39 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:08.409979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7450b65-1965-4793-8e05-47631e473a39 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:08.415361 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e21ad2-1309-4923-9ce4-0dcdec777f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:08.416294 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e21ad2-1309-4923-9ce4-0dcdec777f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:08.416568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e21ad2-1309-4923-9ce4-0dcdec777f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:08.416844 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e21ad2-1309-4923-9ce4-0dcdec777f58 admin admin] PATH_INFO: `/v3/projects/8891387f13f94b9584c7d88afc3a1066/users/8801ff6aa38a4ba8a49831eb624b26eb/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:08.438915 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e21ad2-1309-4923-9ce4-0dcdec777f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8891387f13f94b9584c7d88afc3a1066, user_id=8801ff6aa38a4ba8a49831eb624b26eb, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:08.442692 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e21ad2-1309-4923-9ce4-0dcdec777f58 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:08.484647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b81c2c-3f00-45ff-a362-7858f8e01500 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:08.487174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-56b81c2c-3f00-45ff-a362-7858f8e01500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:08.537260 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b81c2c-3f00-45ff-a362-7858f8e01500 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:08.546117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6947d6-f82a-4c45-9975-97cb65bc4d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:08.547424 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6947d6-f82a-4c45-9975-97cb65bc4d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:08.548024 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6947d6-f82a-4c45-9975-97cb65bc4d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:08.548494 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6947d6-f82a-4c45-9975-97cb65bc4d13 admin admin] PATH_INFO: `/v3/projects/55aac0f1d37344aba2616dfd47196687` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:08.550649 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6947d6-f82a-4c45-9975-97cb65bc4d13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55aac0f1d37344aba2616dfd47196687)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:08.556740 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6947d6-f82a-4c45-9975-97cb65bc4d13 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:08.569911 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 876/1795] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:08 2022] PUT /identity/v3/projects/8891387f13f94b9584c7d88afc3a1066/users/8801ff6aa38a4ba8a49831eb624b26eb/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:08.580823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afcab2-f8ab-4f3b-8e02-8a26801533c8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:08.581462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afcab2-f8ab-4f3b-8e02-8a26801533c8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:08.581462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afcab2-f8ab-4f3b-8e02-8a26801533c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:08.637413 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-04afcab2-f8ab-4f3b-8e02-8a26801533c8 None None] MFA Rules not processed for user `8801ff6aa38a4ba8a49831eb624b26eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:08.650938 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-04afcab2-f8ab-4f3b-8e02-8a26801533c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:08.738582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8b6947d6-f82a-4c45-9975-97cb65bc4d13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55aac0f1d37344aba2616dfd47196687', 'request_id': 'req-8b6947d6-f82a-4c45-9975-97cb65bc4d13'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:08.788786 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 877/1796] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:08.791471 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3172c-2cb7-4442-96e5-e41b7102189a None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:08.792458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3172c-2cb7-4442-96e5-e41b7102189a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:08.793708 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3172c-2cb7-4442-96e5-e41b7102189a None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:08.801189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 878/1797] 10.222.0.25 () {54 vars in 921 bytes} [Thu May 12 06:52:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:52:08.801189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3172c-2cb7-4442-96e5-e41b7102189a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:08.820832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8b6947d6-f82a-4c45-9975-97cb65bc4d13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55aac0f1d37344aba2616dfd47196687', 'request_id': 'req-8b6947d6-f82a-4c45-9975-97cb65bc4d13'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:08.833857 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8b6947d6-f82a-4c45-9975-97cb65bc4d13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55aac0f1d37344aba2616dfd47196687', 'request_id': 'req-8b6947d6-f82a-4c45-9975-97cb65bc4d13'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:08.874126 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8b6947d6-f82a-4c45-9975-97cb65bc4d13 admin admin] The token cache is being invalidate because project 55aac0f1d37344aba2616dfd47196687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:08.876032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8b6947d6-f82a-4c45-9975-97cb65bc4d13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:08.877495 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8b6947d6-f82a-4c45-9975-97cb65bc4d13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:08.892128 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 920/1798] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:08 2022] DELETE /identity/v3/projects/55aac0f1d37344aba2616dfd47196687 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:52:08.894373 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6947d6-f82a-4c45-9975-97cb65bc4d13 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:08.900412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8b6947d6-f82a-4c45-9975-97cb65bc4d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:09.046125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3172c-2cb7-4442-96e5-e41b7102189a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:09.052200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b542919-d6b1-4428-afa0-f6ccab5c6f90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:09.053193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b542919-d6b1-4428-afa0-f6ccab5c6f90 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:09.053632 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b542919-d6b1-4428-afa0-f6ccab5c6f90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:09.053968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b542919-d6b1-4428-afa0-f6ccab5c6f90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:09.058629 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7b542919-d6b1-4428-afa0-f6ccab5c6f90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:09.163855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6947d6-f82a-4c45-9975-97cb65bc4d13 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:09.207053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c348a-0336-4612-a8e1-2ce8775ee39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:09.207053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c348a-0336-4612-a8e1-2ce8775ee39a admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:09.207053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c348a-0336-4612-a8e1-2ce8775ee39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:09.207053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c348a-0336-4612-a8e1-2ce8775ee39a admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:09.207618 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c348a-0336-4612-a8e1-2ce8775ee39a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:09.207618 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c348a-0336-4612-a8e1-2ce8775ee39a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:09.225460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b542919-d6b1-4428-afa0-f6ccab5c6f90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:09.227648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b542919-d6b1-4428-afa0-f6ccab5c6f90 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:09.262721 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 879/1799] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:08 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:09.268396 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60db24-8c0d-4726-8421-c816e90e30e9 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:09.268396 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60db24-8c0d-4726-8421-c816e90e30e9 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:09.268396 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60db24-8c0d-4726-8421-c816e90e30e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:09.293184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2a60db24-8c0d-4726-8421-c816e90e30e9 None None] MFA Rules not processed for user `bbcd54a927bf46f183b50fbda677868d`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:09.298823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2a60db24-8c0d-4726-8421-c816e90e30e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:09.441862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 880/1800] 10.222.0.25 () {58 vars in 1018 bytes} [Thu May 12 06:52:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:09.443604 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fcd21-0071-4683-a324-0ff89e2170ed None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:09.444258 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fcd21-0071-4683-a324-0ff89e2170ed None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:09.444664 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fcd21-0071-4683-a324-0ff89e2170ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:09.497234 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4d5fcd21-0071-4683-a324-0ff89e2170ed None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:09.498545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4d5fcd21-0071-4683-a324-0ff89e2170ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:09.543301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 921/1801] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:08 2022] POST /identity/v3/projects => generated 385 bytes in 651 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:09.552067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c348a-0336-4612-a8e1-2ce8775ee39a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:09.557462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 881/1802] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:09.558032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b18c348a-0336-4612-a8e1-2ce8775ee39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:09.559192 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fcd21-0071-4683-a324-0ff89e2170ed None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:09.588895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fcd21-0071-4683-a324-0ff89e2170ed None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:09.755016 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c348a-0336-4612-a8e1-2ce8775ee39a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:09.765576 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b99bd-e7d7-4486-8e8c-950f58b70aee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:09.766408 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b99bd-e7d7-4486-8e8c-950f58b70aee service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:09.766699 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b99bd-e7d7-4486-8e8c-950f58b70aee service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:09.766977 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b99bd-e7d7-4486-8e8c-950f58b70aee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:09.792423 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c860a69-50a8-4f36-a849-f06660823477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:09.794972 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c860a69-50a8-4f36-a849-f06660823477 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:09.796265 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c860a69-50a8-4f36-a849-f06660823477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:09.796641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c860a69-50a8-4f36-a849-f06660823477 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:09.804676 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b99bd-e7d7-4486-8e8c-950f58b70aee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:09.805473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c860a69-50a8-4f36-a849-f06660823477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:09.807662 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c860a69-50a8-4f36-a849-f06660823477 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:09.809065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b99bd-e7d7-4486-8e8c-950f58b70aee service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:09.841604 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 922/1803] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:09.846106 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c196d2-3238-48f5-ad13-84fa02a85602 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:09.846639 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c196d2-3238-48f5-ad13-84fa02a85602 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:09.847074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c196d2-3238-48f5-ad13-84fa02a85602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:09.876503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-c7c196d2-3238-48f5-ad13-84fa02a85602 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:09.877850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c7c196d2-3238-48f5-ad13-84fa02a85602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:09.887978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 923/1804] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:09.892578 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c196d2-3238-48f5-ad13-84fa02a85602 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:09.916683 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c196d2-3238-48f5-ad13-84fa02a85602 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:09.916683 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a11dc-2575-42a0-aa4a-e09533920eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:09.917928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a11dc-2575-42a0-aa4a-e09533920eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:09.918217 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a11dc-2575-42a0-aa4a-e09533920eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:09.918981 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a11dc-2575-42a0-aa4a-e09533920eb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:09.920142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a11dc-2575-42a0-aa4a-e09533920eb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:52:09.920431 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a11dc-2575-42a0-aa4a-e09533920eb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:09.922778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a11dc-2575-42a0-aa4a-e09533920eb6 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:09.945041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 924/1805] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:52:09.950525 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a11dc-2575-42a0-aa4a-e09533920eb6 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:09.976145 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a11dc-2575-42a0-aa4a-e09533920eb6 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:09.984265 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bead5-311f-4fe4-98c6-d5c5cee70e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:09.985608 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bead5-311f-4fe4-98c6-d5c5cee70e30 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:09.986301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bead5-311f-4fe4-98c6-d5c5cee70e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:09.994100 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bead5-311f-4fe4-98c6-d5c5cee70e30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:09.994895 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bead5-311f-4fe4-98c6-d5c5cee70e30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:10.001122 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bead5-311f-4fe4-98c6-d5c5cee70e30 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:10.002583 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 882/1806] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:09 2022] POST /identity/v3/users => generated 293 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:10.006648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c860a69-50a8-4f36-a849-f06660823477 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:10.035123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c860a69-50a8-4f36-a849-f06660823477 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:10.047806 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702a060-ef36-4c39-af58-1bb6b120e6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:10.048634 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702a060-ef36-4c39-af58-1bb6b120e6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:10.049065 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702a060-ef36-4c39-af58-1bb6b120e6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:10.049391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702a060-ef36-4c39-af58-1bb6b120e6f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:10.050204 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702a060-ef36-4c39-af58-1bb6b120e6f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:10.052180 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702a060-ef36-4c39-af58-1bb6b120e6f2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:10.072089 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 883/1807] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:10.073189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702a060-ef36-4c39-af58-1bb6b120e6f2 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:10.085868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702a060-ef36-4c39-af58-1bb6b120e6f2 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:10.092262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ced140-8c6f-4842-be29-0067c55fda7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:10.093034 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ced140-8c6f-4842-be29-0067c55fda7a admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:10.093384 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ced140-8c6f-4842-be29-0067c55fda7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:10.093726 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ced140-8c6f-4842-be29-0067c55fda7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:10.094538 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ced140-8c6f-4842-be29-0067c55fda7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:10.096390 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ced140-8c6f-4842-be29-0067c55fda7a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:10.116990 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 925/1808] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:09 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:52:10.121739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bead5-311f-4fe4-98c6-d5c5cee70e30 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:10.139395 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 884/1809] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:10.158634 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ced140-8c6f-4842-be29-0067c55fda7a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:10.176378 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ced140-8c6f-4842-be29-0067c55fda7a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:10.246351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bead5-311f-4fe4-98c6-d5c5cee70e30 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:10.263721 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b5d0d-48da-4726-b7d9-3e63e9fbf727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:10.264655 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b5d0d-48da-4726-b7d9-3e63e9fbf727 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:10.265566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b5d0d-48da-4726-b7d9-3e63e9fbf727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:10.265962 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b5d0d-48da-4726-b7d9-3e63e9fbf727 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:10.266718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b5d0d-48da-4726-b7d9-3e63e9fbf727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:10.269814 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af86d1-bfd3-4248-99c6-51aece2441fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:10.270868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af86d1-bfd3-4248-99c6-51aece2441fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:10.271221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af86d1-bfd3-4248-99c6-51aece2441fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:10.271578 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af86d1-bfd3-4248-99c6-51aece2441fb admin admin] PATH_INFO: `/v3/projects/344e33fcdf404b5286f9ad7a819382c8/users/55b55323e74b4f92867eaac5db08286b/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:10.273894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b5d0d-48da-4726-b7d9-3e63e9fbf727 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:10.296169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af86d1-bfd3-4248-99c6-51aece2441fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=344e33fcdf404b5286f9ad7a819382c8, user_id=55b55323e74b4f92867eaac5db08286b, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:10.300670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af86d1-bfd3-4248-99c6-51aece2441fb admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:10.365103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 926/1810] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:10 2022] POST /identity/v3/users => generated 287 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:10.369275 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b5d0d-48da-4726-b7d9-3e63e9fbf727 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:10.385746 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b5d0d-48da-4726-b7d9-3e63e9fbf727 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:10.390293 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 885/1811] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:10 2022] PUT /identity/v3/projects/344e33fcdf404b5286f9ad7a819382c8/users/55b55323e74b4f92867eaac5db08286b/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:10.401468 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8662187-c587-4380-a7cb-a688edbafaaf None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:10.401937 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8662187-c587-4380-a7cb-a688edbafaaf None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:10.402442 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8662187-c587-4380-a7cb-a688edbafaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:10.433137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a8662187-c587-4380-a7cb-a688edbafaaf None None] MFA Rules not processed for user `55b55323e74b4f92867eaac5db08286b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:10.438339 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a8662187-c587-4380-a7cb-a688edbafaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:10.459954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f604b66-0c40-4911-8b27-1187c610b620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:10.463328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f604b66-0c40-4911-8b27-1187c610b620 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:10.463328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f604b66-0c40-4911-8b27-1187c610b620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:10.463328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f604b66-0c40-4911-8b27-1187c610b620 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:10.463328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f604b66-0c40-4911-8b27-1187c610b620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:10.464996 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f604b66-0c40-4911-8b27-1187c610b620 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:10.476023 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 927/1812] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 06:52:10.481211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f604b66-0c40-4911-8b27-1187c610b620 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:10.493312 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f604b66-0c40-4911-8b27-1187c610b620 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:10.502932 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de89d6-155d-404f-bb5f-98899c38888a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:10.503675 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de89d6-155d-404f-bb5f-98899c38888a admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:10.504005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de89d6-155d-404f-bb5f-98899c38888a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:10.504282 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de89d6-155d-404f-bb5f-98899c38888a admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:10.505055 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de89d6-155d-404f-bb5f-98899c38888a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:10.507467 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de89d6-155d-404f-bb5f-98899c38888a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:10.525336 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 928/1813] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:10.527946 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de89d6-155d-404f-bb5f-98899c38888a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:10.542616 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de89d6-155d-404f-bb5f-98899c38888a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:10.548415 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e061c6-c920-4230-9a83-50a9bc992e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:10.550080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e061c6-c920-4230-9a83-50a9bc992e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:10.550575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e061c6-c920-4230-9a83-50a9bc992e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:10.551001 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e061c6-c920-4230-9a83-50a9bc992e9b admin admin] PATH_INFO: `/v3/projects/eb0362d10b534f088d049f6c3d565bd4/users/9b2e437b7392426287f1b770ffa7d18a/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:10.553801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 886/1814] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:52:10.557917 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8662187-c587-4380-a7cb-a688edbafaaf None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:10.573565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e061c6-c920-4230-9a83-50a9bc992e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb0362d10b534f088d049f6c3d565bd4, user_id=9b2e437b7392426287f1b770ffa7d18a, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:10.577403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e061c6-c920-4230-9a83-50a9bc992e9b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:10.584079 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8662187-c587-4380-a7cb-a688edbafaaf None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:10.593160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9637f48-71bb-4caa-916b-2cbc8b1dfa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:10.598938 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9637f48-71bb-4caa-916b-2cbc8b1dfa33 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:10.598938 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9637f48-71bb-4caa-916b-2cbc8b1dfa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:10.598938 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9637f48-71bb-4caa-916b-2cbc8b1dfa33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:10.598938 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9637f48-71bb-4caa-916b-2cbc8b1dfa33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:10.598938 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9637f48-71bb-4caa-916b-2cbc8b1dfa33 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:10.636822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 929/1815] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:10 2022] PUT /identity/v3/projects/eb0362d10b534f088d049f6c3d565bd4/users/9b2e437b7392426287f1b770ffa7d18a/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:10.641912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31af99-491a-4537-a17d-191995ae4e66 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:10.642201 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31af99-491a-4537-a17d-191995ae4e66 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:10.642476 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31af99-491a-4537-a17d-191995ae4e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:10.702219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 887/1816] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:10 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:52:10.703850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-ff31af99-491a-4537-a17d-191995ae4e66 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:10.706384 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9637f48-71bb-4caa-916b-2cbc8b1dfa33 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:10.708162 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ff31af99-491a-4537-a17d-191995ae4e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:10.827917 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 930/1817] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:10.839974 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31af99-491a-4537-a17d-191995ae4e66 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:10.844713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ff31af99-491a-4537-a17d-191995ae4e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:10.870205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9637f48-71bb-4caa-916b-2cbc8b1dfa33 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:10.879580 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544e616-a9b0-4ac7-80d2-e288a711956e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:10.880703 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544e616-a9b0-4ac7-80d2-e288a711956e admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:10.882706 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544e616-a9b0-4ac7-80d2-e288a711956e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:10.883338 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544e616-a9b0-4ac7-80d2-e288a711956e admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:10.884413 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544e616-a9b0-4ac7-80d2-e288a711956e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:10.887778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544e616-a9b0-4ac7-80d2-e288a711956e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:11.010760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 888/1818] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:10 2022] POST /identity/v3/users => generated 300 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:11.011772 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544e616-a9b0-4ac7-80d2-e288a711956e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:11.023411 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544e616-a9b0-4ac7-80d2-e288a711956e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:11.030362 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b81a86-5f1e-4a7a-bdb1-90c05b054320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:11.031030 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b81a86-5f1e-4a7a-bdb1-90c05b054320 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:11.031920 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b81a86-5f1e-4a7a-bdb1-90c05b054320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:11.038669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b81a86-5f1e-4a7a-bdb1-90c05b054320 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:11.038669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b81a86-5f1e-4a7a-bdb1-90c05b054320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:11.038669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b81a86-5f1e-4a7a-bdb1-90c05b054320 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:11.045375 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31af99-491a-4537-a17d-191995ae4e66 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:11.059755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e6b2c-4761-469e-ba4e-d1972f42684e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:11.059755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e6b2c-4761-469e-ba4e-d1972f42684e service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:11.059755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e6b2c-4761-469e-ba4e-d1972f42684e service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:11.059755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e6b2c-4761-469e-ba4e-d1972f42684e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:11.061800 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 889/1819] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:11.064817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b81a86-5f1e-4a7a-bdb1-90c05b054320 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:11.077716 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b81a86-5f1e-4a7a-bdb1-90c05b054320 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:11.085596 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e6b2c-4761-469e-ba4e-d1972f42684e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:11.088319 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e6b2c-4761-469e-ba4e-d1972f42684e service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:11.095757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0456a5-7389-4f21-be18-675860302fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:11.100690 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0456a5-7389-4f21-be18-675860302fea admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:11.100690 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0456a5-7389-4f21-be18-675860302fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:11.100690 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0456a5-7389-4f21-be18-675860302fea admin admin] PATH_INFO: `/v3/projects/23b61d55fdf54282973e6191033d82b2/users/a9bf9efd0cdf421a8438832b1bf4a8a0/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:11.101756 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 931/1820] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 06:52:11.115661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0456a5-7389-4f21-be18-675860302fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b61d55fdf54282973e6191033d82b2, user_id=a9bf9efd0cdf421a8438832b1bf4a8a0, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:11.119460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0456a5-7389-4f21-be18-675860302fea admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:11.267893 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 890/1821] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:11 2022] PUT /identity/v3/projects/23b61d55fdf54282973e6191033d82b2/users/a9bf9efd0cdf421a8438832b1bf4a8a0/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:11.271802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e6b2c-4761-469e-ba4e-d1972f42684e service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:11.281908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e6b2c-4761-469e-ba4e-d1972f42684e service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:11.359314 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de735a0-0443-45d2-849b-e5c7314ee053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:11.361167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de735a0-0443-45d2-849b-e5c7314ee053 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:11.361598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de735a0-0443-45d2-849b-e5c7314ee053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:11.362035 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de735a0-0443-45d2-849b-e5c7314ee053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:11.363541 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de735a0-0443-45d2-849b-e5c7314ee053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:11.365880 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de735a0-0443-45d2-849b-e5c7314ee053 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:11.383713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 932/1822] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:11.385138 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0456a5-7389-4f21-be18-675860302fea admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:11.396142 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0456a5-7389-4f21-be18-675860302fea admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:11.401908 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120a41c-0378-4795-af3c-e330619f390b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:11.402909 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120a41c-0378-4795-af3c-e330619f390b admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:11.403281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120a41c-0378-4795-af3c-e330619f390b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:11.403649 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120a41c-0378-4795-af3c-e330619f390b admin admin] PATH_INFO: `/v3/projects/23b61d55fdf54282973e6191033d82b2/users/a9bf9efd0cdf421a8438832b1bf4a8a0/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:11.405957 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120a41c-0378-4795-af3c-e330619f390b admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b61d55fdf54282973e6191033d82b2, user_id=a9bf9efd0cdf421a8438832b1bf4a8a0, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:11.408888 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120a41c-0378-4795-af3c-e330619f390b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:11.422464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 891/1823] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:11 2022] PUT /identity/v3/projects/23b61d55fdf54282973e6191033d82b2/users/a9bf9efd0cdf421a8438832b1bf4a8a0/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:11.437763 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d9278-11c8-4c47-ae35-9a88895036d7 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:11.438341 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d9278-11c8-4c47-ae35-9a88895036d7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:11.438835 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d9278-11c8-4c47-ae35-9a88895036d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:11.502693 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6e6d9278-11c8-4c47-ae35-9a88895036d7 None None] MFA Rules not processed for user `a9bf9efd0cdf421a8438832b1bf4a8a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:11.504298 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6e6d9278-11c8-4c47-ae35-9a88895036d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:11.604429 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 933/1824] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:11.613296 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120a41c-0378-4795-af3c-e330619f390b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:11.617139 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2120a41c-0378-4795-af3c-e330619f390b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:11.704946 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120a41c-0378-4795-af3c-e330619f390b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:11.716617 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfdfec-8673-44fe-94c1-70b17e2a52f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:11.719563 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfdfec-8673-44fe-94c1-70b17e2a52f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:11.720015 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfdfec-8673-44fe-94c1-70b17e2a52f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:11.723515 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfdfec-8673-44fe-94c1-70b17e2a52f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:11.731940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfdfec-8673-44fe-94c1-70b17e2a52f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:11.733566 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfdfec-8673-44fe-94c1-70b17e2a52f6 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:11.747267 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 892/1825] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:13.306340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d9278-11c8-4c47-ae35-9a88895036d7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:13.317655 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d9278-11c8-4c47-ae35-9a88895036d7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:13.321771 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cb054-9811-421e-a66a-0aa04d57cf75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:13.322516 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cb054-9811-421e-a66a-0aa04d57cf75 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:13.322874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cb054-9811-421e-a66a-0aa04d57cf75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:13.323221 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cb054-9811-421e-a66a-0aa04d57cf75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:13.325256 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fb9cb054-9811-421e-a66a-0aa04d57cf75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:13.404235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9cb054-9811-421e-a66a-0aa04d57cf75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:13.405904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9cb054-9811-421e-a66a-0aa04d57cf75 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:13.416618 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 934/1826] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:14.514875 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5086cb-7deb-430a-b1f1-311ced305258 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:14.515412 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5086cb-7deb-430a-b1f1-311ced305258 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:14.515412 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5086cb-7deb-430a-b1f1-311ced305258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:14.554171 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-af5086cb-7deb-430a-b1f1-311ced305258 None None] MFA Rules not processed for user `9b2e437b7392426287f1b770ffa7d18a`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:14.556057 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-af5086cb-7deb-430a-b1f1-311ced305258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:14.636740 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 893/1827] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:14.667118 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cb054-9811-421e-a66a-0aa04d57cf75 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:14.744898 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cb054-9811-421e-a66a-0aa04d57cf75 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:14.750109 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c93f1-b18a-4abc-af36-b3b8b10baed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:14.750947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c93f1-b18a-4abc-af36-b3b8b10baed7 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:14.751322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c93f1-b18a-4abc-af36-b3b8b10baed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:14.751696 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c93f1-b18a-4abc-af36-b3b8b10baed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:14.752598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c93f1-b18a-4abc-af36-b3b8b10baed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:14.754798 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c93f1-b18a-4abc-af36-b3b8b10baed7 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:15.575522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 935/1828] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:14 2022] POST /identity/v3/projects => generated 373 bytes in 909 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:15.580552 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5086cb-7deb-430a-b1f1-311ced305258 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:15.593170 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5086cb-7deb-430a-b1f1-311ced305258 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:15.669335 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64b2f7-baf5-404e-8f48-84fd464fc087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:15.670010 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64b2f7-baf5-404e-8f48-84fd464fc087 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:15.670204 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64b2f7-baf5-404e-8f48-84fd464fc087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:15.670481 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64b2f7-baf5-404e-8f48-84fd464fc087 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:15.671539 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64b2f7-baf5-404e-8f48-84fd464fc087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:15.673868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64b2f7-baf5-404e-8f48-84fd464fc087 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:15.773645 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 894/1829] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:15 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:15.775224 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c93f1-b18a-4abc-af36-b3b8b10baed7 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:15.786560 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c93f1-b18a-4abc-af36-b3b8b10baed7 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:15.792265 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e690e-f8cb-40cc-8670-b3e7202d1f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:15.792931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e690e-f8cb-40cc-8670-b3e7202d1f28 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:15.793213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e690e-f8cb-40cc-8670-b3e7202d1f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:15.793581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e690e-f8cb-40cc-8670-b3e7202d1f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:15.794329 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e690e-f8cb-40cc-8670-b3e7202d1f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:15.796124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e690e-f8cb-40cc-8670-b3e7202d1f28 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:15.807337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 936/1830] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:15.811672 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64b2f7-baf5-404e-8f48-84fd464fc087 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:15.821441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64b2f7-baf5-404e-8f48-84fd464fc087 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:15.826514 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db1130-012d-4445-a0d3-2bde6381fad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:15.827473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db1130-012d-4445-a0d3-2bde6381fad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:15.827792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db1130-012d-4445-a0d3-2bde6381fad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:15.828076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db1130-012d-4445-a0d3-2bde6381fad1 admin admin] PATH_INFO: `/v3/projects/fa62a87560b14713af9d2111be51035f/users/e53f49d49e9d46abbac5f5c4b2b035d2/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:15.843385 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db1130-012d-4445-a0d3-2bde6381fad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa62a87560b14713af9d2111be51035f, user_id=e53f49d49e9d46abbac5f5c4b2b035d2, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:15.846168 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db1130-012d-4445-a0d3-2bde6381fad1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:15.946241 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 895/1831] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:15 2022] PUT /identity/v3/projects/fa62a87560b14713af9d2111be51035f/users/e53f49d49e9d46abbac5f5c4b2b035d2/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:15.950288 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e690e-f8cb-40cc-8670-b3e7202d1f28 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:15.960103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e690e-f8cb-40cc-8670-b3e7202d1f28 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:16.019990 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ec761-28fe-4da2-a31b-47807eb6567e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:16.020718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ec761-28fe-4da2-a31b-47807eb6567e admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:16.021006 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ec761-28fe-4da2-a31b-47807eb6567e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:16.021283 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ec761-28fe-4da2-a31b-47807eb6567e admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:16.022011 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ec761-28fe-4da2-a31b-47807eb6567e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:16.023597 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ec761-28fe-4da2-a31b-47807eb6567e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:16.033245 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 937/1832] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:16.037378 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db1130-012d-4445-a0d3-2bde6381fad1 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:16.048100 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db1130-012d-4445-a0d3-2bde6381fad1 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:16.052554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b11e1-3b36-4e8c-8219-1e8d17b307d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:16.053483 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b11e1-3b36-4e8c-8219-1e8d17b307d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:16.053756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b11e1-3b36-4e8c-8219-1e8d17b307d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:16.054025 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b11e1-3b36-4e8c-8219-1e8d17b307d1 admin admin] PATH_INFO: `/v3/projects/fa62a87560b14713af9d2111be51035f/users/e53f49d49e9d46abbac5f5c4b2b035d2/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:16.056571 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b11e1-3b36-4e8c-8219-1e8d17b307d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa62a87560b14713af9d2111be51035f, user_id=e53f49d49e9d46abbac5f5c4b2b035d2, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:16.059217 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b11e1-3b36-4e8c-8219-1e8d17b307d1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:16.070154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 896/1833] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:16 2022] PUT /identity/v3/projects/fa62a87560b14713af9d2111be51035f/users/e53f49d49e9d46abbac5f5c4b2b035d2/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:17.325063 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c42392-88de-4f61-9d5f-6493471067fc None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:17.325554 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c42392-88de-4f61-9d5f-6493471067fc None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:17.325684 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c42392-88de-4f61-9d5f-6493471067fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:17.353052 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-79c42392-88de-4f61-9d5f-6493471067fc None None] MFA Rules not processed for user `e53f49d49e9d46abbac5f5c4b2b035d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:17.354253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-79c42392-88de-4f61-9d5f-6493471067fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:17.436046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 938/1834] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:17.448047 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b11e1-3b36-4e8c-8219-1e8d17b307d1 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:17.449814 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c35b11e1-3b36-4e8c-8219-1e8d17b307d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:17.504789 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b11e1-3b36-4e8c-8219-1e8d17b307d1 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:17.508975 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa729a-b97a-496e-80b1-0fda40add2fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:17.509612 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa729a-b97a-496e-80b1-0fda40add2fa service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:17.509895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa729a-b97a-496e-80b1-0fda40add2fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:17.510169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa729a-b97a-496e-80b1-0fda40add2fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:17.563528 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa729a-b97a-496e-80b1-0fda40add2fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:17.564996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa729a-b97a-496e-80b1-0fda40add2fa service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:17.574165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 897/1835] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:23.519921 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c42392-88de-4f61-9d5f-6493471067fc None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:23.529072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c42392-88de-4f61-9d5f-6493471067fc None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:23.532611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227f852-eb74-4366-9208-2e8f620da539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:23.533277 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227f852-eb74-4366-9208-2e8f620da539 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:23.533589 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227f852-eb74-4366-9208-2e8f620da539 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:23.533865 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227f852-eb74-4366-9208-2e8f620da539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:23.543573 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227f852-eb74-4366-9208-2e8f620da539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:23.545017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227f852-eb74-4366-9208-2e8f620da539 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:23.554737 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 939/1836] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:23.638650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cc06a-ec7f-4e1b-a06e-6bf02cff0b31 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:23.639208 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cc06a-ec7f-4e1b-a06e-6bf02cff0b31 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:23.639208 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cc06a-ec7f-4e1b-a06e-6bf02cff0b31 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:23.640677 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 898/1837] 10.222.0.25 () {54 vars in 921 bytes} [Thu May 12 06:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:52:23.648155 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596f27e-36c9-4fca-8202-0428dbc0e68c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:23.648449 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596f27e-36c9-4fca-8202-0428dbc0e68c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:23.649241 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596f27e-36c9-4fca-8202-0428dbc0e68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:23.668576 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-1596f27e-36c9-4fca-8202-0428dbc0e68c None None] MFA Rules not processed for user `bbcd54a927bf46f183b50fbda677868d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:23.669781 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1596f27e-36c9-4fca-8202-0428dbc0e68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:23.740896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 940/1838] 10.222.0.25 () {58 vars in 1018 bytes} [Thu May 12 06:52:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:23.766514 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cc06a-ec7f-4e1b-a06e-6bf02cff0b31 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:23.768393 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c16cc06a-ec7f-4e1b-a06e-6bf02cff0b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:23.791901 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cc06a-ec7f-4e1b-a06e-6bf02cff0b31 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:23.798495 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d62110-9a47-40e1-bf17-a80a9967e9e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:23.799194 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d62110-9a47-40e1-bf17-a80a9967e9e9 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:23.800201 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d62110-9a47-40e1-bf17-a80a9967e9e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:23.800469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d62110-9a47-40e1-bf17-a80a9967e9e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:23.810575 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d62110-9a47-40e1-bf17-a80a9967e9e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:23.812156 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d62110-9a47-40e1-bf17-a80a9967e9e9 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:23.823492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 899/1839] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:26.069098 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596f27e-36c9-4fca-8202-0428dbc0e68c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:26.078721 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596f27e-36c9-4fca-8202-0428dbc0e68c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:26.082294 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd4d79-8c89-4a99-9264-b0a071dda13f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:26.082929 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd4d79-8c89-4a99-9264-b0a071dda13f service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:26.083215 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd4d79-8c89-4a99-9264-b0a071dda13f service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:26.083490 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd4d79-8c89-4a99-9264-b0a071dda13f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:26.139385 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd4d79-8c89-4a99-9264-b0a071dda13f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:26.140777 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd4d79-8c89-4a99-9264-b0a071dda13f service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:26.149863 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 941/1840] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:29.479147 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d62110-9a47-40e1-bf17-a80a9967e9e9 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:29.480571 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-66d62110-9a47-40e1-bf17-a80a9967e9e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:29.546535 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d62110-9a47-40e1-bf17-a80a9967e9e9 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:29.551275 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db61731-ef21-404f-a484-639b2c26772b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:29.552221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db61731-ef21-404f-a484-639b2c26772b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:29.552500 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db61731-ef21-404f-a484-639b2c26772b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:29.552771 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db61731-ef21-404f-a484-639b2c26772b admin admin] PATH_INFO: `/v3/users/2be4aea432f14d1498157b13091709cd` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:29.553979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db61731-ef21-404f-a484-639b2c26772b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2be4aea432f14d1498157b13091709cd)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:29.556042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db61731-ef21-404f-a484-639b2c26772b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:29.784365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7db61731-ef21-404f-a484-639b2c26772b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2be4aea432f14d1498157b13091709cd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:29.785042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7db61731-ef21-404f-a484-639b2c26772b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2be4aea432f14d1498157b13091709cd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:29.797850 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7db61731-ef21-404f-a484-639b2c26772b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2be4aea432f14d1498157b13091709cd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:29.798520 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7db61731-ef21-404f-a484-639b2c26772b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2be4aea432f14d1498157b13091709cd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:29.805326 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7db61731-ef21-404f-a484-639b2c26772b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2be4aea432f14d1498157b13091709cd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:29.987440 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 900/1841] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:29 2022] DELETE /identity/v3/users/2be4aea432f14d1498157b13091709cd => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:29.991858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616701b-5906-4269-8888-af067be2bb7e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:29.992724 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616701b-5906-4269-8888-af067be2bb7e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:29.993146 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616701b-5906-4269-8888-af067be2bb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:30.011462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-b616701b-5906-4269-8888-af067be2bb7e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:30.012684 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b616701b-5906-4269-8888-af067be2bb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:30.072811 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 942/1842] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:30.082168 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db61731-ef21-404f-a484-639b2c26772b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:30.083799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7db61731-ef21-404f-a484-639b2c26772b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:30.182641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db61731-ef21-404f-a484-639b2c26772b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:30.187570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15424dcc-5fdf-457d-8071-031ceea73c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:30.188521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15424dcc-5fdf-457d-8071-031ceea73c85 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:30.188802 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15424dcc-5fdf-457d-8071-031ceea73c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:30.189073 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15424dcc-5fdf-457d-8071-031ceea73c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:30.200459 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15424dcc-5fdf-457d-8071-031ceea73c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:30.202055 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15424dcc-5fdf-457d-8071-031ceea73c85 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:30.223855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 901/1843] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:31.087538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616701b-5906-4269-8888-af067be2bb7e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:31.089568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b616701b-5906-4269-8888-af067be2bb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:31.103334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616701b-5906-4269-8888-af067be2bb7e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:31.108766 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b94b4-9c41-46e5-ab45-7a79a1b66317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:31.109832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b94b4-9c41-46e5-ab45-7a79a1b66317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:31.110114 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b94b4-9c41-46e5-ab45-7a79a1b66317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:31.110388 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b94b4-9c41-46e5-ab45-7a79a1b66317 admin admin] PATH_INFO: `/v3/projects/14a9d2b078e84edc9f1bcc5de2bb4a1c` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:31.111611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b94b4-9c41-46e5-ab45-7a79a1b66317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14a9d2b078e84edc9f1bcc5de2bb4a1c)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:31.114211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b94b4-9c41-46e5-ab45-7a79a1b66317 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:31.323027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-fb0b94b4-9c41-46e5-ab45-7a79a1b66317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14a9d2b078e84edc9f1bcc5de2bb4a1c', 'request_id': 'req-fb0b94b4-9c41-46e5-ab45-7a79a1b66317'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:31.420702 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-fb0b94b4-9c41-46e5-ab45-7a79a1b66317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14a9d2b078e84edc9f1bcc5de2bb4a1c', 'request_id': 'req-fb0b94b4-9c41-46e5-ab45-7a79a1b66317'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:31.426666 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-fb0b94b4-9c41-46e5-ab45-7a79a1b66317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14a9d2b078e84edc9f1bcc5de2bb4a1c', 'request_id': 'req-fb0b94b4-9c41-46e5-ab45-7a79a1b66317'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:31.437831 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-fb0b94b4-9c41-46e5-ab45-7a79a1b66317 admin admin] The token cache is being invalidate because project 14a9d2b078e84edc9f1bcc5de2bb4a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:31.438115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-fb0b94b4-9c41-46e5-ab45-7a79a1b66317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:31.438801 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-fb0b94b4-9c41-46e5-ab45-7a79a1b66317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:31.440352 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 943/1844] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:31 2022] DELETE /identity/v3/projects/14a9d2b078e84edc9f1bcc5de2bb4a1c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:31.444201 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15424dcc-5fdf-457d-8071-031ceea73c85 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:31.454366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15424dcc-5fdf-457d-8071-031ceea73c85 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:31.508657 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978070fd-84a4-40d4-bdc5-96982fef058e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:31.509519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978070fd-84a4-40d4-bdc5-96982fef058e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:31.509795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978070fd-84a4-40d4-bdc5-96982fef058e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:31.510059 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978070fd-84a4-40d4-bdc5-96982fef058e admin admin] PATH_INFO: `/v3/users/2bb4b07ad48142b2801557c303132027` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:31.511256 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978070fd-84a4-40d4-bdc5-96982fef058e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb4b07ad48142b2801557c303132027)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:31.513248 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978070fd-84a4-40d4-bdc5-96982fef058e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:31.788012 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-978070fd-84a4-40d4-bdc5-96982fef058e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb4b07ad48142b2801557c303132027'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:31.789010 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-978070fd-84a4-40d4-bdc5-96982fef058e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb4b07ad48142b2801557c303132027'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:31.803657 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-978070fd-84a4-40d4-bdc5-96982fef058e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb4b07ad48142b2801557c303132027'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:31.804403 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-978070fd-84a4-40d4-bdc5-96982fef058e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb4b07ad48142b2801557c303132027'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:31.812630 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-978070fd-84a4-40d4-bdc5-96982fef058e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb4b07ad48142b2801557c303132027'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:31.935056 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 902/1845] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:31 2022] DELETE /identity/v3/users/2bb4b07ad48142b2801557c303132027 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:32.237005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b94b4-9c41-46e5-ab45-7a79a1b66317 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:32.239003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fb0b94b4-9c41-46e5-ab45-7a79a1b66317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:32.253336 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b94b4-9c41-46e5-ab45-7a79a1b66317 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:32.360425 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc95c3-f840-4172-9ec9-d568ac5b631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:32.361140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc95c3-f840-4172-9ec9-d568ac5b631e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:32.361423 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc95c3-f840-4172-9ec9-d568ac5b631e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:32.361754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc95c3-f840-4172-9ec9-d568ac5b631e admin admin] PATH_INFO: `/v3/users/8801ff6aa38a4ba8a49831eb624b26eb` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:32.368128 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc95c3-f840-4172-9ec9-d568ac5b631e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8801ff6aa38a4ba8a49831eb624b26eb)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:32.370146 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc95c3-f840-4172-9ec9-d568ac5b631e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:32.544597 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978070fd-84a4-40d4-bdc5-96982fef058e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:32.546191 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-978070fd-84a4-40d4-bdc5-96982fef058e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:32.560974 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978070fd-84a4-40d4-bdc5-96982fef058e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:32.566754 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf6b8f-4a11-46d5-9cfe-11e4db8f7a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:32.568047 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6b8f-4a11-46d5-9cfe-11e4db8f7a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:32.568832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6b8f-4a11-46d5-9cfe-11e4db8f7a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:32.569251 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6b8f-4a11-46d5-9cfe-11e4db8f7a8a admin admin] PATH_INFO: `/v3/projects/2f97f6fce87d4d80adef3fc207cbeeae` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:32.572034 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf6b8f-4a11-46d5-9cfe-11e4db8f7a8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f97f6fce87d4d80adef3fc207cbeeae)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:32.576947 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf6b8f-4a11-46d5-9cfe-11e4db8f7a8a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:32.649379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5afc95c3-f840-4172-9ec9-d568ac5b631e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8801ff6aa38a4ba8a49831eb624b26eb'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:32.650105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5afc95c3-f840-4172-9ec9-d568ac5b631e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8801ff6aa38a4ba8a49831eb624b26eb'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:32.651063 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5afc95c3-f840-4172-9ec9-d568ac5b631e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8801ff6aa38a4ba8a49831eb624b26eb'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:32.664868 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5afc95c3-f840-4172-9ec9-d568ac5b631e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8801ff6aa38a4ba8a49831eb624b26eb'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:32.672303 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5afc95c3-f840-4172-9ec9-d568ac5b631e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8801ff6aa38a4ba8a49831eb624b26eb'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:32.782119 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3daf6b8f-4a11-46d5-9cfe-11e4db8f7a8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f97f6fce87d4d80adef3fc207cbeeae', 'request_id': 'req-3daf6b8f-4a11-46d5-9cfe-11e4db8f7a8a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:32.809652 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 944/1846] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:32 2022] DELETE /identity/v3/users/8801ff6aa38a4ba8a49831eb624b26eb => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:32.814190 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e21c37-a9ae-4110-b46f-b7e28a937de5 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:32.814487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e21c37-a9ae-4110-b46f-b7e28a937de5 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:32.814769 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e21c37-a9ae-4110-b46f-b7e28a937de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:32.832145 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f9e21c37-a9ae-4110-b46f-b7e28a937de5 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:32.833855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f9e21c37-a9ae-4110-b46f-b7e28a937de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:32.895213 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3daf6b8f-4a11-46d5-9cfe-11e4db8f7a8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f97f6fce87d4d80adef3fc207cbeeae', 'request_id': 'req-3daf6b8f-4a11-46d5-9cfe-11e4db8f7a8a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:32.896094 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 945/1847] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:52:32.902499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3daf6b8f-4a11-46d5-9cfe-11e4db8f7a8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f97f6fce87d4d80adef3fc207cbeeae', 'request_id': 'req-3daf6b8f-4a11-46d5-9cfe-11e4db8f7a8a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:32.907812 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e21c37-a9ae-4110-b46f-b7e28a937de5 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:32.909684 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f9e21c37-a9ae-4110-b46f-b7e28a937de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:32.916624 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3daf6b8f-4a11-46d5-9cfe-11e4db8f7a8a admin admin] The token cache is being invalidate because project 2f97f6fce87d4d80adef3fc207cbeeae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:32.916910 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3daf6b8f-4a11-46d5-9cfe-11e4db8f7a8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:32.917728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3daf6b8f-4a11-46d5-9cfe-11e4db8f7a8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:32.919609 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 903/1848] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:32 2022] DELETE /identity/v3/projects/2f97f6fce87d4d80adef3fc207cbeeae => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:52:32.924528 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8d4cd-f97c-4e69-be67-9dad57283aa3 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:32.924989 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8d4cd-f97c-4e69-be67-9dad57283aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:32.925511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8d4cd-f97c-4e69-be67-9dad57283aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:32.946002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-acb8d4cd-f97c-4e69-be67-9dad57283aa3 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:32.947572 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-acb8d4cd-f97c-4e69-be67-9dad57283aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:32.956551 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 904/1849] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:32.966569 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031477f-79b9-4d98-9274-503077f64d4b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:32.967004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031477f-79b9-4d98-9274-503077f64d4b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:32.967098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031477f-79b9-4d98-9274-503077f64d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:32.979543 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e21c37-a9ae-4110-b46f-b7e28a937de5 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:32.983604 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a574f-2f6e-490b-b403-982dd0ef191c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:32.984321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a574f-2f6e-490b-b403-982dd0ef191c service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:32.985090 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a574f-2f6e-490b-b403-982dd0ef191c service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:32.985359 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a574f-2f6e-490b-b403-982dd0ef191c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:32.986371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9031477f-79b9-4d98-9274-503077f64d4b None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:32.987526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4e3a574f-2f6e-490b-b403-982dd0ef191c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:32.987656 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9031477f-79b9-4d98-9274-503077f64d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:33.003284 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 905/1850] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:33.006419 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a574f-2f6e-490b-b403-982dd0ef191c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:33.007335 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031477f-79b9-4d98-9274-503077f64d4b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:33.007985 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a574f-2f6e-490b-b403-982dd0ef191c service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:33.017375 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031477f-79b9-4d98-9274-503077f64d4b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:33.020037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 946/1851] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:33.028471 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e1b40-2948-46f5-ae5d-e59be4d374d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:33.029378 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e1b40-2948-46f5-ae5d-e59be4d374d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:33.029812 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e1b40-2948-46f5-ae5d-e59be4d374d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:33.030260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e1b40-2948-46f5-ae5d-e59be4d374d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:33.039816 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e1b40-2948-46f5-ae5d-e59be4d374d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:52:33.040586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e1b40-2948-46f5-ae5d-e59be4d374d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:33.043292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e1b40-2948-46f5-ae5d-e59be4d374d8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:33.061528 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 906/1852] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:52:33.071303 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a574f-2f6e-490b-b403-982dd0ef191c service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:33.087221 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a574f-2f6e-490b-b403-982dd0ef191c service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:33.097347 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc1e4c-6875-4924-bf9b-8f4e5be41898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:33.098081 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc1e4c-6875-4924-bf9b-8f4e5be41898 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:33.098371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc1e4c-6875-4924-bf9b-8f4e5be41898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:33.098684 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc1e4c-6875-4924-bf9b-8f4e5be41898 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:33.099852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc1e4c-6875-4924-bf9b-8f4e5be41898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:33.103441 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc1e4c-6875-4924-bf9b-8f4e5be41898 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:33.354990 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 947/1853] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:33 2022] POST /identity/v3/projects => generated 369 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:33.359170 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e1b40-2948-46f5-ae5d-e59be4d374d8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:33.369499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e1b40-2948-46f5-ae5d-e59be4d374d8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:33.430861 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2d641-1a4e-4f08-9910-b1c121b21adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:33.431545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2d641-1a4e-4f08-9910-b1c121b21adf admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:33.431861 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2d641-1a4e-4f08-9910-b1c121b21adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:33.432133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2d641-1a4e-4f08-9910-b1c121b21adf admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:33.432838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2d641-1a4e-4f08-9910-b1c121b21adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:33.434752 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2d641-1a4e-4f08-9910-b1c121b21adf admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:33.586854 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 907/1854] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:33 2022] POST /identity/v3/users => generated 285 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:33.591095 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc1e4c-6875-4924-bf9b-8f4e5be41898 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:33.601995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc1e4c-6875-4924-bf9b-8f4e5be41898 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:33.607489 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dadefb-8a43-4478-bc83-6ee45086589a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:33.608252 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dadefb-8a43-4478-bc83-6ee45086589a admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:33.608540 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dadefb-8a43-4478-bc83-6ee45086589a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:33.609224 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dadefb-8a43-4478-bc83-6ee45086589a admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:33.609658 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dadefb-8a43-4478-bc83-6ee45086589a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:33.611297 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dadefb-8a43-4478-bc83-6ee45086589a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:33.623963 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 948/1855] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 06:52:33.628030 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2d641-1a4e-4f08-9910-b1c121b21adf admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:33.639819 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2d641-1a4e-4f08-9910-b1c121b21adf admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:33.644647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b8ae6-7e69-4910-89b5-f7c9ea43027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:33.645403 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b8ae6-7e69-4910-89b5-f7c9ea43027b admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:33.645758 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b8ae6-7e69-4910-89b5-f7c9ea43027b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:33.646259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b8ae6-7e69-4910-89b5-f7c9ea43027b admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:33.647076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b8ae6-7e69-4910-89b5-f7c9ea43027b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:33.648904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b8ae6-7e69-4910-89b5-f7c9ea43027b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:33.659909 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 908/1856] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:33.665040 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dadefb-8a43-4478-bc83-6ee45086589a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:33.681902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b8ae6-7e69-4910-89b5-f7c9ea43027b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:33.685774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-418b8ae6-7e69-4910-89b5-f7c9ea43027b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:33.708122 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b8ae6-7e69-4910-89b5-f7c9ea43027b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:33.717107 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3286c-bea8-4dbc-9af8-3fb2aa82ec7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:33.718348 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3286c-bea8-4dbc-9af8-3fb2aa82ec7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:33.719123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3286c-bea8-4dbc-9af8-3fb2aa82ec7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:33.719598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3286c-bea8-4dbc-9af8-3fb2aa82ec7f admin admin] PATH_INFO: `/v3/projects/8891387f13f94b9584c7d88afc3a1066` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:33.721244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3286c-bea8-4dbc-9af8-3fb2aa82ec7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8891387f13f94b9584c7d88afc3a1066)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:33.723483 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3286c-bea8-4dbc-9af8-3fb2aa82ec7f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:33.752508 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dadefb-8a43-4478-bc83-6ee45086589a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:33.763313 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91801aa5-6890-40a5-b581-1670eb579673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:33.764807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91801aa5-6890-40a5-b581-1670eb579673 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:33.765316 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91801aa5-6890-40a5-b581-1670eb579673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:33.765746 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91801aa5-6890-40a5-b581-1670eb579673 admin admin] PATH_INFO: `/v3/projects/7ae0fe7c6e8447ef8482d7741a2bb7d3/users/65ba059d02b240cb876a90b300c1b416/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:33.784612 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91801aa5-6890-40a5-b581-1670eb579673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ae0fe7c6e8447ef8482d7741a2bb7d3, user_id=65ba059d02b240cb876a90b300c1b416, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:33.787460 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91801aa5-6890-40a5-b581-1670eb579673 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:33.906617 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 949/1857] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:33 2022] PUT /identity/v3/projects/7ae0fe7c6e8447ef8482d7741a2bb7d3/users/65ba059d02b240cb876a90b300c1b416/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:33.908189 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978e9a5-4a3a-47c9-89e2-bcb82b805c08 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:33.908487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978e9a5-4a3a-47c9-89e2-bcb82b805c08 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:33.908762 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978e9a5-4a3a-47c9-89e2-bcb82b805c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:33.916261 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-41a3286c-bea8-4dbc-9af8-3fb2aa82ec7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8891387f13f94b9584c7d88afc3a1066', 'request_id': 'req-41a3286c-bea8-4dbc-9af8-3fb2aa82ec7f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:33.936767 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-5978e9a5-4a3a-47c9-89e2-bcb82b805c08 None None] MFA Rules not processed for user `65ba059d02b240cb876a90b300c1b416`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:33.937900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5978e9a5-4a3a-47c9-89e2-bcb82b805c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:34.003426 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-41a3286c-bea8-4dbc-9af8-3fb2aa82ec7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8891387f13f94b9584c7d88afc3a1066', 'request_id': 'req-41a3286c-bea8-4dbc-9af8-3fb2aa82ec7f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:34.014994 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-41a3286c-bea8-4dbc-9af8-3fb2aa82ec7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8891387f13f94b9584c7d88afc3a1066', 'request_id': 'req-41a3286c-bea8-4dbc-9af8-3fb2aa82ec7f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:34.021162 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 950/1858] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:34.026450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978e9a5-4a3a-47c9-89e2-bcb82b805c08 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:34.037503 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-41a3286c-bea8-4dbc-9af8-3fb2aa82ec7f admin admin] The token cache is being invalidate because project 8891387f13f94b9584c7d88afc3a1066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:34.037675 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-41a3286c-bea8-4dbc-9af8-3fb2aa82ec7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:34.039245 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-41a3286c-bea8-4dbc-9af8-3fb2aa82ec7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:34.043663 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 909/1859] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:33 2022] DELETE /identity/v3/projects/8891387f13f94b9584c7d88afc3a1066 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:34.049240 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3286c-bea8-4dbc-9af8-3fb2aa82ec7f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:34.050716 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-41a3286c-bea8-4dbc-9af8-3fb2aa82ec7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:34.136570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3286c-bea8-4dbc-9af8-3fb2aa82ec7f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:34.140352 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978e9a5-4a3a-47c9-89e2-bcb82b805c08 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:34.144013 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c8384-7218-4ffd-93d7-7498c29fab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:34.145845 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c8384-7218-4ffd-93d7-7498c29fab9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:34.146553 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c8384-7218-4ffd-93d7-7498c29fab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:34.146847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fa11d-b107-498d-9b9f-0b26194cda23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:34.147178 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c8384-7218-4ffd-93d7-7498c29fab9d admin admin] PATH_INFO: `/v3/users/55b55323e74b4f92867eaac5db08286b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:34.147836 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fa11d-b107-498d-9b9f-0b26194cda23 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:34.148221 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fa11d-b107-498d-9b9f-0b26194cda23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:34.149124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fa11d-b107-498d-9b9f-0b26194cda23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:34.150297 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fa11d-b107-498d-9b9f-0b26194cda23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:34.150489 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c8384-7218-4ffd-93d7-7498c29fab9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=55b55323e74b4f92867eaac5db08286b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:34.153931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c8384-7218-4ffd-93d7-7498c29fab9d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:34.154060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fa11d-b107-498d-9b9f-0b26194cda23 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:34.406826 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 951/1860] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:34 2022] POST /identity/v3/projects => generated 367 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:52:34.412942 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fa11d-b107-498d-9b9f-0b26194cda23 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:34.415567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e30fa11d-b107-498d-9b9f-0b26194cda23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:34.462058 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fe4c8384-7218-4ffd-93d7-7498c29fab9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55b55323e74b4f92867eaac5db08286b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:34.463017 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fe4c8384-7218-4ffd-93d7-7498c29fab9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55b55323e74b4f92867eaac5db08286b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:34.477366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fe4c8384-7218-4ffd-93d7-7498c29fab9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55b55323e74b4f92867eaac5db08286b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:34.478207 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fe4c8384-7218-4ffd-93d7-7498c29fab9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55b55323e74b4f92867eaac5db08286b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:34.485334 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fe4c8384-7218-4ffd-93d7-7498c29fab9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55b55323e74b4f92867eaac5db08286b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:34.504576 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fa11d-b107-498d-9b9f-0b26194cda23 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:34.517737 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4ec1b-b8ec-42db-a3d6-c96e4ec3e3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:34.518745 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4ec1b-b8ec-42db-a3d6-c96e4ec3e3dd admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:34.519023 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4ec1b-b8ec-42db-a3d6-c96e4ec3e3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:34.519473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4ec1b-b8ec-42db-a3d6-c96e4ec3e3dd admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:34.520215 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4ec1b-b8ec-42db-a3d6-c96e4ec3e3dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:34.522428 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4ec1b-b8ec-42db-a3d6-c96e4ec3e3dd admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:34.586671 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 910/1861] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:34 2022] DELETE /identity/v3/users/55b55323e74b4f92867eaac5db08286b => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:34.681028 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 952/1862] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:34 2022] POST /identity/v3/users => generated 290 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:52:34.684905 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c8384-7218-4ffd-93d7-7498c29fab9d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:34.686942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fe4c8384-7218-4ffd-93d7-7498c29fab9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:34.790970 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c8384-7218-4ffd-93d7-7498c29fab9d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:34.806328 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a7b24-1c68-4a2d-a88b-43dd1e016416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:34.807243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a7b24-1c68-4a2d-a88b-43dd1e016416 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:34.807530 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a7b24-1c68-4a2d-a88b-43dd1e016416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:34.807928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a7b24-1c68-4a2d-a88b-43dd1e016416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:34.809044 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a7b24-1c68-4a2d-a88b-43dd1e016416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:34.811101 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a7b24-1c68-4a2d-a88b-43dd1e016416 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:34.829393 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 911/1863] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:34.832725 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4ec1b-b8ec-42db-a3d6-c96e4ec3e3dd admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:34.847738 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4ec1b-b8ec-42db-a3d6-c96e4ec3e3dd admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:34.857546 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bbe66-2c33-4552-9cf5-dd205bef689e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:34.858504 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bbe66-2c33-4552-9cf5-dd205bef689e admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:34.858787 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bbe66-2c33-4552-9cf5-dd205bef689e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:34.859057 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bbe66-2c33-4552-9cf5-dd205bef689e admin admin] PATH_INFO: `/v3/projects/da3ce04d446e4406aef6f964fe87a896/users/1861209fcc4041e89c17ac9b9904028a/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:34.878178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bbe66-2c33-4552-9cf5-dd205bef689e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da3ce04d446e4406aef6f964fe87a896, user_id=1861209fcc4041e89c17ac9b9904028a, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:34.881785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bbe66-2c33-4552-9cf5-dd205bef689e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:35.069575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 953/1864] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:34 2022] PUT /identity/v3/projects/da3ce04d446e4406aef6f964fe87a896/users/1861209fcc4041e89c17ac9b9904028a/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:52:35.073531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a7b24-1c68-4a2d-a88b-43dd1e016416 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:35.093749 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a7b24-1c68-4a2d-a88b-43dd1e016416 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:35.176525 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a00be-1233-47de-8019-9d151f9b3832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:35.177350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a00be-1233-47de-8019-9d151f9b3832 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:35.177826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a00be-1233-47de-8019-9d151f9b3832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:35.178202 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a00be-1233-47de-8019-9d151f9b3832 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:35.179633 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a00be-1233-47de-8019-9d151f9b3832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:35.181040 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a00be-1233-47de-8019-9d151f9b3832 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:35.194101 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 912/1865] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:35.197924 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bbe66-2c33-4552-9cf5-dd205bef689e admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:35.228295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a00be-1233-47de-8019-9d151f9b3832 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:35.233551 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-534a00be-1233-47de-8019-9d151f9b3832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:35.234283 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bbe66-2c33-4552-9cf5-dd205bef689e admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:35.249186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d017d1-8576-4f94-a3ce-47307c4925c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:35.250843 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d017d1-8576-4f94-a3ce-47307c4925c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:35.253874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d017d1-8576-4f94-a3ce-47307c4925c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:35.254420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d017d1-8576-4f94-a3ce-47307c4925c7 admin admin] PATH_INFO: `/v3/projects/da3ce04d446e4406aef6f964fe87a896/users/1861209fcc4041e89c17ac9b9904028a/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:35.258666 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d017d1-8576-4f94-a3ce-47307c4925c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da3ce04d446e4406aef6f964fe87a896, user_id=1861209fcc4041e89c17ac9b9904028a, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:35.266293 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d017d1-8576-4f94-a3ce-47307c4925c7 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:35.267157 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a00be-1233-47de-8019-9d151f9b3832 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:35.281849 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2360e-0f49-4393-a6c4-063dd584c3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:35.320177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2360e-0f49-4393-a6c4-063dd584c3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:35.320177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2360e-0f49-4393-a6c4-063dd584c3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:35.320177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2360e-0f49-4393-a6c4-063dd584c3ef admin admin] PATH_INFO: `/v3/projects/344e33fcdf404b5286f9ad7a819382c8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:35.320177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2360e-0f49-4393-a6c4-063dd584c3ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=344e33fcdf404b5286f9ad7a819382c8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:35.320177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2360e-0f49-4393-a6c4-063dd584c3ef admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:35.321586 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 954/1866] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:35 2022] PUT /identity/v3/projects/da3ce04d446e4406aef6f964fe87a896/users/1861209fcc4041e89c17ac9b9904028a/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:35.324933 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac45069-cc25-4d6e-92d1-97329fb0c300 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:35.325411 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac45069-cc25-4d6e-92d1-97329fb0c300 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:35.325796 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac45069-cc25-4d6e-92d1-97329fb0c300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:35.394937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4ac45069-cc25-4d6e-92d1-97329fb0c300 None None] MFA Rules not processed for user `1861209fcc4041e89c17ac9b9904028a`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:35.396549 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4ac45069-cc25-4d6e-92d1-97329fb0c300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:35.542599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0bc2360e-0f49-4393-a6c4-063dd584c3ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '344e33fcdf404b5286f9ad7a819382c8', 'request_id': 'req-0bc2360e-0f49-4393-a6c4-063dd584c3ef'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:35.557721 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 955/1867] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:52:35.569668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac45069-cc25-4d6e-92d1-97329fb0c300 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:35.571625 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4ac45069-cc25-4d6e-92d1-97329fb0c300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:35.642956 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac45069-cc25-4d6e-92d1-97329fb0c300 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:35.666269 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0bc2360e-0f49-4393-a6c4-063dd584c3ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '344e33fcdf404b5286f9ad7a819382c8', 'request_id': 'req-0bc2360e-0f49-4393-a6c4-063dd584c3ef'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:35.673959 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0bc2360e-0f49-4393-a6c4-063dd584c3ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '344e33fcdf404b5286f9ad7a819382c8', 'request_id': 'req-0bc2360e-0f49-4393-a6c4-063dd584c3ef'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:35.702998 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0bc2360e-0f49-4393-a6c4-063dd584c3ef admin admin] The token cache is being invalidate because project 344e33fcdf404b5286f9ad7a819382c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:35.712299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0bc2360e-0f49-4393-a6c4-063dd584c3ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:35.713113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0bc2360e-0f49-4393-a6c4-063dd584c3ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:35.717833 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 913/1868] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:35 2022] DELETE /identity/v3/projects/344e33fcdf404b5286f9ad7a819382c8 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:35.718857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2360e-0f49-4393-a6c4-063dd584c3ef admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:35.721993 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5bfea-5486-4d9c-9930-95b0ed20bd6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:35.722345 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0bc2360e-0f49-4393-a6c4-063dd584c3ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:35.722436 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5bfea-5486-4d9c-9930-95b0ed20bd6d service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:35.722436 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5bfea-5486-4d9c-9930-95b0ed20bd6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:35.722436 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5bfea-5486-4d9c-9930-95b0ed20bd6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:35.724434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ccf5bfea-5486-4d9c-9930-95b0ed20bd6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:35.822792 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5bfea-5486-4d9c-9930-95b0ed20bd6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:35.822792 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5bfea-5486-4d9c-9930-95b0ed20bd6d service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:35.842069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 956/1869] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 06:52:35.845984 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2360e-0f49-4393-a6c4-063dd584c3ef admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:35.857497 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36937a77-bee8-4a3d-a19a-028631b99d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:35.858636 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36937a77-bee8-4a3d-a19a-028631b99d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:35.858993 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36937a77-bee8-4a3d-a19a-028631b99d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:35.859547 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36937a77-bee8-4a3d-a19a-028631b99d71 admin admin] PATH_INFO: `/v3/users/a9bf9efd0cdf421a8438832b1bf4a8a0` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:35.863035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36937a77-bee8-4a3d-a19a-028631b99d71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9bf9efd0cdf421a8438832b1bf4a8a0)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:35.865967 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36937a77-bee8-4a3d-a19a-028631b99d71 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:36.184262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36937a77-bee8-4a3d-a19a-028631b99d71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9bf9efd0cdf421a8438832b1bf4a8a0'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:36.185499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36937a77-bee8-4a3d-a19a-028631b99d71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9bf9efd0cdf421a8438832b1bf4a8a0'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:36.213566 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36937a77-bee8-4a3d-a19a-028631b99d71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9bf9efd0cdf421a8438832b1bf4a8a0'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:36.214580 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36937a77-bee8-4a3d-a19a-028631b99d71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9bf9efd0cdf421a8438832b1bf4a8a0'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:36.222148 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36937a77-bee8-4a3d-a19a-028631b99d71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9bf9efd0cdf421a8438832b1bf4a8a0'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:36.323252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 914/1870] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:35 2022] DELETE /identity/v3/users/a9bf9efd0cdf421a8438832b1bf4a8a0 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:36.812580 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5bfea-5486-4d9c-9930-95b0ed20bd6d service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:36.833383 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5bfea-5486-4d9c-9930-95b0ed20bd6d service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:36.902787 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f022417-9ec9-4a99-907a-aded3f056e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:36.903666 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f022417-9ec9-4a99-907a-aded3f056e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:36.903979 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f022417-9ec9-4a99-907a-aded3f056e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:36.904257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f022417-9ec9-4a99-907a-aded3f056e23 admin admin] PATH_INFO: `/v3/projects/23b61d55fdf54282973e6191033d82b2` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:36.905720 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f022417-9ec9-4a99-907a-aded3f056e23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23b61d55fdf54282973e6191033d82b2)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:36.907618 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f022417-9ec9-4a99-907a-aded3f056e23 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:37.044485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0f022417-9ec9-4a99-907a-aded3f056e23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23b61d55fdf54282973e6191033d82b2', 'request_id': 'req-0f022417-9ec9-4a99-907a-aded3f056e23'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:37.112751 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0f022417-9ec9-4a99-907a-aded3f056e23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23b61d55fdf54282973e6191033d82b2', 'request_id': 'req-0f022417-9ec9-4a99-907a-aded3f056e23'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:37.118651 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0f022417-9ec9-4a99-907a-aded3f056e23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23b61d55fdf54282973e6191033d82b2', 'request_id': 'req-0f022417-9ec9-4a99-907a-aded3f056e23'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:37.138923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0f022417-9ec9-4a99-907a-aded3f056e23 admin admin] The token cache is being invalidate because project 23b61d55fdf54282973e6191033d82b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:37.138923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0f022417-9ec9-4a99-907a-aded3f056e23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:37.138923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0f022417-9ec9-4a99-907a-aded3f056e23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:37.138923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 957/1871] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:36 2022] DELETE /identity/v3/projects/23b61d55fdf54282973e6191033d82b2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:37.142878 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efd470-e93a-408a-a865-0cdbf4d9caf0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:37.143326 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efd470-e93a-408a-a865-0cdbf4d9caf0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:37.143423 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efd470-e93a-408a-a865-0cdbf4d9caf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:37.162604 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-68efd470-e93a-408a-a865-0cdbf4d9caf0 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:37.166877 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-68efd470-e93a-408a-a865-0cdbf4d9caf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:37.251569 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 915/1872] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:52:37.262186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cce20-b16e-495e-a2af-144ae6d2e27b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:37.262471 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cce20-b16e-495e-a2af-144ae6d2e27b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:37.262742 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cce20-b16e-495e-a2af-144ae6d2e27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:37.281879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f12cce20-b16e-495e-a2af-144ae6d2e27b None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:37.283518 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f12cce20-b16e-495e-a2af-144ae6d2e27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:37.295286 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 958/1873] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:37.298628 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efd470-e93a-408a-a865-0cdbf4d9caf0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:37.308776 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efd470-e93a-408a-a865-0cdbf4d9caf0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:37.313486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14f240-e3a2-49a1-988a-cc0871ae0858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:37.314141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14f240-e3a2-49a1-988a-cc0871ae0858 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:37.314421 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14f240-e3a2-49a1-988a-cc0871ae0858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:37.314693 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14f240-e3a2-49a1-988a-cc0871ae0858 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:37.315454 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14f240-e3a2-49a1-988a-cc0871ae0858 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:52:37.315791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14f240-e3a2-49a1-988a-cc0871ae0858 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:37.317383 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14f240-e3a2-49a1-988a-cc0871ae0858 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:37.329054 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 916/1874] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:52:37.333487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cce20-b16e-495e-a2af-144ae6d2e27b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:37.343668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cce20-b16e-495e-a2af-144ae6d2e27b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:37.348510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6d69c-5d7d-4038-b72f-eefaecf67902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:37.349160 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6d69c-5d7d-4038-b72f-eefaecf67902 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:37.349445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6d69c-5d7d-4038-b72f-eefaecf67902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:37.349714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6d69c-5d7d-4038-b72f-eefaecf67902 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:37.350457 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6d69c-5d7d-4038-b72f-eefaecf67902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:37.353035 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6d69c-5d7d-4038-b72f-eefaecf67902 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:37.502509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 959/1875] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:37 2022] POST /identity/v3/projects => generated 391 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:37.506612 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14f240-e3a2-49a1-988a-cc0871ae0858 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:37.517429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14f240-e3a2-49a1-988a-cc0871ae0858 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:37.578530 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec20050-b0b9-4d00-b34f-aa696bd7e057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:37.587533 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec20050-b0b9-4d00-b34f-aa696bd7e057 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:37.588798 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec20050-b0b9-4d00-b34f-aa696bd7e057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:37.589148 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec20050-b0b9-4d00-b34f-aa696bd7e057 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:37.596454 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec20050-b0b9-4d00-b34f-aa696bd7e057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:37.596454 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec20050-b0b9-4d00-b34f-aa696bd7e057 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:37.715516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 917/1876] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:37 2022] POST /identity/v3/users => generated 296 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:37.716710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6d69c-5d7d-4038-b72f-eefaecf67902 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:37.729981 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6d69c-5d7d-4038-b72f-eefaecf67902 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:37.737433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc322c-7d8b-47bc-9579-5f102d4adb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:37.738118 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc322c-7d8b-47bc-9579-5f102d4adb34 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:37.738488 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc322c-7d8b-47bc-9579-5f102d4adb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:37.738766 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc322c-7d8b-47bc-9579-5f102d4adb34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:37.739656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc322c-7d8b-47bc-9579-5f102d4adb34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:37.741610 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc322c-7d8b-47bc-9579-5f102d4adb34 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:37.754990 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 960/1877] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 06:52:37.758922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec20050-b0b9-4d00-b34f-aa696bd7e057 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:37.768904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec20050-b0b9-4d00-b34f-aa696bd7e057 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:37.773685 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6179c1a-8e1e-4b2b-8877-f297e38c1378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:37.774379 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6179c1a-8e1e-4b2b-8877-f297e38c1378 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:37.774637 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6179c1a-8e1e-4b2b-8877-f297e38c1378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:37.774911 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6179c1a-8e1e-4b2b-8877-f297e38c1378 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:37.775642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6179c1a-8e1e-4b2b-8877-f297e38c1378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:37.777300 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6179c1a-8e1e-4b2b-8877-f297e38c1378 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:37.794194 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 918/1878] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:37.800825 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc322c-7d8b-47bc-9579-5f102d4adb34 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:37.809316 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc322c-7d8b-47bc-9579-5f102d4adb34 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:37.814924 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bea00-f7b3-4219-b639-a75a59621ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:37.816042 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bea00-f7b3-4219-b639-a75a59621ce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:37.816317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bea00-f7b3-4219-b639-a75a59621ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:37.816752 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bea00-f7b3-4219-b639-a75a59621ce2 admin admin] PATH_INFO: `/v3/projects/6f0c687e191f471099021efbd2330b37/users/a609fa38165c461c999ecd6a0c85be8c/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:37.838791 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bea00-f7b3-4219-b639-a75a59621ce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f0c687e191f471099021efbd2330b37, user_id=a609fa38165c461c999ecd6a0c85be8c, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:37.842170 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bea00-f7b3-4219-b639-a75a59621ce2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:37.936016 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 961/1879] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:37 2022] PUT /identity/v3/projects/6f0c687e191f471099021efbd2330b37/users/a609fa38165c461c999ecd6a0c85be8c/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:37.948387 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdf8be-8a74-43f9-b2a2-6578fe86aa29 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:37.948634 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdf8be-8a74-43f9-b2a2-6578fe86aa29 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:37.948911 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdf8be-8a74-43f9-b2a2-6578fe86aa29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:37.979874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-80bdf8be-8a74-43f9-b2a2-6578fe86aa29 None None] MFA Rules not processed for user `a609fa38165c461c999ecd6a0c85be8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:37.981114 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-80bdf8be-8a74-43f9-b2a2-6578fe86aa29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:38.063743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 919/1880] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:38.068449 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bea00-f7b3-4219-b639-a75a59621ce2 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:38.177487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bea00-f7b3-4219-b639-a75a59621ce2 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:38.186559 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81790e-a4dc-4a41-b581-09886bda6331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:38.187293 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81790e-a4dc-4a41-b581-09886bda6331 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:38.190350 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81790e-a4dc-4a41-b581-09886bda6331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:38.190350 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81790e-a4dc-4a41-b581-09886bda6331 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:38.190350 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81790e-a4dc-4a41-b581-09886bda6331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:38.190783 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81790e-a4dc-4a41-b581-09886bda6331 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:38.311801 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 962/1881] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:38 2022] POST /identity/v3/projects => generated 393 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:38.313004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdf8be-8a74-43f9-b2a2-6578fe86aa29 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:38.323733 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdf8be-8a74-43f9-b2a2-6578fe86aa29 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:38.379483 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fa7b2-16ff-4eab-9c56-e655381a61f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:38.380292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fa7b2-16ff-4eab-9c56-e655381a61f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:38.380464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fa7b2-16ff-4eab-9c56-e655381a61f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:38.384945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fa7b2-16ff-4eab-9c56-e655381a61f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:38.384945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fa7b2-16ff-4eab-9c56-e655381a61f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:38.384945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fa7b2-16ff-4eab-9c56-e655381a61f7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:38.472189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 920/1882] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:38 2022] POST /identity/v3/users => generated 303 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:52:38.476342 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81790e-a4dc-4a41-b581-09886bda6331 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:38.486968 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81790e-a4dc-4a41-b581-09886bda6331 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:38.491676 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff06cc-5029-4753-9f62-e33b1ae9030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:38.492918 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff06cc-5029-4753-9f62-e33b1ae9030f admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:38.493199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff06cc-5029-4753-9f62-e33b1ae9030f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:38.493473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff06cc-5029-4753-9f62-e33b1ae9030f admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:38.494248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff06cc-5029-4753-9f62-e33b1ae9030f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:38.495857 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff06cc-5029-4753-9f62-e33b1ae9030f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:38.506165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 963/1883] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:38.510300 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fa7b2-16ff-4eab-9c56-e655381a61f7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:38.520339 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fa7b2-16ff-4eab-9c56-e655381a61f7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:38.525166 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2096c3-cf8f-4fba-a727-26facbe23353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:38.526050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2096c3-cf8f-4fba-a727-26facbe23353 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:38.526368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2096c3-cf8f-4fba-a727-26facbe23353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:38.526640 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2096c3-cf8f-4fba-a727-26facbe23353 admin admin] PATH_INFO: `/v3/projects/c77cfbb28f29422aad92fd15db8b1148/users/b936954ef46b43c78408f026d4f59107/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:38.542314 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2096c3-cf8f-4fba-a727-26facbe23353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77cfbb28f29422aad92fd15db8b1148, user_id=b936954ef46b43c78408f026d4f59107, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:38.545066 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2096c3-cf8f-4fba-a727-26facbe23353 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:38.609855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 921/1884] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:38 2022] PUT /identity/v3/projects/c77cfbb28f29422aad92fd15db8b1148/users/b936954ef46b43c78408f026d4f59107/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:38.613775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff06cc-5029-4753-9f62-e33b1ae9030f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:38.623607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff06cc-5029-4753-9f62-e33b1ae9030f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:38.685492 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a9975-9e0d-49da-876f-a23d2c1e06d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:38.686167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a9975-9e0d-49da-876f-a23d2c1e06d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:38.686446 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a9975-9e0d-49da-876f-a23d2c1e06d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:38.686716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a9975-9e0d-49da-876f-a23d2c1e06d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:38.687445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a9975-9e0d-49da-876f-a23d2c1e06d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:38.689082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a9975-9e0d-49da-876f-a23d2c1e06d2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:38.698715 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 964/1885] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:38.702938 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2096c3-cf8f-4fba-a727-26facbe23353 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:38.713679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2096c3-cf8f-4fba-a727-26facbe23353 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:38.718398 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e1f44-8ee1-44d4-b46e-37dd31a2ff80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:38.719271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e1f44-8ee1-44d4-b46e-37dd31a2ff80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:38.719550 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e1f44-8ee1-44d4-b46e-37dd31a2ff80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:38.719887 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e1f44-8ee1-44d4-b46e-37dd31a2ff80 admin admin] PATH_INFO: `/v3/projects/c77cfbb28f29422aad92fd15db8b1148/users/b936954ef46b43c78408f026d4f59107/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:38.721871 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e1f44-8ee1-44d4-b46e-37dd31a2ff80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77cfbb28f29422aad92fd15db8b1148, user_id=b936954ef46b43c78408f026d4f59107, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:38.724531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e1f44-8ee1-44d4-b46e-37dd31a2ff80 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:38.734556 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 922/1886] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:38 2022] PUT /identity/v3/projects/c77cfbb28f29422aad92fd15db8b1148/users/b936954ef46b43c78408f026d4f59107/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:38.745380 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e9b63-ebb6-4311-90b2-fff66e8222eb None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:38.745669 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e9b63-ebb6-4311-90b2-fff66e8222eb None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:38.745963 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e9b63-ebb6-4311-90b2-fff66e8222eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:38.772557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-2a4e9b63-ebb6-4311-90b2-fff66e8222eb None None] MFA Rules not processed for user `b936954ef46b43c78408f026d4f59107`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:38.773814 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2a4e9b63-ebb6-4311-90b2-fff66e8222eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:38.842733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 965/1887] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:38.857057 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e1f44-8ee1-44d4-b46e-37dd31a2ff80 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:38.858841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-189e1f44-8ee1-44d4-b46e-37dd31a2ff80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:38.916268 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e1f44-8ee1-44d4-b46e-37dd31a2ff80 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:38.919904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb1fed-0ce5-45de-9e6b-6443787e8f1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:38.920541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb1fed-0ce5-45de-9e6b-6443787e8f1b service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:38.920822 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb1fed-0ce5-45de-9e6b-6443787e8f1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:38.921094 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb1fed-0ce5-45de-9e6b-6443787e8f1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:38.930420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb1fed-0ce5-45de-9e6b-6443787e8f1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:38.931899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb1fed-0ce5-45de-9e6b-6443787e8f1b service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:38.941028 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 923/1888] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:39.002285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e9b63-ebb6-4311-90b2-fff66e8222eb None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:39.012892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e9b63-ebb6-4311-90b2-fff66e8222eb None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:39.016879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41b3c4-de60-4c6c-b311-2e6ccecef9a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:39.024108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41b3c4-de60-4c6c-b311-2e6ccecef9a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:39.024108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41b3c4-de60-4c6c-b311-2e6ccecef9a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:39.024108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41b3c4-de60-4c6c-b311-2e6ccecef9a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:39.086025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41b3c4-de60-4c6c-b311-2e6ccecef9a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:39.087523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41b3c4-de60-4c6c-b311-2e6ccecef9a3 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:39.096605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 966/1889] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:39.349381 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb1fed-0ce5-45de-9e6b-6443787e8f1b service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:39.350759 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e0eb1fed-0ce5-45de-9e6b-6443787e8f1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:39.413407 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb1fed-0ce5-45de-9e6b-6443787e8f1b service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:39.418156 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f535c-c9ab-433e-a7d0-9baf1955d3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:39.419011 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f535c-c9ab-433e-a7d0-9baf1955d3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:39.419289 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f535c-c9ab-433e-a7d0-9baf1955d3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:39.419558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f535c-c9ab-433e-a7d0-9baf1955d3fe admin admin] PATH_INFO: `/v3/users/65ba059d02b240cb876a90b300c1b416` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:39.420751 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f535c-c9ab-433e-a7d0-9baf1955d3fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=65ba059d02b240cb876a90b300c1b416)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:39.422639 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f535c-c9ab-433e-a7d0-9baf1955d3fe admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:39.678529 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4b3f535c-c9ab-433e-a7d0-9baf1955d3fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65ba059d02b240cb876a90b300c1b416'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:39.679185 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4b3f535c-c9ab-433e-a7d0-9baf1955d3fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65ba059d02b240cb876a90b300c1b416'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:39.691367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4b3f535c-c9ab-433e-a7d0-9baf1955d3fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65ba059d02b240cb876a90b300c1b416'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:39.692013 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4b3f535c-c9ab-433e-a7d0-9baf1955d3fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65ba059d02b240cb876a90b300c1b416'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:39.698902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4b3f535c-c9ab-433e-a7d0-9baf1955d3fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65ba059d02b240cb876a90b300c1b416'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:39.797686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 924/1890] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:39 2022] DELETE /identity/v3/users/65ba059d02b240cb876a90b300c1b416 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:39.805963 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e520a96-933a-4de4-841a-c184818a615e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:39.806276 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e520a96-933a-4de4-841a-c184818a615e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:39.806546 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e520a96-933a-4de4-841a-c184818a615e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:39.822975 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-8e520a96-933a-4de4-841a-c184818a615e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:39.824204 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8e520a96-933a-4de4-841a-c184818a615e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:39.887492 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 967/1891] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:39.897836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f535c-c9ab-433e-a7d0-9baf1955d3fe admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:39.899333 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4b3f535c-c9ab-433e-a7d0-9baf1955d3fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:39.955845 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f535c-c9ab-433e-a7d0-9baf1955d3fe admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:39.959743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e7430-03d2-4a8e-82ee-d1b280c6de06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:39.960398 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e7430-03d2-4a8e-82ee-d1b280c6de06 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:39.960701 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e7430-03d2-4a8e-82ee-d1b280c6de06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:39.960983 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e7430-03d2-4a8e-82ee-d1b280c6de06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:39.970760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e7430-03d2-4a8e-82ee-d1b280c6de06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:39.972237 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e7430-03d2-4a8e-82ee-d1b280c6de06 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:39.982295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 925/1892] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:40.553777 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e520a96-933a-4de4-841a-c184818a615e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:40.556347 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8e520a96-933a-4de4-841a-c184818a615e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:40.584369 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e520a96-933a-4de4-841a-c184818a615e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:40.595213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fdd8f-9841-4b5f-ade0-84c9c2b80f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:40.596451 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fdd8f-9841-4b5f-ade0-84c9c2b80f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:40.596806 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fdd8f-9841-4b5f-ade0-84c9c2b80f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:40.597153 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fdd8f-9841-4b5f-ade0-84c9c2b80f64 admin admin] PATH_INFO: `/v3/projects/7ae0fe7c6e8447ef8482d7741a2bb7d3` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:40.599864 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fdd8f-9841-4b5f-ade0-84c9c2b80f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ae0fe7c6e8447ef8482d7741a2bb7d3)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:40.602941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fdd8f-9841-4b5f-ade0-84c9c2b80f64 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:40.730556 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-cb1fdd8f-9841-4b5f-ade0-84c9c2b80f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ae0fe7c6e8447ef8482d7741a2bb7d3', 'request_id': 'req-cb1fdd8f-9841-4b5f-ade0-84c9c2b80f64'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:40.803924 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-cb1fdd8f-9841-4b5f-ade0-84c9c2b80f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ae0fe7c6e8447ef8482d7741a2bb7d3', 'request_id': 'req-cb1fdd8f-9841-4b5f-ade0-84c9c2b80f64'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:40.810507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-cb1fdd8f-9841-4b5f-ade0-84c9c2b80f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ae0fe7c6e8447ef8482d7741a2bb7d3', 'request_id': 'req-cb1fdd8f-9841-4b5f-ade0-84c9c2b80f64'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:40.821941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-cb1fdd8f-9841-4b5f-ade0-84c9c2b80f64 admin admin] The token cache is being invalidate because project 7ae0fe7c6e8447ef8482d7741a2bb7d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:40.822139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-cb1fdd8f-9841-4b5f-ade0-84c9c2b80f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:40.822775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-cb1fdd8f-9841-4b5f-ade0-84c9c2b80f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:40.824375 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 968/1893] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:40 2022] DELETE /identity/v3/projects/7ae0fe7c6e8447ef8482d7741a2bb7d3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:40.828476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e7430-03d2-4a8e-82ee-d1b280c6de06 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:40.843196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e7430-03d2-4a8e-82ee-d1b280c6de06 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:40.897884 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af2399-15de-4b62-824a-61d1874af2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:40.899317 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af2399-15de-4b62-824a-61d1874af2a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:40.899596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af2399-15de-4b62-824a-61d1874af2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:40.899907 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af2399-15de-4b62-824a-61d1874af2a1 admin admin] PATH_INFO: `/v3/users/1861209fcc4041e89c17ac9b9904028a` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:40.904282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af2399-15de-4b62-824a-61d1874af2a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1861209fcc4041e89c17ac9b9904028a)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:40.906692 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af2399-15de-4b62-824a-61d1874af2a1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:41.462134 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-31af2399-15de-4b62-824a-61d1874af2a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1861209fcc4041e89c17ac9b9904028a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:41.462787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-31af2399-15de-4b62-824a-61d1874af2a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1861209fcc4041e89c17ac9b9904028a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:41.474305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-31af2399-15de-4b62-824a-61d1874af2a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1861209fcc4041e89c17ac9b9904028a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:41.474941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-31af2399-15de-4b62-824a-61d1874af2a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1861209fcc4041e89c17ac9b9904028a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:41.482086 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-31af2399-15de-4b62-824a-61d1874af2a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1861209fcc4041e89c17ac9b9904028a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:41.626253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 926/1894] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:40 2022] DELETE /identity/v3/users/1861209fcc4041e89c17ac9b9904028a => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:42.081162 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fdd8f-9841-4b5f-ade0-84c9c2b80f64 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:42.081712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-cb1fdd8f-9841-4b5f-ade0-84c9c2b80f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:42.095172 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fdd8f-9841-4b5f-ade0-84c9c2b80f64 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:42.169477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a653d-66c8-4c6a-b326-1bae6b21f46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:42.170361 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a653d-66c8-4c6a-b326-1bae6b21f46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:42.171724 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a653d-66c8-4c6a-b326-1bae6b21f46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:42.172909 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a653d-66c8-4c6a-b326-1bae6b21f46a admin admin] PATH_INFO: `/v3/projects/da3ce04d446e4406aef6f964fe87a896` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:42.174324 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a653d-66c8-4c6a-b326-1bae6b21f46a admin admin] RBAC: Authorizing `identity:delete_project(project_id=da3ce04d446e4406aef6f964fe87a896)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:42.176265 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a653d-66c8-4c6a-b326-1bae6b21f46a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:42.374664 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3e6a653d-66c8-4c6a-b326-1bae6b21f46a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da3ce04d446e4406aef6f964fe87a896', 'request_id': 'req-3e6a653d-66c8-4c6a-b326-1bae6b21f46a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:42.437966 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3e6a653d-66c8-4c6a-b326-1bae6b21f46a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da3ce04d446e4406aef6f964fe87a896', 'request_id': 'req-3e6a653d-66c8-4c6a-b326-1bae6b21f46a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:42.444158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3e6a653d-66c8-4c6a-b326-1bae6b21f46a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da3ce04d446e4406aef6f964fe87a896', 'request_id': 'req-3e6a653d-66c8-4c6a-b326-1bae6b21f46a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:42.456192 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3e6a653d-66c8-4c6a-b326-1bae6b21f46a admin admin] The token cache is being invalidate because project da3ce04d446e4406aef6f964fe87a896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:42.456624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3e6a653d-66c8-4c6a-b326-1bae6b21f46a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:42.457405 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3e6a653d-66c8-4c6a-b326-1bae6b21f46a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:42.459060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 969/1895] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:42 2022] DELETE /identity/v3/projects/da3ce04d446e4406aef6f964fe87a896 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:42.464466 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c589b5-54a6-4e5b-b3a4-3383b96bb101 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:42.465034 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c589b5-54a6-4e5b-b3a4-3383b96bb101 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:42.465178 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c589b5-54a6-4e5b-b3a4-3383b96bb101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:42.482841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-17c589b5-54a6-4e5b-b3a4-3383b96bb101 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:42.484082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-17c589b5-54a6-4e5b-b3a4-3383b96bb101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:42.558015 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 927/1896] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:42.558438 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1b799-939b-4f69-a3be-b0500bc1b496 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:42.558721 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1b799-939b-4f69-a3be-b0500bc1b496 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:42.558996 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1b799-939b-4f69-a3be-b0500bc1b496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:42.578860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3de1b799-939b-4f69-a3be-b0500bc1b496 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:42.580104 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3de1b799-939b-4f69-a3be-b0500bc1b496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:42.592385 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 970/1897] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:42.593587 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c589b5-54a6-4e5b-b3a4-3383b96bb101 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:42.608032 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c589b5-54a6-4e5b-b3a4-3383b96bb101 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:42.613629 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b217c-775a-476f-af33-ba09acb7e24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:42.614224 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b217c-775a-476f-af33-ba09acb7e24b admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:42.614506 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b217c-775a-476f-af33-ba09acb7e24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:42.614775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b217c-775a-476f-af33-ba09acb7e24b admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:42.615513 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b217c-775a-476f-af33-ba09acb7e24b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:52:42.615854 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b217c-775a-476f-af33-ba09acb7e24b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:42.618077 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b217c-775a-476f-af33-ba09acb7e24b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:42.632244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 928/1898] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:52:42.638764 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1b799-939b-4f69-a3be-b0500bc1b496 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:42.649514 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1b799-939b-4f69-a3be-b0500bc1b496 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:42.654940 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edfdb0-3709-4935-91e8-19953e5fd588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:42.655791 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edfdb0-3709-4935-91e8-19953e5fd588 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:42.656179 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edfdb0-3709-4935-91e8-19953e5fd588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:42.656575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edfdb0-3709-4935-91e8-19953e5fd588 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:42.657392 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edfdb0-3709-4935-91e8-19953e5fd588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:42.659631 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edfdb0-3709-4935-91e8-19953e5fd588 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:42.792021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 971/1899] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:42 2022] POST /identity/v3/projects => generated 369 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:52:42.794452 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b217c-775a-476f-af33-ba09acb7e24b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:42.807639 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b217c-775a-476f-af33-ba09acb7e24b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:42.865807 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2326c-1c26-4cb9-b1a6-f6d9b891e867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:42.866480 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2326c-1c26-4cb9-b1a6-f6d9b891e867 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:42.866765 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2326c-1c26-4cb9-b1a6-f6d9b891e867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:42.867057 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2326c-1c26-4cb9-b1a6-f6d9b891e867 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:42.868352 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2326c-1c26-4cb9-b1a6-f6d9b891e867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:42.870270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2326c-1c26-4cb9-b1a6-f6d9b891e867 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:43.031294 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 929/1900] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:42 2022] POST /identity/v3/users => generated 285 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:52:43.032657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edfdb0-3709-4935-91e8-19953e5fd588 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:43.043324 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edfdb0-3709-4935-91e8-19953e5fd588 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:43.048114 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba1fa8-d687-44b7-b69e-34f49828e024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:43.048762 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba1fa8-d687-44b7-b69e-34f49828e024 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:43.049052 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba1fa8-d687-44b7-b69e-34f49828e024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:43.049333 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba1fa8-d687-44b7-b69e-34f49828e024 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:43.050070 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba1fa8-d687-44b7-b69e-34f49828e024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:43.051673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba1fa8-d687-44b7-b69e-34f49828e024 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:43.063580 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 972/1901] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:43.067798 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2326c-1c26-4cb9-b1a6-f6d9b891e867 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:43.078755 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2326c-1c26-4cb9-b1a6-f6d9b891e867 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:43.083639 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a189c3b-7a8b-41ed-aac4-ad544b9e4ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:43.084571 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a189c3b-7a8b-41ed-aac4-ad544b9e4ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:43.084927 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a189c3b-7a8b-41ed-aac4-ad544b9e4ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:43.085211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a189c3b-7a8b-41ed-aac4-ad544b9e4ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:43.086189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a189c3b-7a8b-41ed-aac4-ad544b9e4ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:43.087905 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a189c3b-7a8b-41ed-aac4-ad544b9e4ff1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:43.100329 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 930/1902] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:43.104552 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba1fa8-d687-44b7-b69e-34f49828e024 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:43.115253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba1fa8-d687-44b7-b69e-34f49828e024 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:43.124101 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13615a37-4a0f-44b0-b25d-8b34e3ac3bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:43.124101 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13615a37-4a0f-44b0-b25d-8b34e3ac3bb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:43.124101 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13615a37-4a0f-44b0-b25d-8b34e3ac3bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:43.124101 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13615a37-4a0f-44b0-b25d-8b34e3ac3bb4 admin admin] PATH_INFO: `/v3/projects/6ae09d0d89e447c09f576dffa1148050/users/c54bf9a45ae6446aa17241b557bd3390/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:43.138376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13615a37-4a0f-44b0-b25d-8b34e3ac3bb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae09d0d89e447c09f576dffa1148050, user_id=c54bf9a45ae6446aa17241b557bd3390, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:43.141073 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13615a37-4a0f-44b0-b25d-8b34e3ac3bb4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:43.273961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 973/1903] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:43 2022] PUT /identity/v3/projects/6ae09d0d89e447c09f576dffa1148050/users/c54bf9a45ae6446aa17241b557bd3390/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:43.285231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1634007-9576-4e1e-9d48-9bed90b3905a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:43.285665 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1634007-9576-4e1e-9d48-9bed90b3905a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:43.290166 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1634007-9576-4e1e-9d48-9bed90b3905a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:43.318808 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f1634007-9576-4e1e-9d48-9bed90b3905a None None] MFA Rules not processed for user `c54bf9a45ae6446aa17241b557bd3390`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:43.319836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f1634007-9576-4e1e-9d48-9bed90b3905a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:43.402878 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 931/1904] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:43.407070 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13615a37-4a0f-44b0-b25d-8b34e3ac3bb4 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:43.478799 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13615a37-4a0f-44b0-b25d-8b34e3ac3bb4 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:43.483663 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e373d0-f9bb-4873-9a19-af5b4049dd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:43.484362 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e373d0-f9bb-4873-9a19-af5b4049dd82 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:43.484647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e373d0-f9bb-4873-9a19-af5b4049dd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:43.484922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e373d0-f9bb-4873-9a19-af5b4049dd82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:43.485627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e373d0-f9bb-4873-9a19-af5b4049dd82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:43.487549 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e373d0-f9bb-4873-9a19-af5b4049dd82 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:43.626012 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 974/1905] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:43 2022] POST /identity/v3/projects => generated 365 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:52:43.631152 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1634007-9576-4e1e-9d48-9bed90b3905a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:43.647623 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1634007-9576-4e1e-9d48-9bed90b3905a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:43.726854 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e635da-2294-47b2-adc6-ad2829117cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:43.726854 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e635da-2294-47b2-adc6-ad2829117cde admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:43.726854 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e635da-2294-47b2-adc6-ad2829117cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:43.726854 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e635da-2294-47b2-adc6-ad2829117cde admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:43.727285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e635da-2294-47b2-adc6-ad2829117cde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:43.728800 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e635da-2294-47b2-adc6-ad2829117cde admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:43.818405 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 932/1906] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:43 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:43.822367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e373d0-f9bb-4873-9a19-af5b4049dd82 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:43.832583 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e373d0-f9bb-4873-9a19-af5b4049dd82 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:43.838360 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137a72c-8232-4a3d-9967-a6cb4167acba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:43.839032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137a72c-8232-4a3d-9967-a6cb4167acba admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:43.839311 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137a72c-8232-4a3d-9967-a6cb4167acba admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:43.839579 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137a72c-8232-4a3d-9967-a6cb4167acba admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:43.840357 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137a72c-8232-4a3d-9967-a6cb4167acba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:43.842046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137a72c-8232-4a3d-9967-a6cb4167acba admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:43.853653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 975/1907] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:43.857858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e635da-2294-47b2-adc6-ad2829117cde admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:43.868497 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e635da-2294-47b2-adc6-ad2829117cde admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:43.873453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d6df2-63b9-4728-b529-ef96b3ee02f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:43.874407 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d6df2-63b9-4728-b529-ef96b3ee02f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:43.875919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d6df2-63b9-4728-b529-ef96b3ee02f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:43.875919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d6df2-63b9-4728-b529-ef96b3ee02f5 admin admin] PATH_INFO: `/v3/projects/0802984b169744faa6cb4aa708460a5b/users/7208ee50cc8149a48c4616dd2bac64d2/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:43.890616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d6df2-63b9-4728-b529-ef96b3ee02f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0802984b169744faa6cb4aa708460a5b, user_id=7208ee50cc8149a48c4616dd2bac64d2, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:43.893388 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d6df2-63b9-4728-b529-ef96b3ee02f5 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:43.998689 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 933/1908] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:43 2022] PUT /identity/v3/projects/0802984b169744faa6cb4aa708460a5b/users/7208ee50cc8149a48c4616dd2bac64d2/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:44.002542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137a72c-8232-4a3d-9967-a6cb4167acba admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:44.012561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137a72c-8232-4a3d-9967-a6cb4167acba admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:44.082868 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f5908-2937-4e0c-bc84-cbc02765afaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:44.082868 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f5908-2937-4e0c-bc84-cbc02765afaf admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:44.082868 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f5908-2937-4e0c-bc84-cbc02765afaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:44.082868 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f5908-2937-4e0c-bc84-cbc02765afaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:44.083270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f5908-2937-4e0c-bc84-cbc02765afaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:44.083270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f5908-2937-4e0c-bc84-cbc02765afaf admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:44.094322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 976/1909] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:44.098305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d6df2-63b9-4728-b529-ef96b3ee02f5 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:44.109643 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d6df2-63b9-4728-b529-ef96b3ee02f5 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:44.114395 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463255ad-fe20-44a8-99af-ceabe9102a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:44.115278 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463255ad-fe20-44a8-99af-ceabe9102a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:44.115559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463255ad-fe20-44a8-99af-ceabe9102a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:44.115864 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463255ad-fe20-44a8-99af-ceabe9102a16 admin admin] PATH_INFO: `/v3/projects/0802984b169744faa6cb4aa708460a5b/users/7208ee50cc8149a48c4616dd2bac64d2/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:44.120395 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463255ad-fe20-44a8-99af-ceabe9102a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0802984b169744faa6cb4aa708460a5b, user_id=7208ee50cc8149a48c4616dd2bac64d2, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:44.123390 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463255ad-fe20-44a8-99af-ceabe9102a16 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:44.134281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 934/1910] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:44 2022] PUT /identity/v3/projects/0802984b169744faa6cb4aa708460a5b/users/7208ee50cc8149a48c4616dd2bac64d2/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:44.144627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35f237-1657-4765-97fa-5e94269a6ff1 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:44.145542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35f237-1657-4765-97fa-5e94269a6ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:44.146056 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35f237-1657-4765-97fa-5e94269a6ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:44.178505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-7d35f237-1657-4765-97fa-5e94269a6ff1 None None] MFA Rules not processed for user `7208ee50cc8149a48c4616dd2bac64d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:44.180005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7d35f237-1657-4765-97fa-5e94269a6ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:44.267649 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 977/1911] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:44 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:44.282589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463255ad-fe20-44a8-99af-ceabe9102a16 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:44.284436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-463255ad-fe20-44a8-99af-ceabe9102a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:44.356176 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463255ad-fe20-44a8-99af-ceabe9102a16 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:44.367191 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d376b4-07f4-43f4-bdf0-3adacf710e29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:44.368309 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d376b4-07f4-43f4-bdf0-3adacf710e29 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:44.368798 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d376b4-07f4-43f4-bdf0-3adacf710e29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:44.370086 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d376b4-07f4-43f4-bdf0-3adacf710e29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:44.381437 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d376b4-07f4-43f4-bdf0-3adacf710e29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:44.383496 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d376b4-07f4-43f4-bdf0-3adacf710e29 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:44.393464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 935/1912] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:44.551286 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35f237-1657-4765-97fa-5e94269a6ff1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:44.561557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35f237-1657-4765-97fa-5e94269a6ff1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:44.565937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6743c-97df-484c-b3ea-cb4aa495fb83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:44.566593 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6743c-97df-484c-b3ea-cb4aa495fb83 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:44.566878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6743c-97df-484c-b3ea-cb4aa495fb83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:44.567180 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6743c-97df-484c-b3ea-cb4aa495fb83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:44.625546 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6743c-97df-484c-b3ea-cb4aa495fb83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:44.626991 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6743c-97df-484c-b3ea-cb4aa495fb83 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:44.636118 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 978/1913] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:45.506567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d376b4-07f4-43f4-bdf0-3adacf710e29 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:45.508246 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-60d376b4-07f4-43f4-bdf0-3adacf710e29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:45.575646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d376b4-07f4-43f4-bdf0-3adacf710e29 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:45.580283 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40a223-c313-459f-97aa-44ad5f4fdc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:45.581147 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40a223-c313-459f-97aa-44ad5f4fdc6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:45.581422 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40a223-c313-459f-97aa-44ad5f4fdc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:45.581689 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40a223-c313-459f-97aa-44ad5f4fdc6a admin admin] PATH_INFO: `/v3/users/340fcb8721eb4ed6b1330a1f6037da61` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:45.582931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40a223-c313-459f-97aa-44ad5f4fdc6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=340fcb8721eb4ed6b1330a1f6037da61)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:45.584988 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40a223-c313-459f-97aa-44ad5f4fdc6a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:45.629183 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6743c-97df-484c-b3ea-cb4aa495fb83 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:45.630708 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9fc6743c-97df-484c-b3ea-cb4aa495fb83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:45.644576 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6743c-97df-484c-b3ea-cb4aa495fb83 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:45.649623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25a593-ebf5-4837-bba6-6522c73ff45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:45.650503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25a593-ebf5-4837-bba6-6522c73ff45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:45.650787 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25a593-ebf5-4837-bba6-6522c73ff45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:45.651065 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25a593-ebf5-4837-bba6-6522c73ff45f admin admin] PATH_INFO: `/v3/users/a609fa38165c461c999ecd6a0c85be8c` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:45.652305 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25a593-ebf5-4837-bba6-6522c73ff45f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a609fa38165c461c999ecd6a0c85be8c)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:45.654219 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25a593-ebf5-4837-bba6-6522c73ff45f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:45.845237 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0f40a223-c313-459f-97aa-44ad5f4fdc6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '340fcb8721eb4ed6b1330a1f6037da61'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:45.845873 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0f40a223-c313-459f-97aa-44ad5f4fdc6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '340fcb8721eb4ed6b1330a1f6037da61'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:45.858111 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0f40a223-c313-459f-97aa-44ad5f4fdc6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '340fcb8721eb4ed6b1330a1f6037da61'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:45.858775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0f40a223-c313-459f-97aa-44ad5f4fdc6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '340fcb8721eb4ed6b1330a1f6037da61'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:45.865523 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0f40a223-c313-459f-97aa-44ad5f4fdc6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '340fcb8721eb4ed6b1330a1f6037da61'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:45.881614 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-4f25a593-ebf5-4837-bba6-6522c73ff45f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a609fa38165c461c999ecd6a0c85be8c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:45.882321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-4f25a593-ebf5-4837-bba6-6522c73ff45f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a609fa38165c461c999ecd6a0c85be8c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:45.882920 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-4f25a593-ebf5-4837-bba6-6522c73ff45f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a609fa38165c461c999ecd6a0c85be8c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:45.894419 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-4f25a593-ebf5-4837-bba6-6522c73ff45f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a609fa38165c461c999ecd6a0c85be8c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:45.901141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-4f25a593-ebf5-4837-bba6-6522c73ff45f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a609fa38165c461c999ecd6a0c85be8c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:45.940321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 936/1914] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:45 2022] DELETE /identity/v3/users/340fcb8721eb4ed6b1330a1f6037da61 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:45.941244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40a223-c313-459f-97aa-44ad5f4fdc6a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:45.942597 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0f40a223-c313-459f-97aa-44ad5f4fdc6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:46.005999 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40a223-c313-459f-97aa-44ad5f4fdc6a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:46.011030 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84270e-80ef-44be-be9c-0b6447f034a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:46.011920 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84270e-80ef-44be-be9c-0b6447f034a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:46.012201 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84270e-80ef-44be-be9c-0b6447f034a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:46.012469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84270e-80ef-44be-be9c-0b6447f034a2 admin admin] PATH_INFO: `/v3/users/9b2e437b7392426287f1b770ffa7d18a` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:46.013642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84270e-80ef-44be-be9c-0b6447f034a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b2e437b7392426287f1b770ffa7d18a)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:46.015583 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84270e-80ef-44be-be9c-0b6447f034a2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:46.032462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 979/1915] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:45 2022] DELETE /identity/v3/users/a609fa38165c461c999ecd6a0c85be8c => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:52:46.034004 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd76161-04f8-4873-b5ef-94b839842bca None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:46.034290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd76161-04f8-4873-b5ef-94b839842bca None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:46.034566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd76161-04f8-4873-b5ef-94b839842bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:46.051303 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-2dd76161-04f8-4873-b5ef-94b839842bca None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:46.053059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2dd76161-04f8-4873-b5ef-94b839842bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:46.109945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 980/1916] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:46.111235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ff280-53cd-4fc2-9ed8-abe16e18b111 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:46.111520 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ff280-53cd-4fc2-9ed8-abe16e18b111 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:46.111831 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ff280-53cd-4fc2-9ed8-abe16e18b111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:46.129378 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3a7ff280-53cd-4fc2-9ed8-abe16e18b111 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:46.130558 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3a7ff280-53cd-4fc2-9ed8-abe16e18b111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:46.138718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 981/1917] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:46.139473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ff280-53cd-4fc2-9ed8-abe16e18b111 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:46.140691 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3a7ff280-53cd-4fc2-9ed8-abe16e18b111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:46.195837 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ff280-53cd-4fc2-9ed8-abe16e18b111 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:46.199478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec3532-ce1e-4724-8276-d9a7526d2402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:46.200163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec3532-ce1e-4724-8276-d9a7526d2402 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:46.200493 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec3532-ce1e-4724-8276-d9a7526d2402 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:46.200764 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec3532-ce1e-4724-8276-d9a7526d2402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:46.209641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec3532-ce1e-4724-8276-d9a7526d2402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:46.211097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec3532-ce1e-4724-8276-d9a7526d2402 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:46.220168 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 982/1918] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:46.220938 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec3532-ce1e-4724-8276-d9a7526d2402 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:46.222224 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f2ec3532-ce1e-4724-8276-d9a7526d2402 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:46.232401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec3532-ce1e-4724-8276-d9a7526d2402 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:46.236098 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056efff6-f931-40e6-85d2-5f94ee1905c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:46.236717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056efff6-f931-40e6-85d2-5f94ee1905c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:46.236999 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056efff6-f931-40e6-85d2-5f94ee1905c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:46.237274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056efff6-f931-40e6-85d2-5f94ee1905c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:46.246637 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056efff6-f931-40e6-85d2-5f94ee1905c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:46.248077 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056efff6-f931-40e6-85d2-5f94ee1905c0 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:46.257371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 983/1919] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:46.316481 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8b84270e-80ef-44be-be9c-0b6447f034a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b2e437b7392426287f1b770ffa7d18a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:46.317169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8b84270e-80ef-44be-be9c-0b6447f034a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b2e437b7392426287f1b770ffa7d18a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:46.329879 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8b84270e-80ef-44be-be9c-0b6447f034a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b2e437b7392426287f1b770ffa7d18a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:46.330706 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8b84270e-80ef-44be-be9c-0b6447f034a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b2e437b7392426287f1b770ffa7d18a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:46.338901 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8b84270e-80ef-44be-be9c-0b6447f034a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b2e437b7392426287f1b770ffa7d18a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:46.444406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 937/1920] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:45 2022] DELETE /identity/v3/users/9b2e437b7392426287f1b770ffa7d18a => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:46.909039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056efff6-f931-40e6-85d2-5f94ee1905c0 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:46.910568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-056efff6-f931-40e6-85d2-5f94ee1905c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:46.931288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84270e-80ef-44be-be9c-0b6447f034a2 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:46.933331 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8b84270e-80ef-44be-be9c-0b6447f034a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:46.943183 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056efff6-f931-40e6-85d2-5f94ee1905c0 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:47.011484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412f7c2-8987-4175-a27e-b689c38ea2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:47.012736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412f7c2-8987-4175-a27e-b689c38ea2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:47.013363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412f7c2-8987-4175-a27e-b689c38ea2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:47.013827 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412f7c2-8987-4175-a27e-b689c38ea2aa admin admin] PATH_INFO: `/v3/projects/eb0362d10b534f088d049f6c3d565bd4` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:47.016362 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412f7c2-8987-4175-a27e-b689c38ea2aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb0362d10b534f088d049f6c3d565bd4)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:47.021552 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412f7c2-8987-4175-a27e-b689c38ea2aa admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:47.035724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84270e-80ef-44be-be9c-0b6447f034a2 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:47.046456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1105f98-9938-4a0a-9130-5fe03a83b70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:47.047349 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1105f98-9938-4a0a-9130-5fe03a83b70e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:47.047621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1105f98-9938-4a0a-9130-5fe03a83b70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:47.057888 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1105f98-9938-4a0a-9130-5fe03a83b70e admin admin] PATH_INFO: `/v3/projects/6f0c687e191f471099021efbd2330b37` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:47.057888 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1105f98-9938-4a0a-9130-5fe03a83b70e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f0c687e191f471099021efbd2330b37)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:47.057888 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1105f98-9938-4a0a-9130-5fe03a83b70e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:47.169632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d412f7c2-8987-4175-a27e-b689c38ea2aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb0362d10b534f088d049f6c3d565bd4', 'request_id': 'req-d412f7c2-8987-4175-a27e-b689c38ea2aa'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:47.295792 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d412f7c2-8987-4175-a27e-b689c38ea2aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb0362d10b534f088d049f6c3d565bd4', 'request_id': 'req-d412f7c2-8987-4175-a27e-b689c38ea2aa'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:47.301414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d412f7c2-8987-4175-a27e-b689c38ea2aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb0362d10b534f088d049f6c3d565bd4', 'request_id': 'req-d412f7c2-8987-4175-a27e-b689c38ea2aa'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:47.315438 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d412f7c2-8987-4175-a27e-b689c38ea2aa admin admin] The token cache is being invalidate because project eb0362d10b534f088d049f6c3d565bd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:47.315632 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1105f98-9938-4a0a-9130-5fe03a83b70e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f0c687e191f471099021efbd2330b37', 'request_id': 'req-f1105f98-9938-4a0a-9130-5fe03a83b70e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:47.317892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d412f7c2-8987-4175-a27e-b689c38ea2aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:47.317892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d412f7c2-8987-4175-a27e-b689c38ea2aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:47.318509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 984/1921] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:46 2022] DELETE /identity/v3/projects/eb0362d10b534f088d049f6c3d565bd4 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:47.319332 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412f7c2-8987-4175-a27e-b689c38ea2aa admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:47.321210 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d412f7c2-8987-4175-a27e-b689c38ea2aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:47.387978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412f7c2-8987-4175-a27e-b689c38ea2aa admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:47.403649 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1105f98-9938-4a0a-9130-5fe03a83b70e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f0c687e191f471099021efbd2330b37', 'request_id': 'req-f1105f98-9938-4a0a-9130-5fe03a83b70e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:47.412681 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1105f98-9938-4a0a-9130-5fe03a83b70e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f0c687e191f471099021efbd2330b37', 'request_id': 'req-f1105f98-9938-4a0a-9130-5fe03a83b70e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:47.425045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1105f98-9938-4a0a-9130-5fe03a83b70e admin admin] The token cache is being invalidate because project 6f0c687e191f471099021efbd2330b37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:47.425414 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1105f98-9938-4a0a-9130-5fe03a83b70e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:47.426204 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1105f98-9938-4a0a-9130-5fe03a83b70e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:47.428648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 938/1922] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:46 2022] DELETE /identity/v3/projects/6f0c687e191f471099021efbd2330b37 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:47.428952 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1105f98-9938-4a0a-9130-5fe03a83b70e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:47.430245 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f1105f98-9938-4a0a-9130-5fe03a83b70e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:47.468616 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80639c22-db4f-4c68-9a40-527b2faaff35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:47.473790 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80639c22-db4f-4c68-9a40-527b2faaff35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:47.474077 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80639c22-db4f-4c68-9a40-527b2faaff35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:47.474355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80639c22-db4f-4c68-9a40-527b2faaff35 admin admin] PATH_INFO: `/v3/projects/ecaca50e2b78466bb959545d64015071` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:47.475655 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80639c22-db4f-4c68-9a40-527b2faaff35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecaca50e2b78466bb959545d64015071)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:47.478247 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80639c22-db4f-4c68-9a40-527b2faaff35 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:47.509148 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1105f98-9938-4a0a-9130-5fe03a83b70e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:47.513819 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd8134-38a0-48fc-878b-628bf1daca60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:47.514678 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd8134-38a0-48fc-878b-628bf1daca60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:47.514958 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd8134-38a0-48fc-878b-628bf1daca60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:47.515230 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd8134-38a0-48fc-878b-628bf1daca60 admin admin] PATH_INFO: `/v3/users/e53f49d49e9d46abbac5f5c4b2b035d2` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:47.516545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd8134-38a0-48fc-878b-628bf1daca60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e53f49d49e9d46abbac5f5c4b2b035d2)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:47.518513 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd8134-38a0-48fc-878b-628bf1daca60 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:47.666951 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-80639c22-db4f-4c68-9a40-527b2faaff35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecaca50e2b78466bb959545d64015071', 'request_id': 'req-80639c22-db4f-4c68-9a40-527b2faaff35'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:47.786575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-80639c22-db4f-4c68-9a40-527b2faaff35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecaca50e2b78466bb959545d64015071', 'request_id': 'req-80639c22-db4f-4c68-9a40-527b2faaff35'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:47.793549 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-80639c22-db4f-4c68-9a40-527b2faaff35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecaca50e2b78466bb959545d64015071', 'request_id': 'req-80639c22-db4f-4c68-9a40-527b2faaff35'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:47.804838 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-80639c22-db4f-4c68-9a40-527b2faaff35 admin admin] The token cache is being invalidate because project ecaca50e2b78466bb959545d64015071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:47.805107 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-80639c22-db4f-4c68-9a40-527b2faaff35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:47.805712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-80639c22-db4f-4c68-9a40-527b2faaff35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:47.807286 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 985/1923] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:47 2022] DELETE /identity/v3/projects/ecaca50e2b78466bb959545d64015071 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:47.808168 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80639c22-db4f-4c68-9a40-527b2faaff35 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:47.809446 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-80639c22-db4f-4c68-9a40-527b2faaff35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:47.847916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-03dd8134-38a0-48fc-878b-628bf1daca60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e53f49d49e9d46abbac5f5c4b2b035d2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:47.848579 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-03dd8134-38a0-48fc-878b-628bf1daca60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e53f49d49e9d46abbac5f5c4b2b035d2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:47.861358 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-03dd8134-38a0-48fc-878b-628bf1daca60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e53f49d49e9d46abbac5f5c4b2b035d2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:47.862068 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-03dd8134-38a0-48fc-878b-628bf1daca60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e53f49d49e9d46abbac5f5c4b2b035d2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:47.869810 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-03dd8134-38a0-48fc-878b-628bf1daca60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e53f49d49e9d46abbac5f5c4b2b035d2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:47.884597 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80639c22-db4f-4c68-9a40-527b2faaff35 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:47.889599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d6c3f-e648-4cd5-bbf3-751f3f3ba4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:47.890471 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d6c3f-e648-4cd5-bbf3-751f3f3ba4f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:47.890757 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d6c3f-e648-4cd5-bbf3-751f3f3ba4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:47.891037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d6c3f-e648-4cd5-bbf3-751f3f3ba4f2 admin admin] PATH_INFO: `/v3/users/b936954ef46b43c78408f026d4f59107` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:47.892270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d6c3f-e648-4cd5-bbf3-751f3f3ba4f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b936954ef46b43c78408f026d4f59107)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:47.894295 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d6c3f-e648-4cd5-bbf3-751f3f3ba4f2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:47.957959 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 939/1924] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:47 2022] DELETE /identity/v3/users/e53f49d49e9d46abbac5f5c4b2b035d2 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:47.959018 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd8134-38a0-48fc-878b-628bf1daca60 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:47.960635 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-03dd8134-38a0-48fc-878b-628bf1daca60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:48.037998 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd8134-38a0-48fc-878b-628bf1daca60 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:48.046052 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3fac1-859a-496b-934a-6ec9971aee1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:48.047310 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3fac1-859a-496b-934a-6ec9971aee1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:48.047673 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3fac1-859a-496b-934a-6ec9971aee1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:48.048097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3fac1-859a-496b-934a-6ec9971aee1f admin admin] PATH_INFO: `/v3/users/4df2c64c32ab4cf48240bebeafd19ac0` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:48.049505 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3fac1-859a-496b-934a-6ec9971aee1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4df2c64c32ab4cf48240bebeafd19ac0)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:48.051672 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3fac1-859a-496b-934a-6ec9971aee1f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:48.148384 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f02d6c3f-e648-4cd5-bbf3-751f3f3ba4f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b936954ef46b43c78408f026d4f59107'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:48.149557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f02d6c3f-e648-4cd5-bbf3-751f3f3ba4f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b936954ef46b43c78408f026d4f59107'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:48.150166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f02d6c3f-e648-4cd5-bbf3-751f3f3ba4f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b936954ef46b43c78408f026d4f59107'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:48.161553 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f02d6c3f-e648-4cd5-bbf3-751f3f3ba4f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b936954ef46b43c78408f026d4f59107'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:48.168612 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f02d6c3f-e648-4cd5-bbf3-751f3f3ba4f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b936954ef46b43c78408f026d4f59107'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:48.301129 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 986/1925] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:47 2022] DELETE /identity/v3/users/b936954ef46b43c78408f026d4f59107 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:48.302055 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d6c3f-e648-4cd5-bbf3-751f3f3ba4f2 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:48.303360 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f02d6c3f-e648-4cd5-bbf3-751f3f3ba4f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:48.310861 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-64e3fac1-859a-496b-934a-6ec9971aee1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4df2c64c32ab4cf48240bebeafd19ac0'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:48.311680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-64e3fac1-859a-496b-934a-6ec9971aee1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4df2c64c32ab4cf48240bebeafd19ac0'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:48.323872 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-64e3fac1-859a-496b-934a-6ec9971aee1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4df2c64c32ab4cf48240bebeafd19ac0'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:48.324582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-64e3fac1-859a-496b-934a-6ec9971aee1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4df2c64c32ab4cf48240bebeafd19ac0'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:48.331386 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-64e3fac1-859a-496b-934a-6ec9971aee1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4df2c64c32ab4cf48240bebeafd19ac0'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:48.371752 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d6c3f-e648-4cd5-bbf3-751f3f3ba4f2 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:48.376623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174ed61-0904-4662-92bc-da9ae05f5a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:48.377551 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174ed61-0904-4662-92bc-da9ae05f5a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:48.377837 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174ed61-0904-4662-92bc-da9ae05f5a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:48.378111 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174ed61-0904-4662-92bc-da9ae05f5a2b admin admin] PATH_INFO: `/v3/projects/fa62a87560b14713af9d2111be51035f` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:48.379312 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174ed61-0904-4662-92bc-da9ae05f5a2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa62a87560b14713af9d2111be51035f)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:48.381249 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174ed61-0904-4662-92bc-da9ae05f5a2b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:48.462139 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 940/1926] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:47 2022] DELETE /identity/v3/users/4df2c64c32ab4cf48240bebeafd19ac0 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:48.501146 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2174ed61-0904-4662-92bc-da9ae05f5a2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa62a87560b14713af9d2111be51035f', 'request_id': 'req-2174ed61-0904-4662-92bc-da9ae05f5a2b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:48.569180 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2174ed61-0904-4662-92bc-da9ae05f5a2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa62a87560b14713af9d2111be51035f', 'request_id': 'req-2174ed61-0904-4662-92bc-da9ae05f5a2b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:48.578057 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2174ed61-0904-4662-92bc-da9ae05f5a2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa62a87560b14713af9d2111be51035f', 'request_id': 'req-2174ed61-0904-4662-92bc-da9ae05f5a2b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:48.592040 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2174ed61-0904-4662-92bc-da9ae05f5a2b admin admin] The token cache is being invalidate because project fa62a87560b14713af9d2111be51035f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:48.592337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2174ed61-0904-4662-92bc-da9ae05f5a2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:48.593036 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2174ed61-0904-4662-92bc-da9ae05f5a2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:48.594844 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 987/1927] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:48 2022] DELETE /identity/v3/projects/fa62a87560b14713af9d2111be51035f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:48.605667 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20f1ee-0c4c-4494-91bf-ef240c03ffdd None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:48.605960 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20f1ee-0c4c-4494-91bf-ef240c03ffdd None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:48.606244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20f1ee-0c4c-4494-91bf-ef240c03ffdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:48.627414 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6f20f1ee-0c4c-4494-91bf-ef240c03ffdd None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:48.628930 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6f20f1ee-0c4c-4494-91bf-ef240c03ffdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:48.694225 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 941/1928] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:48.701355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c7c72-9ee3-4aaf-b5b1-ee66c4c99a15 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:48.701650 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c7c72-9ee3-4aaf-b5b1-ee66c4c99a15 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:48.701929 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c7c72-9ee3-4aaf-b5b1-ee66c4c99a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:48.721130 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-845c7c72-9ee3-4aaf-b5b1-ee66c4c99a15 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:48.722440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-845c7c72-9ee3-4aaf-b5b1-ee66c4c99a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:48.731489 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 988/1929] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:48.736691 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20f1ee-0c4c-4494-91bf-ef240c03ffdd None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:48.747927 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20f1ee-0c4c-4494-91bf-ef240c03ffdd None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:48.752650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d523242-36fc-4be4-a57a-dfa9ab1ebd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:48.753308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d523242-36fc-4be4-a57a-dfa9ab1ebd6f admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:48.753586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d523242-36fc-4be4-a57a-dfa9ab1ebd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:48.753853 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d523242-36fc-4be4-a57a-dfa9ab1ebd6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:48.754579 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d523242-36fc-4be4-a57a-dfa9ab1ebd6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:52:48.754878 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d523242-36fc-4be4-a57a-dfa9ab1ebd6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:48.756496 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d523242-36fc-4be4-a57a-dfa9ab1ebd6f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:48.768549 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 942/1930] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:52:48.773109 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c7c72-9ee3-4aaf-b5b1-ee66c4c99a15 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:48.782490 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c7c72-9ee3-4aaf-b5b1-ee66c4c99a15 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:48.798661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206939f4-7f28-414a-a20f-6e48b1936c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:48.798661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206939f4-7f28-414a-a20f-6e48b1936c95 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:48.798661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206939f4-7f28-414a-a20f-6e48b1936c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:48.798661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206939f4-7f28-414a-a20f-6e48b1936c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:48.799443 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206939f4-7f28-414a-a20f-6e48b1936c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:48.800999 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206939f4-7f28-414a-a20f-6e48b1936c95 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:48.830505 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d523242-36fc-4be4-a57a-dfa9ab1ebd6f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:48.832584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1d523242-36fc-4be4-a57a-dfa9ab1ebd6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:48.853350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d523242-36fc-4be4-a57a-dfa9ab1ebd6f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:48.864355 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514bd25-26fa-4ca2-82b7-a6ad4c05ddea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:48.865345 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514bd25-26fa-4ca2-82b7-a6ad4c05ddea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:48.870047 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514bd25-26fa-4ca2-82b7-a6ad4c05ddea admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:48.870047 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514bd25-26fa-4ca2-82b7-a6ad4c05ddea admin admin] PATH_INFO: `/v3/projects/c77cfbb28f29422aad92fd15db8b1148` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:48.870047 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514bd25-26fa-4ca2-82b7-a6ad4c05ddea admin admin] RBAC: Authorizing `identity:delete_project(project_id=c77cfbb28f29422aad92fd15db8b1148)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:48.870308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514bd25-26fa-4ca2-82b7-a6ad4c05ddea admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:48.929409 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 989/1931] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:48 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:48.930753 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206939f4-7f28-414a-a20f-6e48b1936c95 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:48.998448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206939f4-7f28-414a-a20f-6e48b1936c95 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:49.003621 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0023ad2-06e0-42e0-8957-a26da3203415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:49.004470 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0023ad2-06e0-42e0-8957-a26da3203415 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:49.004992 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0023ad2-06e0-42e0-8957-a26da3203415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:49.005112 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0023ad2-06e0-42e0-8957-a26da3203415 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:49.005895 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0023ad2-06e0-42e0-8957-a26da3203415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:49.008627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0023ad2-06e0-42e0-8957-a26da3203415 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:49.044139 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5514bd25-26fa-4ca2-82b7-a6ad4c05ddea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c77cfbb28f29422aad92fd15db8b1148', 'request_id': 'req-5514bd25-26fa-4ca2-82b7-a6ad4c05ddea'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:49.133253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5514bd25-26fa-4ca2-82b7-a6ad4c05ddea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c77cfbb28f29422aad92fd15db8b1148', 'request_id': 'req-5514bd25-26fa-4ca2-82b7-a6ad4c05ddea'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:49.137108 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5514bd25-26fa-4ca2-82b7-a6ad4c05ddea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c77cfbb28f29422aad92fd15db8b1148', 'request_id': 'req-5514bd25-26fa-4ca2-82b7-a6ad4c05ddea'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:49.142066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 990/1932] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:48 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:49.143159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0023ad2-06e0-42e0-8957-a26da3203415 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:49.147456 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a0023ad2-06e0-42e0-8957-a26da3203415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:49.154160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5514bd25-26fa-4ca2-82b7-a6ad4c05ddea admin admin] The token cache is being invalidate because project c77cfbb28f29422aad92fd15db8b1148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:49.154665 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5514bd25-26fa-4ca2-82b7-a6ad4c05ddea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:49.155532 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5514bd25-26fa-4ca2-82b7-a6ad4c05ddea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:49.157545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 943/1933] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:48 2022] DELETE /identity/v3/projects/c77cfbb28f29422aad92fd15db8b1148 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:49.161457 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0023ad2-06e0-42e0-8957-a26da3203415 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:49.162589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514bd25-26fa-4ca2-82b7-a6ad4c05ddea admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:49.174048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5514bd25-26fa-4ca2-82b7-a6ad4c05ddea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:49.235051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42637c02-f105-47a2-bb7e-3ca989327df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:49.235987 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42637c02-f105-47a2-bb7e-3ca989327df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:49.236269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42637c02-f105-47a2-bb7e-3ca989327df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:49.236601 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514bd25-26fa-4ca2-82b7-a6ad4c05ddea admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:49.236707 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42637c02-f105-47a2-bb7e-3ca989327df2 admin admin] PATH_INFO: `/v3/projects/a8c1151f59854a688639667cd8c07575` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:49.237809 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42637c02-f105-47a2-bb7e-3ca989327df2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c1151f59854a688639667cd8c07575)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:49.239709 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42637c02-f105-47a2-bb7e-3ca989327df2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:49.241333 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6d35e-7d1e-48b4-971c-d0edc0d5916d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:49.242359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6d35e-7d1e-48b4-971c-d0edc0d5916d admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:49.242588 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6d35e-7d1e-48b4-971c-d0edc0d5916d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:49.242872 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6d35e-7d1e-48b4-971c-d0edc0d5916d admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:49.243600 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6d35e-7d1e-48b4-971c-d0edc0d5916d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:49.245617 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6d35e-7d1e-48b4-971c-d0edc0d5916d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:49.256774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 944/1934] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:49.261110 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1a244-fc9e-4e21-89a6-9af501d0a76f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:49.261394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1a244-fc9e-4e21-89a6-9af501d0a76f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:49.261669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1a244-fc9e-4e21-89a6-9af501d0a76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:49.282377 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-cae1a244-fc9e-4e21-89a6-9af501d0a76f None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:49.283568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cae1a244-fc9e-4e21-89a6-9af501d0a76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:49.292190 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 945/1935] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:49.293130 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1a244-fc9e-4e21-89a6-9af501d0a76f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:49.302551 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1a244-fc9e-4e21-89a6-9af501d0a76f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:49.307775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd8f54-2ada-4449-92fc-48d740e99474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:49.308423 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd8f54-2ada-4449-92fc-48d740e99474 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:49.308701 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd8f54-2ada-4449-92fc-48d740e99474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:49.308972 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd8f54-2ada-4449-92fc-48d740e99474 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:49.309693 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd8f54-2ada-4449-92fc-48d740e99474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:49.311326 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd8f54-2ada-4449-92fc-48d740e99474 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:49.321322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 946/1936] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:49.322591 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0431c97-d3e5-4eca-b598-4f8873dade2f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:49.322880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0431c97-d3e5-4eca-b598-4f8873dade2f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:49.323206 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0431c97-d3e5-4eca-b598-4f8873dade2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:49.341260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f0431c97-d3e5-4eca-b598-4f8873dade2f None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:49.342356 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f0431c97-d3e5-4eca-b598-4f8873dade2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:49.350228 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 947/1937] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:49.354593 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0431c97-d3e5-4eca-b598-4f8873dade2f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:49.359091 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-42637c02-f105-47a2-bb7e-3ca989327df2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c1151f59854a688639667cd8c07575', 'request_id': 'req-42637c02-f105-47a2-bb7e-3ca989327df2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:49.363714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0431c97-d3e5-4eca-b598-4f8873dade2f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:49.418085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2265ca-6990-432f-8ba8-82e03ba350c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:49.418962 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2265ca-6990-432f-8ba8-82e03ba350c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:49.419241 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2265ca-6990-432f-8ba8-82e03ba350c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:49.419513 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2265ca-6990-432f-8ba8-82e03ba350c7 admin admin] PATH_INFO: `/v3/projects/c5a390a34f094d0caaa869aa12d9690b/users/2c4097afb65b41308a7780d9dbce4095/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:49.433484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2265ca-6990-432f-8ba8-82e03ba350c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a390a34f094d0caaa869aa12d9690b, user_id=2c4097afb65b41308a7780d9dbce4095, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:49.436164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2265ca-6990-432f-8ba8-82e03ba350c7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:49.443391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-42637c02-f105-47a2-bb7e-3ca989327df2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c1151f59854a688639667cd8c07575', 'request_id': 'req-42637c02-f105-47a2-bb7e-3ca989327df2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:49.450351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-42637c02-f105-47a2-bb7e-3ca989327df2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c1151f59854a688639667cd8c07575', 'request_id': 'req-42637c02-f105-47a2-bb7e-3ca989327df2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:49.463555 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-42637c02-f105-47a2-bb7e-3ca989327df2 admin admin] The token cache is being invalidate because project a8c1151f59854a688639667cd8c07575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:49.463867 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-42637c02-f105-47a2-bb7e-3ca989327df2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:49.464522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-42637c02-f105-47a2-bb7e-3ca989327df2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:49.466349 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 991/1938] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:49 2022] DELETE /identity/v3/projects/a8c1151f59854a688639667cd8c07575 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:49.467173 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42637c02-f105-47a2-bb7e-3ca989327df2 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:49.472466 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-42637c02-f105-47a2-bb7e-3ca989327df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:49.480571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42637c02-f105-47a2-bb7e-3ca989327df2 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:49.485158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20764e-02f3-411e-9f6d-aa83a4740176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:49.485793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20764e-02f3-411e-9f6d-aa83a4740176 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:49.486060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20764e-02f3-411e-9f6d-aa83a4740176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:49.486335 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20764e-02f3-411e-9f6d-aa83a4740176 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:49.487049 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20764e-02f3-411e-9f6d-aa83a4740176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:52:49.487350 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20764e-02f3-411e-9f6d-aa83a4740176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:49.488987 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20764e-02f3-411e-9f6d-aa83a4740176 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:49.499964 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 992/1939] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:52:49.501376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1a10c-c635-4aae-845d-0b33e1cac81b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:49.501470 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1a10c-c635-4aae-845d-0b33e1cac81b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:49.501732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1a10c-c635-4aae-845d-0b33e1cac81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:49.519202 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-b6a1a10c-c635-4aae-845d-0b33e1cac81b None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:49.520443 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b6a1a10c-c635-4aae-845d-0b33e1cac81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:49.525362 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 948/1940] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:49 2022] PUT /identity/v3/projects/c5a390a34f094d0caaa869aa12d9690b/users/2c4097afb65b41308a7780d9dbce4095/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:49.528230 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2265ca-6990-432f-8ba8-82e03ba350c7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:49.587163 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2265ca-6990-432f-8ba8-82e03ba350c7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:49.587378 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 993/1941] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:49.588661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a188d-03ff-4bd3-a4d6-eb4e3e24ef9d None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:49.588947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a188d-03ff-4bd3-a4d6-eb4e3e24ef9d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:49.589218 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a188d-03ff-4bd3-a4d6-eb4e3e24ef9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:49.592746 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca443a-3a54-4c2e-a4d0-c4cf49551bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:49.593583 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca443a-3a54-4c2e-a4d0-c4cf49551bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:49.594018 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca443a-3a54-4c2e-a4d0-c4cf49551bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:49.594669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca443a-3a54-4c2e-a4d0-c4cf49551bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:49.595129 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca443a-3a54-4c2e-a4d0-c4cf49551bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:49.597063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca443a-3a54-4c2e-a4d0-c4cf49551bb5 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:49.615748 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-280a188d-03ff-4bd3-a4d6-eb4e3e24ef9d None None] MFA Rules not processed for user `2c4097afb65b41308a7780d9dbce4095`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:49.617100 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-280a188d-03ff-4bd3-a4d6-eb4e3e24ef9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:49.679723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 949/1942] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:49 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:49.679921 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 994/1943] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:49.680893 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab5d43-eb58-4e32-88ee-1279ad09b107 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:49.681189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab5d43-eb58-4e32-88ee-1279ad09b107 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:49.681468 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab5d43-eb58-4e32-88ee-1279ad09b107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:49.684656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a188d-03ff-4bd3-a4d6-eb4e3e24ef9d None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:49.696673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a188d-03ff-4bd3-a4d6-eb4e3e24ef9d None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:49.701635 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b1ab5d43-eb58-4e32-88ee-1279ad09b107 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:49.702836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b1ab5d43-eb58-4e32-88ee-1279ad09b107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:49.755918 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346dae0-1f57-4745-8783-ae94aec20c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:49.756599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346dae0-1f57-4745-8783-ae94aec20c89 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:49.756881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346dae0-1f57-4745-8783-ae94aec20c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:49.757157 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346dae0-1f57-4745-8783-ae94aec20c89 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:49.758414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346dae0-1f57-4745-8783-ae94aec20c89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:49.760351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346dae0-1f57-4745-8783-ae94aec20c89 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:49.764758 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 950/1944] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:49.765631 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab5d43-eb58-4e32-88ee-1279ad09b107 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:49.766869 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b1ab5d43-eb58-4e32-88ee-1279ad09b107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:49.821317 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab5d43-eb58-4e32-88ee-1279ad09b107 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:49.824942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995957d-b424-4f17-a23e-ec7d6e85bed2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:49.825577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995957d-b424-4f17-a23e-ec7d6e85bed2 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:49.825850 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995957d-b424-4f17-a23e-ec7d6e85bed2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:49.826127 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995957d-b424-4f17-a23e-ec7d6e85bed2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:49.852050 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 995/1945] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:49 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:49.852050 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346dae0-1f57-4745-8783-ae94aec20c89 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:49.852050 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b346dae0-1f57-4745-8783-ae94aec20c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:49.863006 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346dae0-1f57-4745-8783-ae94aec20c89 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:49.870076 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219405d-6f2d-4fe9-ae19-8ab29414958a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:49.875425 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219405d-6f2d-4fe9-ae19-8ab29414958a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:49.875425 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219405d-6f2d-4fe9-ae19-8ab29414958a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:49.875425 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219405d-6f2d-4fe9-ae19-8ab29414958a admin admin] PATH_INFO: `/v3/users/c54bf9a45ae6446aa17241b557bd3390` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:49.875425 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219405d-6f2d-4fe9-ae19-8ab29414958a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c54bf9a45ae6446aa17241b557bd3390)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:49.875425 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219405d-6f2d-4fe9-ae19-8ab29414958a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:49.882325 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995957d-b424-4f17-a23e-ec7d6e85bed2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:49.884391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995957d-b424-4f17-a23e-ec7d6e85bed2 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:49.893123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 951/1946] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:49.893907 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995957d-b424-4f17-a23e-ec7d6e85bed2 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:49.904010 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995957d-b424-4f17-a23e-ec7d6e85bed2 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:49.910929 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c320ab-fcf8-4c85-8a1c-24597fcd2a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:49.910929 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c320ab-fcf8-4c85-8a1c-24597fcd2a77 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:49.910929 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c320ab-fcf8-4c85-8a1c-24597fcd2a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:49.910929 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c320ab-fcf8-4c85-8a1c-24597fcd2a77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:49.911304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c320ab-fcf8-4c85-8a1c-24597fcd2a77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:52:49.911304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c320ab-fcf8-4c85-8a1c-24597fcd2a77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:49.912552 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c320ab-fcf8-4c85-8a1c-24597fcd2a77 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:49.924376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 952/1947] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:52:49.925171 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c320ab-fcf8-4c85-8a1c-24597fcd2a77 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:49.935488 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c320ab-fcf8-4c85-8a1c-24597fcd2a77 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:49.940194 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f419b-4194-49e3-9d6d-0d9a27333b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:49.940809 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f419b-4194-49e3-9d6d-0d9a27333b76 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:49.941094 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f419b-4194-49e3-9d6d-0d9a27333b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:49.941366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f419b-4194-49e3-9d6d-0d9a27333b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:49.942092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f419b-4194-49e3-9d6d-0d9a27333b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:49.943919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f419b-4194-49e3-9d6d-0d9a27333b76 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:49.953928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 953/1948] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:49.954743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f419b-4194-49e3-9d6d-0d9a27333b76 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:49.956352 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b65f419b-4194-49e3-9d6d-0d9a27333b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:49.969261 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f419b-4194-49e3-9d6d-0d9a27333b76 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:49.973912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc4ee7-1f26-42f8-af1d-c1ce7c6cd8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:49.974781 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc4ee7-1f26-42f8-af1d-c1ce7c6cd8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:49.975058 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc4ee7-1f26-42f8-af1d-c1ce7c6cd8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:49.975334 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc4ee7-1f26-42f8-af1d-c1ce7c6cd8e4 admin admin] PATH_INFO: `/v3/users/2c4097afb65b41308a7780d9dbce4095` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:49.977177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc4ee7-1f26-42f8-af1d-c1ce7c6cd8e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4097afb65b41308a7780d9dbce4095)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:49.979046 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc4ee7-1f26-42f8-af1d-c1ce7c6cd8e4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:50.173184 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7219405d-6f2d-4fe9-ae19-8ab29414958a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c54bf9a45ae6446aa17241b557bd3390'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:50.173833 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7219405d-6f2d-4fe9-ae19-8ab29414958a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c54bf9a45ae6446aa17241b557bd3390'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:50.174448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7219405d-6f2d-4fe9-ae19-8ab29414958a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c54bf9a45ae6446aa17241b557bd3390'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:50.192052 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7219405d-6f2d-4fe9-ae19-8ab29414958a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c54bf9a45ae6446aa17241b557bd3390'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:50.200079 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7219405d-6f2d-4fe9-ae19-8ab29414958a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c54bf9a45ae6446aa17241b557bd3390'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:50.320035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fccc4ee7-1f26-42f8-af1d-c1ce7c6cd8e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4097afb65b41308a7780d9dbce4095'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:50.322449 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fccc4ee7-1f26-42f8-af1d-c1ce7c6cd8e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4097afb65b41308a7780d9dbce4095'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:50.334964 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fccc4ee7-1f26-42f8-af1d-c1ce7c6cd8e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4097afb65b41308a7780d9dbce4095'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:50.335634 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fccc4ee7-1f26-42f8-af1d-c1ce7c6cd8e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4097afb65b41308a7780d9dbce4095'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:50.343032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 996/1949] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:49 2022] DELETE /identity/v3/users/c54bf9a45ae6446aa17241b557bd3390 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:50.343816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219405d-6f2d-4fe9-ae19-8ab29414958a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:50.344321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fccc4ee7-1f26-42f8-af1d-c1ce7c6cd8e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4097afb65b41308a7780d9dbce4095'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:50.345244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7219405d-6f2d-4fe9-ae19-8ab29414958a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:50.410219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 954/1950] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:49 2022] DELETE /identity/v3/users/2c4097afb65b41308a7780d9dbce4095 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:50.411051 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc4ee7-1f26-42f8-af1d-c1ce7c6cd8e4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:50.412485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fccc4ee7-1f26-42f8-af1d-c1ce7c6cd8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:50.418070 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219405d-6f2d-4fe9-ae19-8ab29414958a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:50.478414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdbd56-5c41-42ba-862f-faab06257c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:50.479091 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdbd56-5c41-42ba-862f-faab06257c06 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:50.479371 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdbd56-5c41-42ba-862f-faab06257c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:50.479645 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdbd56-5c41-42ba-862f-faab06257c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:50.480381 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdbd56-5c41-42ba-862f-faab06257c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:50.482273 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdbd56-5c41-42ba-862f-faab06257c06 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:50.482581 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc4ee7-1f26-42f8-af1d-c1ce7c6cd8e4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:50.487438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd6fdc-27d6-42d0-a568-2063e088cb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:50.488281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd6fdc-27d6-42d0-a568-2063e088cb0a admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:50.488562 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd6fdc-27d6-42d0-a568-2063e088cb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:50.488831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd6fdc-27d6-42d0-a568-2063e088cb0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:50.489566 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd6fdc-27d6-42d0-a568-2063e088cb0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:50.491171 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd6fdc-27d6-42d0-a568-2063e088cb0a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:50.501351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 955/1951] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:50.502597 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57cd3d-5161-403d-b631-ce5ad4f51e2a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:50.502880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57cd3d-5161-403d-b631-ce5ad4f51e2a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:50.503158 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57cd3d-5161-403d-b631-ce5ad4f51e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:50.520642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8c57cd3d-5161-403d-b631-ce5ad4f51e2a None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:50.521880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8c57cd3d-5161-403d-b631-ce5ad4f51e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:50.530262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 956/1952] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:50.531442 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625a608-7f84-4a85-a492-06c326e9f7f3 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:50.531755 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625a608-7f84-4a85-a492-06c326e9f7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:50.532033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625a608-7f84-4a85-a492-06c326e9f7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:50.549256 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6625a608-7f84-4a85-a492-06c326e9f7f3 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:50.550536 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6625a608-7f84-4a85-a492-06c326e9f7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:50.558829 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 957/1953] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:50.559576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625a608-7f84-4a85-a492-06c326e9f7f3 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:50.568806 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625a608-7f84-4a85-a492-06c326e9f7f3 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:50.573729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2e92e-d9c0-42c1-9c72-4fafe0335561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:50.574605 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2e92e-d9c0-42c1-9c72-4fafe0335561 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:50.574867 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2e92e-d9c0-42c1-9c72-4fafe0335561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:50.575135 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2e92e-d9c0-42c1-9c72-4fafe0335561 admin admin] PATH_INFO: `/v3/projects/6194e4b8913c47b48d41b7dcc3f9d2cc/users/a72d4abb5ab14beaae418e4f69f2d66b/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:50.589418 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2e92e-d9c0-42c1-9c72-4fafe0335561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6194e4b8913c47b48d41b7dcc3f9d2cc, user_id=a72d4abb5ab14beaae418e4f69f2d66b, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:50.592115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2e92e-d9c0-42c1-9c72-4fafe0335561 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:50.603034 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 997/1954] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:50 2022] POST /identity/v3/projects => generated 363 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:50.603034 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdbd56-5c41-42ba-862f-faab06257c06 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:50.603034 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-70bdbd56-5c41-42ba-862f-faab06257c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:50.658603 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdbd56-5c41-42ba-862f-faab06257c06 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:50.662233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde38adc-d961-4063-999e-aeff4c41139e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:50.662891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde38adc-d961-4063-999e-aeff4c41139e service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:50.663177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde38adc-d961-4063-999e-aeff4c41139e service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:50.663453 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde38adc-d961-4063-999e-aeff4c41139e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:50.673198 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 958/1955] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:50 2022] PUT /identity/v3/projects/6194e4b8913c47b48d41b7dcc3f9d2cc/users/a72d4abb5ab14beaae418e4f69f2d66b/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:50.674032 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2e92e-d9c0-42c1-9c72-4fafe0335561 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:50.675574 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-61d2e92e-d9c0-42c1-9c72-4fafe0335561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:50.728051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde38adc-d961-4063-999e-aeff4c41139e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:50.729472 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde38adc-d961-4063-999e-aeff4c41139e service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:50.738858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 998/1956] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:50.739779 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde38adc-d961-4063-999e-aeff4c41139e service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:50.740212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2e92e-d9c0-42c1-9c72-4fafe0335561 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:50.741278 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-dde38adc-d961-4063-999e-aeff4c41139e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:50.744256 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2ca32-658a-4746-bd33-c581322096d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:50.744949 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2ca32-658a-4746-bd33-c581322096d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:50.745315 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2ca32-658a-4746-bd33-c581322096d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:50.745593 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2ca32-658a-4746-bd33-c581322096d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:50.753579 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde38adc-d961-4063-999e-aeff4c41139e service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:50.811981 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245f5df-0ae0-4942-8014-7a3b2a0d19b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:50.812877 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245f5df-0ae0-4942-8014-7a3b2a0d19b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:50.813251 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2ca32-658a-4746-bd33-c581322096d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:50.813407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245f5df-0ae0-4942-8014-7a3b2a0d19b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:50.813705 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245f5df-0ae0-4942-8014-7a3b2a0d19b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:50.814501 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245f5df-0ae0-4942-8014-7a3b2a0d19b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:50.814703 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2ca32-658a-4746-bd33-c581322096d1 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:50.816663 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245f5df-0ae0-4942-8014-7a3b2a0d19b2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:50.824775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 959/1957] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:50.826100 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb290e95-9072-4c21-bd2d-8c2f49667c09 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:50.826316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb290e95-9072-4c21-bd2d-8c2f49667c09 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:50.826591 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb290e95-9072-4c21-bd2d-8c2f49667c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:50.855026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-eb290e95-9072-4c21-bd2d-8c2f49667c09 None None] MFA Rules not processed for user `a72d4abb5ab14beaae418e4f69f2d66b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:50.856363 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-eb290e95-9072-4c21-bd2d-8c2f49667c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:50.899207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 999/1958] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:50 2022] POST /identity/v3/users => generated 282 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:50.900477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245f5df-0ae0-4942-8014-7a3b2a0d19b2 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:50.911531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245f5df-0ae0-4942-8014-7a3b2a0d19b2 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:50.918262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9eeb7-7c35-47b6-85c7-659fb068883b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:50.919175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9eeb7-7c35-47b6-85c7-659fb068883b admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:50.919527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9eeb7-7c35-47b6-85c7-659fb068883b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:50.919907 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9eeb7-7c35-47b6-85c7-659fb068883b admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:50.920711 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9eeb7-7c35-47b6-85c7-659fb068883b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:50.922472 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9eeb7-7c35-47b6-85c7-659fb068883b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:50.923398 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 960/1959] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:50.929018 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb290e95-9072-4c21-bd2d-8c2f49667c09 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:50.933482 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1000/1960] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 06:52:50.937218 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9eeb7-7c35-47b6-85c7-659fb068883b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:50.942123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb290e95-9072-4c21-bd2d-8c2f49667c09 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:50.947358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9eeb7-7c35-47b6-85c7-659fb068883b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:50.948113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1a40f-f860-49c0-8698-7779316912a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:50.948801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1a40f-f860-49c0-8698-7779316912a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:50.949067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1a40f-f860-49c0-8698-7779316912a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:50.949345 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1a40f-f860-49c0-8698-7779316912a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:50.950120 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1a40f-f860-49c0-8698-7779316912a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:50.952242 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1a40f-f860-49c0-8698-7779316912a8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:50.952662 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b9d25-a424-4320-8203-0c9df4f89a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:50.953324 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b9d25-a424-4320-8203-0c9df4f89a0c admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:50.953608 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b9d25-a424-4320-8203-0c9df4f89a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:50.953884 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b9d25-a424-4320-8203-0c9df4f89a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:50.954721 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b9d25-a424-4320-8203-0c9df4f89a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:50.956217 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b9d25-a424-4320-8203-0c9df4f89a0c admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:50.968891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1001/1961] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 06:52:50.972902 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b9d25-a424-4320-8203-0c9df4f89a0c admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:50.983823 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b9d25-a424-4320-8203-0c9df4f89a0c admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:50.993223 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1189f-993e-40ee-a224-1bdec45d2717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:50.994228 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1189f-993e-40ee-a224-1bdec45d2717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:50.994641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1189f-993e-40ee-a224-1bdec45d2717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:50.995030 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1189f-993e-40ee-a224-1bdec45d2717 admin admin] PATH_INFO: `/v3/projects/188756dc6de54bfd813589b51159942f/users/ea14303c35e3473694a7f91e759b1b02/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:51.011891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1189f-993e-40ee-a224-1bdec45d2717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=188756dc6de54bfd813589b51159942f, user_id=ea14303c35e3473694a7f91e759b1b02, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:51.014552 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1189f-993e-40ee-a224-1bdec45d2717 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:51.072383 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 961/1962] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:50 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:52:51.073551 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1a40f-f860-49c0-8698-7779316912a8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:51.097377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1002/1963] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:50 2022] PUT /identity/v3/projects/188756dc6de54bfd813589b51159942f/users/ea14303c35e3473694a7f91e759b1b02/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:52:51.112318 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987c6fd-c7a9-4429-b484-bb7110960fc8 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:51.112886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987c6fd-c7a9-4429-b484-bb7110960fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:51.113164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987c6fd-c7a9-4429-b484-bb7110960fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:51.141808 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1a40f-f860-49c0-8698-7779316912a8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:51.145593 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4987c6fd-c7a9-4429-b484-bb7110960fc8 None None] MFA Rules not processed for user `ea14303c35e3473694a7f91e759b1b02`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:51.147114 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4987c6fd-c7a9-4429-b484-bb7110960fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:51.206178 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192ca24-3194-42dd-9de7-b4f484125e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:51.206781 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192ca24-3194-42dd-9de7-b4f484125e23 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:51.207070 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192ca24-3194-42dd-9de7-b4f484125e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:51.207496 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192ca24-3194-42dd-9de7-b4f484125e23 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:51.208419 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192ca24-3194-42dd-9de7-b4f484125e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:51.213495 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192ca24-3194-42dd-9de7-b4f484125e23 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:51.219431 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1003/1964] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:51 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:51.223875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987c6fd-c7a9-4429-b484-bb7110960fc8 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:51.236171 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987c6fd-c7a9-4429-b484-bb7110960fc8 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:51.242981 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06376972-ce2c-448f-a058-6cb9308007fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:51.244168 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06376972-ce2c-448f-a058-6cb9308007fe admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:51.244168 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06376972-ce2c-448f-a058-6cb9308007fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:51.245470 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06376972-ce2c-448f-a058-6cb9308007fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:51.245470 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06376972-ce2c-448f-a058-6cb9308007fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:51.247036 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06376972-ce2c-448f-a058-6cb9308007fe admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:51.325992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 962/1965] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:51 2022] POST /identity/v3/users => generated 288 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:52:51.329445 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192ca24-3194-42dd-9de7-b4f484125e23 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:51.342157 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192ca24-3194-42dd-9de7-b4f484125e23 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:51.342931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1004/1966] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:51 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:52:51.344176 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06376972-ce2c-448f-a058-6cb9308007fe admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:51.421416 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cc36d-37fb-406b-aed3-cf2b073c1304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:51.421832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06376972-ce2c-448f-a058-6cb9308007fe admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:51.422333 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cc36d-37fb-406b-aed3-cf2b073c1304 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:51.422740 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cc36d-37fb-406b-aed3-cf2b073c1304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:51.423111 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cc36d-37fb-406b-aed3-cf2b073c1304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:51.423990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9cc36d-37fb-406b-aed3-cf2b073c1304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:51.425698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9cc36d-37fb-406b-aed3-cf2b073c1304 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:51.428668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8f35e-105e-4371-b460-8d195b3131ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:51.430154 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8f35e-105e-4371-b460-8d195b3131ad admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:51.430440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8f35e-105e-4371-b460-8d195b3131ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:51.430714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8f35e-105e-4371-b460-8d195b3131ad admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:51.431469 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8f35e-105e-4371-b460-8d195b3131ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:51.433989 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8f35e-105e-4371-b460-8d195b3131ad admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:51.439858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 963/1967] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 06:52:51.441676 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cc36d-37fb-406b-aed3-cf2b073c1304 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:51.452888 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cc36d-37fb-406b-aed3-cf2b073c1304 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:51.457660 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d50d61-9593-4fbc-b281-6dbe53bb81f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:51.458229 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d50d61-9593-4fbc-b281-6dbe53bb81f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:51.458513 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d50d61-9593-4fbc-b281-6dbe53bb81f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:51.458781 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d50d61-9593-4fbc-b281-6dbe53bb81f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:51.459502 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d50d61-9593-4fbc-b281-6dbe53bb81f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:51.461663 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d50d61-9593-4fbc-b281-6dbe53bb81f8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:51.471301 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 964/1968] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:51.475393 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d50d61-9593-4fbc-b281-6dbe53bb81f8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:51.485533 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d50d61-9593-4fbc-b281-6dbe53bb81f8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:51.490093 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274aba6c-0bea-4bc8-8667-096b57424007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:51.490952 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274aba6c-0bea-4bc8-8667-096b57424007 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:51.491228 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274aba6c-0bea-4bc8-8667-096b57424007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:51.491497 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274aba6c-0bea-4bc8-8667-096b57424007 admin admin] PATH_INFO: `/v3/projects/6f87015faa37463ca1f54e90ffc20237/users/5fb4be83fd4744b399c710b5adaec660/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:51.505768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274aba6c-0bea-4bc8-8667-096b57424007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f87015faa37463ca1f54e90ffc20237, user_id=5fb4be83fd4744b399c710b5adaec660, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:51.508539 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274aba6c-0bea-4bc8-8667-096b57424007 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:51.569541 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1005/1969] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:51 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:51.570602 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8f35e-105e-4371-b460-8d195b3131ad admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:51.572473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a6a8f35e-105e-4371-b460-8d195b3131ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:51.587597 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8f35e-105e-4371-b460-8d195b3131ad admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:51.593554 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d3835-29d0-479d-a8d6-cd742e902897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:51.594343 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d3835-29d0-479d-a8d6-cd742e902897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:51.594631 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d3835-29d0-479d-a8d6-cd742e902897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:51.594877 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d3835-29d0-479d-a8d6-cd742e902897 admin admin] PATH_INFO: `/v3/projects/6ae09d0d89e447c09f576dffa1148050` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:51.596128 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d3835-29d0-479d-a8d6-cd742e902897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae09d0d89e447c09f576dffa1148050)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:51.598030 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d3835-29d0-479d-a8d6-cd742e902897 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:51.604443 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 965/1970] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:51 2022] PUT /identity/v3/projects/6f87015faa37463ca1f54e90ffc20237/users/5fb4be83fd4744b399c710b5adaec660/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:51.605423 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274aba6c-0bea-4bc8-8667-096b57424007 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:51.611821 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-274aba6c-0bea-4bc8-8667-096b57424007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:51.670496 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274aba6c-0bea-4bc8-8667-096b57424007 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:51.675205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160391e4-ada3-416d-a5de-8ebc3b370129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:51.676141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160391e4-ada3-416d-a5de-8ebc3b370129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:51.676470 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160391e4-ada3-416d-a5de-8ebc3b370129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:51.676743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160391e4-ada3-416d-a5de-8ebc3b370129 admin admin] PATH_INFO: `/v3/projects/c5a390a34f094d0caaa869aa12d9690b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:51.677938 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160391e4-ada3-416d-a5de-8ebc3b370129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a390a34f094d0caaa869aa12d9690b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:51.680022 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160391e4-ada3-416d-a5de-8ebc3b370129 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:51.709681 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-711d3835-29d0-479d-a8d6-cd742e902897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae09d0d89e447c09f576dffa1148050', 'request_id': 'req-711d3835-29d0-479d-a8d6-cd742e902897'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:51.815175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-711d3835-29d0-479d-a8d6-cd742e902897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae09d0d89e447c09f576dffa1148050', 'request_id': 'req-711d3835-29d0-479d-a8d6-cd742e902897'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:51.823064 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-711d3835-29d0-479d-a8d6-cd742e902897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae09d0d89e447c09f576dffa1148050', 'request_id': 'req-711d3835-29d0-479d-a8d6-cd742e902897'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:51.824459 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-160391e4-ada3-416d-a5de-8ebc3b370129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a390a34f094d0caaa869aa12d9690b', 'request_id': 'req-160391e4-ada3-416d-a5de-8ebc3b370129'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:51.835330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-711d3835-29d0-479d-a8d6-cd742e902897 admin admin] The token cache is being invalidate because project 6ae09d0d89e447c09f576dffa1148050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:51.836358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-711d3835-29d0-479d-a8d6-cd742e902897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:51.837149 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-711d3835-29d0-479d-a8d6-cd742e902897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:51.838791 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1006/1971] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:51 2022] DELETE /identity/v3/projects/6ae09d0d89e447c09f576dffa1148050 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:51.839742 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d3835-29d0-479d-a8d6-cd742e902897 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:51.841142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-711d3835-29d0-479d-a8d6-cd742e902897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:51.884448 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-160391e4-ada3-416d-a5de-8ebc3b370129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a390a34f094d0caaa869aa12d9690b', 'request_id': 'req-160391e4-ada3-416d-a5de-8ebc3b370129'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:51.895913 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-160391e4-ada3-416d-a5de-8ebc3b370129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a390a34f094d0caaa869aa12d9690b', 'request_id': 'req-160391e4-ada3-416d-a5de-8ebc3b370129'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:51.909726 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-160391e4-ada3-416d-a5de-8ebc3b370129 admin admin] The token cache is being invalidate because project c5a390a34f094d0caaa869aa12d9690b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:51.910017 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-160391e4-ada3-416d-a5de-8ebc3b370129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:51.910685 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-160391e4-ada3-416d-a5de-8ebc3b370129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:51.910914 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d3835-29d0-479d-a8d6-cd742e902897 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:51.912742 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 966/1972] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:51 2022] DELETE /identity/v3/projects/c5a390a34f094d0caaa869aa12d9690b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:51.914679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dad125-69f7-46f1-84fd-9e086c7a99ca None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:51.915113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dad125-69f7-46f1-84fd-9e086c7a99ca None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:51.915281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dad125-69f7-46f1-84fd-9e086c7a99ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:51.944025 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b3dad125-69f7-46f1-84fd-9e086c7a99ca None None] MFA Rules not processed for user `5fb4be83fd4744b399c710b5adaec660`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:51.945924 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b3dad125-69f7-46f1-84fd-9e086c7a99ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:51.972712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac083e8-8d9c-40b7-990b-1c12e98b6f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:51.973344 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac083e8-8d9c-40b7-990b-1c12e98b6f4c admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:51.973631 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac083e8-8d9c-40b7-990b-1c12e98b6f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:51.974030 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac083e8-8d9c-40b7-990b-1c12e98b6f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:51.974899 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac083e8-8d9c-40b7-990b-1c12e98b6f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:51.976538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac083e8-8d9c-40b7-990b-1c12e98b6f4c admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:51.986369 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1007/1973] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:51.988894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac083e8-8d9c-40b7-990b-1c12e98b6f4c admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:51.989188 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-eac083e8-8d9c-40b7-990b-1c12e98b6f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:52.006637 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac083e8-8d9c-40b7-990b-1c12e98b6f4c admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:52.011756 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ff48c-fbce-4206-a631-8ad861180ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:52.012618 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ff48c-fbce-4206-a631-8ad861180ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:52.012936 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ff48c-fbce-4206-a631-8ad861180ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:52.013215 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ff48c-fbce-4206-a631-8ad861180ddd admin admin] PATH_INFO: `/v3/users/7208ee50cc8149a48c4616dd2bac64d2` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:52.014670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ff48c-fbce-4206-a631-8ad861180ddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7208ee50cc8149a48c4616dd2bac64d2)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:52.016267 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 967/1974] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:52.016600 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ff48c-fbce-4206-a631-8ad861180ddd admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:52.018026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ecbde-6f7c-42e5-b4b1-daa62d48f6a4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:52.018435 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ecbde-6f7c-42e5-b4b1-daa62d48f6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:52.018972 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ecbde-6f7c-42e5-b4b1-daa62d48f6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:52.036838 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a44ecbde-6f7c-42e5-b4b1-daa62d48f6a4 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:52.038022 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a44ecbde-6f7c-42e5-b4b1-daa62d48f6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:52.046524 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 968/1975] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:52.047303 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ecbde-6f7c-42e5-b4b1-daa62d48f6a4 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:52.048569 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a44ecbde-6f7c-42e5-b4b1-daa62d48f6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:52.060711 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ecbde-6f7c-42e5-b4b1-daa62d48f6a4 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:52.065372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb92c1-27e9-4bb7-b431-e4f36f6486ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:52.066247 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb92c1-27e9-4bb7-b431-e4f36f6486ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:52.066523 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb92c1-27e9-4bb7-b431-e4f36f6486ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:52.066789 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb92c1-27e9-4bb7-b431-e4f36f6486ea admin admin] PATH_INFO: `/v3/projects/adfd862148404f9d814460e9e059b307/users/d55374999c084b3e9c2ffaaea6345886/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:52.081181 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb92c1-27e9-4bb7-b431-e4f36f6486ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=adfd862148404f9d814460e9e059b307, user_id=d55374999c084b3e9c2ffaaea6345886, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:52.083867 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb92c1-27e9-4bb7-b431-e4f36f6486ea admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:52.187593 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 969/1976] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:52 2022] PUT /identity/v3/projects/adfd862148404f9d814460e9e059b307/users/d55374999c084b3e9c2ffaaea6345886/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:52.188534 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb92c1-27e9-4bb7-b431-e4f36f6486ea admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:52.190296 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3ffb92c1-27e9-4bb7-b431-e4f36f6486ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:52.225035 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9b2ff48c-fbce-4206-a631-8ad861180ddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7208ee50cc8149a48c4616dd2bac64d2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:52.225777 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9b2ff48c-fbce-4206-a631-8ad861180ddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7208ee50cc8149a48c4616dd2bac64d2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:52.227121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9b2ff48c-fbce-4206-a631-8ad861180ddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7208ee50cc8149a48c4616dd2bac64d2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:52.239410 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9b2ff48c-fbce-4206-a631-8ad861180ddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7208ee50cc8149a48c4616dd2bac64d2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:52.246584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9b2ff48c-fbce-4206-a631-8ad861180ddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7208ee50cc8149a48c4616dd2bac64d2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:52.258595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb92c1-27e9-4bb7-b431-e4f36f6486ea admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:52.263541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750cc93-fe47-49c2-821f-29351d2f071f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:52.264432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750cc93-fe47-49c2-821f-29351d2f071f admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:52.264809 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750cc93-fe47-49c2-821f-29351d2f071f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:52.265200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750cc93-fe47-49c2-821f-29351d2f071f admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:52.265990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750cc93-fe47-49c2-821f-29351d2f071f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:52.268095 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750cc93-fe47-49c2-821f-29351d2f071f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:52.351398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1008/1977] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:51 2022] DELETE /identity/v3/users/7208ee50cc8149a48c4616dd2bac64d2 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:52.353262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a637f6e-14ec-4e33-9e22-3a9989b61c08 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:52.353535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a637f6e-14ec-4e33-9e22-3a9989b61c08 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:52.353811 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a637f6e-14ec-4e33-9e22-3a9989b61c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:52.371142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-2a637f6e-14ec-4e33-9e22-3a9989b61c08 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:52.372394 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2a637f6e-14ec-4e33-9e22-3a9989b61c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:52.393493 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 970/1978] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:52 2022] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:52.395767 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750cc93-fe47-49c2-821f-29351d2f071f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:52.396368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9750cc93-fe47-49c2-821f-29351d2f071f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:52.439861 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1009/1979] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:52.440964 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a637f6e-14ec-4e33-9e22-3a9989b61c08 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:52.442347 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2a637f6e-14ec-4e33-9e22-3a9989b61c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:52.463467 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a637f6e-14ec-4e33-9e22-3a9989b61c08 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:52.493406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750cc93-fe47-49c2-821f-29351d2f071f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:52.499738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ca1c6-dafa-4498-88c5-30cc109b9dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:52.499738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ca1c6-dafa-4498-88c5-30cc109b9dee admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:52.499738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ca1c6-dafa-4498-88c5-30cc109b9dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:52.500111 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ca1c6-dafa-4498-88c5-30cc109b9dee admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:52.500517 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ca1c6-dafa-4498-88c5-30cc109b9dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:52.502137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ca1c6-dafa-4498-88c5-30cc109b9dee admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:52.516596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 971/1980] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:52.516596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ca1c6-dafa-4498-88c5-30cc109b9dee admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:52.520707 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c9e79-9f24-48bf-b3e6-02089db11377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:52.521516 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c9e79-9f24-48bf-b3e6-02089db11377 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:52.521855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c9e79-9f24-48bf-b3e6-02089db11377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:52.522448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c9e79-9f24-48bf-b3e6-02089db11377 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:52.523175 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c9e79-9f24-48bf-b3e6-02089db11377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:52.525257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c9e79-9f24-48bf-b3e6-02089db11377 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:52.527582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ca1c6-dafa-4498-88c5-30cc109b9dee admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:52.532846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42732a-5c5f-438f-a1ae-61d83169c2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:52.534129 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42732a-5c5f-438f-a1ae-61d83169c2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:52.534129 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42732a-5c5f-438f-a1ae-61d83169c2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:52.534129 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42732a-5c5f-438f-a1ae-61d83169c2a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:52.534976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42732a-5c5f-438f-a1ae-61d83169c2a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:52:52.535292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42732a-5c5f-438f-a1ae-61d83169c2a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:52.536926 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42732a-5c5f-438f-a1ae-61d83169c2a2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:52.553787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 972/1981] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:52:52.553787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42732a-5c5f-438f-a1ae-61d83169c2a2 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:52.556132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ce42732a-5c5f-438f-a1ae-61d83169c2a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:52.568641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42732a-5c5f-438f-a1ae-61d83169c2a2 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:52.573432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf6521-2a88-44ef-9011-40724e05e03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:52.574289 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf6521-2a88-44ef-9011-40724e05e03c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:52.574569 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf6521-2a88-44ef-9011-40724e05e03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:52.574840 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf6521-2a88-44ef-9011-40724e05e03c admin admin] PATH_INFO: `/v3/users/0a93626f8db64b7193772320bfb3ed5a` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:52.576426 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf6521-2a88-44ef-9011-40724e05e03c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a93626f8db64b7193772320bfb3ed5a)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:52.578460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf6521-2a88-44ef-9011-40724e05e03c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:52.616054 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1010/1982] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:52 2022] POST /identity/v3/users => generated 295 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:52.617577 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c9e79-9f24-48bf-b3e6-02089db11377 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:52.628961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c9e79-9f24-48bf-b3e6-02089db11377 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:52.634105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b9051-ac40-4d02-923a-809a7721e408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:52.634983 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b9051-ac40-4d02-923a-809a7721e408 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:52.635262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b9051-ac40-4d02-923a-809a7721e408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:52.635527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b9051-ac40-4d02-923a-809a7721e408 admin admin] PATH_INFO: `/v3/projects/adfd862148404f9d814460e9e059b307/users/d55374999c084b3e9c2ffaaea6345886/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:52.637547 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b9051-ac40-4d02-923a-809a7721e408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adfd862148404f9d814460e9e059b307, user_id=d55374999c084b3e9c2ffaaea6345886, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:52.640197 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b9051-ac40-4d02-923a-809a7721e408 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:52.650261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1011/1983] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:52 2022] PUT /identity/v3/projects/adfd862148404f9d814460e9e059b307/users/d55374999c084b3e9c2ffaaea6345886/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:52.659528 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b9051-ac40-4d02-923a-809a7721e408 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:52.722502 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7fdf6521-2a88-44ef-9011-40724e05e03c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a93626f8db64b7193772320bfb3ed5a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:52.723209 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7fdf6521-2a88-44ef-9011-40724e05e03c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a93626f8db64b7193772320bfb3ed5a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:52.729988 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b9051-ac40-4d02-923a-809a7721e408 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:52.734943 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f499d-8f4a-47df-bb32-49ff67cfed4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:52.735660 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f499d-8f4a-47df-bb32-49ff67cfed4b admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:52.735974 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f499d-8f4a-47df-bb32-49ff67cfed4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:52.736242 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f499d-8f4a-47df-bb32-49ff67cfed4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:52.737029 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f499d-8f4a-47df-bb32-49ff67cfed4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:52.738487 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7fdf6521-2a88-44ef-9011-40724e05e03c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a93626f8db64b7193772320bfb3ed5a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:52.739019 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f499d-8f4a-47df-bb32-49ff67cfed4b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:52.739533 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7fdf6521-2a88-44ef-9011-40724e05e03c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a93626f8db64b7193772320bfb3ed5a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:52.747914 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7fdf6521-2a88-44ef-9011-40724e05e03c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a93626f8db64b7193772320bfb3ed5a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:52.832348 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 973/1984] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:52 2022] DELETE /identity/v3/users/0a93626f8db64b7193772320bfb3ed5a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:52.833272 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf6521-2a88-44ef-9011-40724e05e03c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:52.834677 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7fdf6521-2a88-44ef-9011-40724e05e03c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:52.844950 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1012/1985] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:52 2022] POST /identity/v3/projects => generated 359 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:52.846319 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8aae2-bcb2-4d6d-9711-b0c4d42fcab9 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:52.846606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8aae2-bcb2-4d6d-9711-b0c4d42fcab9 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:52.847016 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8aae2-bcb2-4d6d-9711-b0c4d42fcab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:52.883915 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-12a8aae2-bcb2-4d6d-9711-b0c4d42fcab9 None None] MFA Rules not processed for user `d55374999c084b3e9c2ffaaea6345886`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:52.891579 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-12a8aae2-bcb2-4d6d-9711-b0c4d42fcab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:52.908536 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf6521-2a88-44ef-9011-40724e05e03c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:52.968281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1013/1986] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:52.968995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8aae2-bcb2-4d6d-9711-b0c4d42fcab9 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:52.970678 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-12a8aae2-bcb2-4d6d-9711-b0c4d42fcab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:52.982220 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96e3cc-dc21-49b3-b55f-d1cd58db8474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:52.982824 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96e3cc-dc21-49b3-b55f-d1cd58db8474 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:52.983113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96e3cc-dc21-49b3-b55f-d1cd58db8474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:52.983386 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96e3cc-dc21-49b3-b55f-d1cd58db8474 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:52.984162 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96e3cc-dc21-49b3-b55f-d1cd58db8474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:52.985966 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96e3cc-dc21-49b3-b55f-d1cd58db8474 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:52.996711 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 974/1987] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:52.997432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96e3cc-dc21-49b3-b55f-d1cd58db8474 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:53.000991 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2e96e3cc-dc21-49b3-b55f-d1cd58db8474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:53.013644 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96e3cc-dc21-49b3-b55f-d1cd58db8474 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:53.018538 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182b3d3-9302-4dab-aa93-184c92322a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:53.019210 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182b3d3-9302-4dab-aa93-184c92322a0c admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:53.019477 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182b3d3-9302-4dab-aa93-184c92322a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:53.019790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182b3d3-9302-4dab-aa93-184c92322a0c admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:53.020468 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182b3d3-9302-4dab-aa93-184c92322a0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:53.022531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182b3d3-9302-4dab-aa93-184c92322a0c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:53.050923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8aae2-bcb2-4d6d-9711-b0c4d42fcab9 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:53.055986 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d0252-99d4-4eb9-9e61-70a6e38a8ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:53.056844 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d0252-99d4-4eb9-9e61-70a6e38a8ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:53.057123 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d0252-99d4-4eb9-9e61-70a6e38a8ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:53.057396 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d0252-99d4-4eb9-9e61-70a6e38a8ae2 admin admin] PATH_INFO: `/v3/projects/0802984b169744faa6cb4aa708460a5b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:53.058577 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d0252-99d4-4eb9-9e61-70a6e38a8ae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0802984b169744faa6cb4aa708460a5b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:53.060523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d0252-99d4-4eb9-9e61-70a6e38a8ae2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:53.135215 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 975/1988] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:52 2022] POST /identity/v3/users => generated 280 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:53.136083 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182b3d3-9302-4dab-aa93-184c92322a0c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:53.139457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2182b3d3-9302-4dab-aa93-184c92322a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:53.192032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-434d0252-99d4-4eb9-9e61-70a6e38a8ae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0802984b169744faa6cb4aa708460a5b', 'request_id': 'req-434d0252-99d4-4eb9-9e61-70a6e38a8ae2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:53.194308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182b3d3-9302-4dab-aa93-184c92322a0c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:53.242555 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e285934-ba98-43ab-b063-72d7858df169 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:53.243196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e285934-ba98-43ab-b063-72d7858df169 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:53.243473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e285934-ba98-43ab-b063-72d7858df169 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:53.243769 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e285934-ba98-43ab-b063-72d7858df169 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:53.299492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e285934-ba98-43ab-b063-72d7858df169 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:53.300945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e285934-ba98-43ab-b063-72d7858df169 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:53.306539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-434d0252-99d4-4eb9-9e61-70a6e38a8ae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0802984b169744faa6cb4aa708460a5b', 'request_id': 'req-434d0252-99d4-4eb9-9e61-70a6e38a8ae2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:53.311135 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 976/1989] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:53 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:53.311948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e285934-ba98-43ab-b063-72d7858df169 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:53.312356 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-434d0252-99d4-4eb9-9e61-70a6e38a8ae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0802984b169744faa6cb4aa708460a5b', 'request_id': 'req-434d0252-99d4-4eb9-9e61-70a6e38a8ae2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:53.324286 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-434d0252-99d4-4eb9-9e61-70a6e38a8ae2 admin admin] The token cache is being invalidate because project 0802984b169744faa6cb4aa708460a5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:53.324598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-434d0252-99d4-4eb9-9e61-70a6e38a8ae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:53.327912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-434d0252-99d4-4eb9-9e61-70a6e38a8ae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:53.328194 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1014/1990] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:52 2022] DELETE /identity/v3/projects/0802984b169744faa6cb4aa708460a5b => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:53.328907 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d0252-99d4-4eb9-9e61-70a6e38a8ae2 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:53.330318 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-434d0252-99d4-4eb9-9e61-70a6e38a8ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:53.374393 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e285934-ba98-43ab-b063-72d7858df169 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:53.379159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad3f3a-b743-43a2-bd84-b6880d56f600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:53.380203 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad3f3a-b743-43a2-bd84-b6880d56f600 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:53.380520 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad3f3a-b743-43a2-bd84-b6880d56f600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:53.380922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad3f3a-b743-43a2-bd84-b6880d56f600 admin admin] PATH_INFO: `/v3/projects/100900deedff45518fa0e37eb0ad2ab0/users/8e81eedaf4b24a36b656f4b431ec7833/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:53.392875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d0252-99d4-4eb9-9e61-70a6e38a8ae2 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:53.395971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad3f3a-b743-43a2-bd84-b6880d56f600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100900deedff45518fa0e37eb0ad2ab0, user_id=8e81eedaf4b24a36b656f4b431ec7833, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:53.397682 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e059f-0a20-4027-9b70-f2b773d9b473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:53.398540 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e059f-0a20-4027-9b70-f2b773d9b473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:53.398669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad3f3a-b743-43a2-bd84-b6880d56f600 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:53.398820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e059f-0a20-4027-9b70-f2b773d9b473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:53.399090 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e059f-0a20-4027-9b70-f2b773d9b473 admin admin] PATH_INFO: `/v3/projects/a3b3fff43ea54c74bb52d76d2264d008` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:53.400304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e059f-0a20-4027-9b70-f2b773d9b473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b3fff43ea54c74bb52d76d2264d008)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:53.402185 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e059f-0a20-4027-9b70-f2b773d9b473 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:53.466366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 977/1991] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:53 2022] PUT /identity/v3/projects/100900deedff45518fa0e37eb0ad2ab0/users/8e81eedaf4b24a36b656f4b431ec7833/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:53.467344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad3f3a-b743-43a2-bd84-b6880d56f600 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:53.469217 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b2ad3f3a-b743-43a2-bd84-b6880d56f600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:53.517626 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9c5e059f-0a20-4027-9b70-f2b773d9b473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b3fff43ea54c74bb52d76d2264d008', 'request_id': 'req-9c5e059f-0a20-4027-9b70-f2b773d9b473'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:53.531536 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad3f3a-b743-43a2-bd84-b6880d56f600 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:53.591121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6d0d1-0ccf-4995-98e6-486038fb4103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:53.591842 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6d0d1-0ccf-4995-98e6-486038fb4103 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:53.592126 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6d0d1-0ccf-4995-98e6-486038fb4103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:53.592398 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6d0d1-0ccf-4995-98e6-486038fb4103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:53.593133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6d0d1-0ccf-4995-98e6-486038fb4103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:53.594710 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6d0d1-0ccf-4995-98e6-486038fb4103 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:53.603390 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9c5e059f-0a20-4027-9b70-f2b773d9b473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b3fff43ea54c74bb52d76d2264d008', 'request_id': 'req-9c5e059f-0a20-4027-9b70-f2b773d9b473'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:53.605809 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 978/1992] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:53.605809 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bf1da-da58-420e-b2f4-5b0cf9e819df None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:53.605809 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bf1da-da58-420e-b2f4-5b0cf9e819df None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:53.606038 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bf1da-da58-420e-b2f4-5b0cf9e819df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:53.609624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9c5e059f-0a20-4027-9b70-f2b773d9b473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b3fff43ea54c74bb52d76d2264d008', 'request_id': 'req-9c5e059f-0a20-4027-9b70-f2b773d9b473'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:53.621356 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9c5e059f-0a20-4027-9b70-f2b773d9b473 admin admin] The token cache is being invalidate because project a3b3fff43ea54c74bb52d76d2264d008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:53.621720 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9c5e059f-0a20-4027-9b70-f2b773d9b473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:53.622896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9c5e059f-0a20-4027-9b70-f2b773d9b473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:53.623747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-be2bf1da-da58-420e-b2f4-5b0cf9e819df None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:53.624357 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1015/1993] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:53 2022] DELETE /identity/v3/projects/a3b3fff43ea54c74bb52d76d2264d008 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:53.624946 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-be2bf1da-da58-420e-b2f4-5b0cf9e819df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:53.625339 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e059f-0a20-4027-9b70-f2b773d9b473 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:53.626669 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9c5e059f-0a20-4027-9b70-f2b773d9b473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:53.633769 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 979/1994] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:53.634691 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bf1da-da58-420e-b2f4-5b0cf9e819df None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:53.635976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-be2bf1da-da58-420e-b2f4-5b0cf9e819df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:53.640117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e059f-0a20-4027-9b70-f2b773d9b473 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:53.644800 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee9a98-16fe-42b1-a09b-e7c9a054716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:53.645470 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee9a98-16fe-42b1-a09b-e7c9a054716e admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:53.645757 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee9a98-16fe-42b1-a09b-e7c9a054716e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:53.646034 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee9a98-16fe-42b1-a09b-e7c9a054716e admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:53.646775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee9a98-16fe-42b1-a09b-e7c9a054716e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:53.647486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bf1da-da58-420e-b2f4-5b0cf9e819df None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:53.648438 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee9a98-16fe-42b1-a09b-e7c9a054716e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:53.652516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee98860-1c8e-45b0-a074-a5f04d19f611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:53.663346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee98860-1c8e-45b0-a074-a5f04d19f611 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:53.663346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee98860-1c8e-45b0-a074-a5f04d19f611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:53.663346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee98860-1c8e-45b0-a074-a5f04d19f611 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:53.663346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee98860-1c8e-45b0-a074-a5f04d19f611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:53.663346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee98860-1c8e-45b0-a074-a5f04d19f611 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:53.663749 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1016/1995] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:53.663749 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0660e-7a3b-4e47-b4f6-51343aacdf3e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:53.663749 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0660e-7a3b-4e47-b4f6-51343aacdf3e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:53.663749 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0660e-7a3b-4e47-b4f6-51343aacdf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:53.669757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 980/1996] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:53.669757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30d43d-34a0-4ceb-90a9-eb1b6ff9dfcd None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:53.669757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30d43d-34a0-4ceb-90a9-eb1b6ff9dfcd None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:53.669757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30d43d-34a0-4ceb-90a9-eb1b6ff9dfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:53.678931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-86a0660e-7a3b-4e47-b4f6-51343aacdf3e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:53.680682 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-86a0660e-7a3b-4e47-b4f6-51343aacdf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:53.689168 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1017/1997] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:53.689943 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0660e-7a3b-4e47-b4f6-51343aacdf3e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:53.691767 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5b30d43d-34a0-4ceb-90a9-eb1b6ff9dfcd None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:53.692594 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5b30d43d-34a0-4ceb-90a9-eb1b6ff9dfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:53.699817 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0660e-7a3b-4e47-b4f6-51343aacdf3e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:53.701763 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 981/1998] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:53.703177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30d43d-34a0-4ceb-90a9-eb1b6ff9dfcd None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:53.707220 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bd801-9360-4394-88bb-a134cf557670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:53.708234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bd801-9360-4394-88bb-a134cf557670 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:53.708450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bd801-9360-4394-88bb-a134cf557670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:53.708718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bd801-9360-4394-88bb-a134cf557670 admin admin] PATH_INFO: `/v3/projects/100900deedff45518fa0e37eb0ad2ab0/users/8e81eedaf4b24a36b656f4b431ec7833/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:53.711272 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bd801-9360-4394-88bb-a134cf557670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100900deedff45518fa0e37eb0ad2ab0, user_id=8e81eedaf4b24a36b656f4b431ec7833, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:53.714197 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30d43d-34a0-4ceb-90a9-eb1b6ff9dfcd None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:53.714338 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bd801-9360-4394-88bb-a134cf557670 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:53.719415 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bfab1-e1a9-4ea5-be97-a62cb7cc50c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:53.720331 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bfab1-e1a9-4ea5-be97-a62cb7cc50c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:53.720597 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bfab1-e1a9-4ea5-be97-a62cb7cc50c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:53.720871 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bfab1-e1a9-4ea5-be97-a62cb7cc50c9 admin admin] PATH_INFO: `/v3/projects/f477e99ffc69447d80f55c91e945a1ae/users/1da73cd6352a4e20b20abbc3235baa0d/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:53.737290 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bfab1-e1a9-4ea5-be97-a62cb7cc50c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f477e99ffc69447d80f55c91e945a1ae, user_id=1da73cd6352a4e20b20abbc3235baa0d, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:53.738604 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1018/1999] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:53 2022] PUT /identity/v3/projects/100900deedff45518fa0e37eb0ad2ab0/users/8e81eedaf4b24a36b656f4b431ec7833/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:53.740113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bfab1-e1a9-4ea5-be97-a62cb7cc50c9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:53.740319 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa06b6b-f52d-4ec2-81e9-3430416e02bd None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:53.740615 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa06b6b-f52d-4ec2-81e9-3430416e02bd None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:53.740894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa06b6b-f52d-4ec2-81e9-3430416e02bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:53.765241 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-0aa06b6b-f52d-4ec2-81e9-3430416e02bd None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:53.766602 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0aa06b6b-f52d-4ec2-81e9-3430416e02bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:53.826622 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1019/2000] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:53.828754 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa06b6b-f52d-4ec2-81e9-3430416e02bd None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:53.838242 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa06b6b-f52d-4ec2-81e9-3430416e02bd None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:53.844999 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3756d7-b8cf-4746-93c8-6a92d45682dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:53.845657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3756d7-b8cf-4746-93c8-6a92d45682dd admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:53.845937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3756d7-b8cf-4746-93c8-6a92d45682dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:53.846208 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3756d7-b8cf-4746-93c8-6a92d45682dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:53.846933 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3756d7-b8cf-4746-93c8-6a92d45682dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:52:53.847231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3756d7-b8cf-4746-93c8-6a92d45682dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:53.848841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3756d7-b8cf-4746-93c8-6a92d45682dd admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:53.860260 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1020/2001] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:52:53.861441 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629ac8a-95ea-4a38-acb9-a86f340e2910 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:53.861720 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629ac8a-95ea-4a38-acb9-a86f340e2910 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:53.861994 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629ac8a-95ea-4a38-acb9-a86f340e2910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:53.868406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 982/2002] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:53 2022] PUT /identity/v3/projects/f477e99ffc69447d80f55c91e945a1ae/users/1da73cd6352a4e20b20abbc3235baa0d/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:53.878245 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bfab1-e1a9-4ea5-be97-a62cb7cc50c9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:53.890412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-b629ac8a-95ea-4a38-acb9-a86f340e2910 None None] MFA Rules not processed for user `8e81eedaf4b24a36b656f4b431ec7833`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:53.891777 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b629ac8a-95ea-4a38-acb9-a86f340e2910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:53.947034 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bfab1-e1a9-4ea5-be97-a62cb7cc50c9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:53.951768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40a926-3d27-4df9-b550-15646c27e244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:53.952430 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40a926-3d27-4df9-b550-15646c27e244 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:53.952709 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40a926-3d27-4df9-b550-15646c27e244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:53.952979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40a926-3d27-4df9-b550-15646c27e244 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:53.953708 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40a926-3d27-4df9-b550-15646c27e244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:52:53.954005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40a926-3d27-4df9-b550-15646c27e244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:53.955585 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40a926-3d27-4df9-b550-15646c27e244 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:53.966699 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1021/2003] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:53.971115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 983/2004] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:52:53.971219 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629ac8a-95ea-4a38-acb9-a86f340e2910 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:53.971308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da1e3c-1bd4-4646-9572-76103accadfb None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:53.971308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da1e3c-1bd4-4646-9572-76103accadfb None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:53.971308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da1e3c-1bd4-4646-9572-76103accadfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:53.982237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629ac8a-95ea-4a38-acb9-a86f340e2910 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:53.987305 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9317c3-8a81-4199-a840-511a6f89decd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:53.988138 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9317c3-8a81-4199-a840-511a6f89decd admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:53.988429 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9317c3-8a81-4199-a840-511a6f89decd admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:53.988706 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9317c3-8a81-4199-a840-511a6f89decd admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:53.989423 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9317c3-8a81-4199-a840-511a6f89decd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:53.991713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9317c3-8a81-4199-a840-511a6f89decd admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:53.999330 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-95da1e3c-1bd4-4646-9572-76103accadfb None None] MFA Rules not processed for user `1da73cd6352a4e20b20abbc3235baa0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:54.000587 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-95da1e3c-1bd4-4646-9572-76103accadfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:54.064476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 984/2005] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:53 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:54.065552 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da1e3c-1bd4-4646-9572-76103accadfb None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:54.084381 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da1e3c-1bd4-4646-9572-76103accadfb None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:54.084381 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82b395-700b-4a9b-8e31-5d9b82dd770a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:54.084752 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82b395-700b-4a9b-8e31-5d9b82dd770a admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:54.085031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82b395-700b-4a9b-8e31-5d9b82dd770a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:54.085299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82b395-700b-4a9b-8e31-5d9b82dd770a admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:54.086090 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82b395-700b-4a9b-8e31-5d9b82dd770a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:54.088021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82b395-700b-4a9b-8e31-5d9b82dd770a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:54.116893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1022/2006] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:53 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:54.116893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9317c3-8a81-4199-a840-511a6f89decd admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:54.116893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6d9317c3-8a81-4199-a840-511a6f89decd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:54.172912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9317c3-8a81-4199-a840-511a6f89decd admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:54.176487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eab802-c7a7-4ba0-8b19-94b3f0fff937 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:54.177129 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eab802-c7a7-4ba0-8b19-94b3f0fff937 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:54.177407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eab802-c7a7-4ba0-8b19-94b3f0fff937 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:54.177675 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eab802-c7a7-4ba0-8b19-94b3f0fff937 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:54.180079 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c2eab802-c7a7-4ba0-8b19-94b3f0fff937 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:54.234440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eab802-c7a7-4ba0-8b19-94b3f0fff937 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:54.235885 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eab802-c7a7-4ba0-8b19-94b3f0fff937 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:54.245144 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1023/2007] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:54.246992 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eab802-c7a7-4ba0-8b19-94b3f0fff937 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:54.301460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 985/2008] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:54 2022] POST /identity/v3/projects => generated 387 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:54.302643 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82b395-700b-4a9b-8e31-5d9b82dd770a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:54.305015 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8d82b395-700b-4a9b-8e31-5d9b82dd770a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:54.308962 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eab802-c7a7-4ba0-8b19-94b3f0fff937 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:54.366976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74b2e7-1e3b-4085-af26-3b3c6672b4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:54.367670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74b2e7-1e3b-4085-af26-3b3c6672b4bc admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:54.367980 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74b2e7-1e3b-4085-af26-3b3c6672b4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:54.368305 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74b2e7-1e3b-4085-af26-3b3c6672b4bc admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:54.368965 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74b2e7-1e3b-4085-af26-3b3c6672b4bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:54.370891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74b2e7-1e3b-4085-af26-3b3c6672b4bc admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:54.371342 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82b395-700b-4a9b-8e31-5d9b82dd770a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:54.378875 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e30a7-1bd2-404c-8949-36332421cc04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:54.379522 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e30a7-1bd2-404c-8949-36332421cc04 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:54.380479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e30a7-1bd2-404c-8949-36332421cc04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:54.380754 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e30a7-1bd2-404c-8949-36332421cc04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:54.435978 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e30a7-1bd2-404c-8949-36332421cc04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:54.437401 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e30a7-1bd2-404c-8949-36332421cc04 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:54.446007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 986/2009] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:54 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:54.453462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e30a7-1bd2-404c-8949-36332421cc04 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:54.463119 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e30a7-1bd2-404c-8949-36332421cc04 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:54.467968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daa053-0513-4376-ac59-8bb4e0c37532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:54.468638 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daa053-0513-4376-ac59-8bb4e0c37532 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:54.468915 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daa053-0513-4376-ac59-8bb4e0c37532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:54.469185 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daa053-0513-4376-ac59-8bb4e0c37532 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:54.470069 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56daa053-0513-4376-ac59-8bb4e0c37532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:54.472004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56daa053-0513-4376-ac59-8bb4e0c37532 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:54.607303 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1024/2010] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:54 2022] POST /identity/v3/users => generated 290 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:54.607303 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74b2e7-1e3b-4085-af26-3b3c6672b4bc admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:54.614369 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74b2e7-1e3b-4085-af26-3b3c6672b4bc admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:54.618844 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1336414-1904-49c4-b09d-bd0fd2064ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:54.619671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1336414-1904-49c4-b09d-bd0fd2064ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:54.619985 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1336414-1904-49c4-b09d-bd0fd2064ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:54.620254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1336414-1904-49c4-b09d-bd0fd2064ab9 admin admin] PATH_INFO: `/v3/users/1da73cd6352a4e20b20abbc3235baa0d` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:54.621451 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1336414-1904-49c4-b09d-bd0fd2064ab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da73cd6352a4e20b20abbc3235baa0d)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:54.623382 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1336414-1904-49c4-b09d-bd0fd2064ab9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:54.640447 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 987/2011] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:54 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:54.641967 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daa053-0513-4376-ac59-8bb4e0c37532 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:54.652766 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daa053-0513-4376-ac59-8bb4e0c37532 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:54.657619 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c5d5b-5190-40b3-ba5c-248d6398958d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:54.658278 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c5d5b-5190-40b3-ba5c-248d6398958d admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:54.658559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c5d5b-5190-40b3-ba5c-248d6398958d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:54.658834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c5d5b-5190-40b3-ba5c-248d6398958d admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:54.659568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c5d5b-5190-40b3-ba5c-248d6398958d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:54.662001 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c5d5b-5190-40b3-ba5c-248d6398958d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:54.674703 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 988/2012] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:54.674703 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c5d5b-5190-40b3-ba5c-248d6398958d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:54.681605 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c5d5b-5190-40b3-ba5c-248d6398958d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:54.686276 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feadaf8-4140-43fa-ac99-6a7ec22ae96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:54.686879 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feadaf8-4140-43fa-ac99-6a7ec22ae96b admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:54.687163 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feadaf8-4140-43fa-ac99-6a7ec22ae96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:54.687438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feadaf8-4140-43fa-ac99-6a7ec22ae96b admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:54.688170 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feadaf8-4140-43fa-ac99-6a7ec22ae96b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:54.689692 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feadaf8-4140-43fa-ac99-6a7ec22ae96b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:54.700295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 989/2013] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:54.702350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feadaf8-4140-43fa-ac99-6a7ec22ae96b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:54.710433 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feadaf8-4140-43fa-ac99-6a7ec22ae96b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:54.715634 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cfaf8-4f55-4431-9625-b985db8dc74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:54.716279 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cfaf8-4f55-4431-9625-b985db8dc74f admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:54.716560 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cfaf8-4f55-4431-9625-b985db8dc74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:54.716834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cfaf8-4f55-4431-9625-b985db8dc74f admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:54.717538 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04cfaf8-4f55-4431-9625-b985db8dc74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:54.719070 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04cfaf8-4f55-4431-9625-b985db8dc74f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:54.731971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 990/2014] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:54.731971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cfaf8-4f55-4431-9625-b985db8dc74f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:54.739695 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cfaf8-4f55-4431-9625-b985db8dc74f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:54.744447 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6851f-a236-49fd-b31a-98ef530529cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:54.745115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6851f-a236-49fd-b31a-98ef530529cf admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:54.745397 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6851f-a236-49fd-b31a-98ef530529cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:54.745669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6851f-a236-49fd-b31a-98ef530529cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:54.746378 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6851f-a236-49fd-b31a-98ef530529cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:54.747961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6851f-a236-49fd-b31a-98ef530529cf admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:54.757324 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 991/2015] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:54.758681 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6851f-a236-49fd-b31a-98ef530529cf admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:54.760393 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-43b6851f-a236-49fd-b31a-98ef530529cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:54.772588 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6851f-a236-49fd-b31a-98ef530529cf admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:54.777745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c1dea-78c6-4d32-ab8b-6b36e7df8c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:54.778551 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c1dea-78c6-4d32-ab8b-6b36e7df8c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:54.778828 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c1dea-78c6-4d32-ab8b-6b36e7df8c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:54.779095 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c1dea-78c6-4d32-ab8b-6b36e7df8c71 admin admin] PATH_INFO: `/v3/users/ea14303c35e3473694a7f91e759b1b02` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:54.780284 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c1dea-78c6-4d32-ab8b-6b36e7df8c71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea14303c35e3473694a7f91e759b1b02)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:54.782127 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c1dea-78c6-4d32-ab8b-6b36e7df8c71 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:54.856708 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d1336414-1904-49c4-b09d-bd0fd2064ab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da73cd6352a4e20b20abbc3235baa0d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:54.857945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d1336414-1904-49c4-b09d-bd0fd2064ab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da73cd6352a4e20b20abbc3235baa0d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:54.858229 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d1336414-1904-49c4-b09d-bd0fd2064ab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da73cd6352a4e20b20abbc3235baa0d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:54.869907 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d1336414-1904-49c4-b09d-bd0fd2064ab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da73cd6352a4e20b20abbc3235baa0d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:54.876831 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d1336414-1904-49c4-b09d-bd0fd2064ab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da73cd6352a4e20b20abbc3235baa0d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:55.021188 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1025/2016] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:54 2022] DELETE /identity/v3/users/1da73cd6352a4e20b20abbc3235baa0d => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:55.031715 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1336414-1904-49c4-b09d-bd0fd2064ab9 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:55.031715 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d1336414-1904-49c4-b09d-bd0fd2064ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:55.064254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-301c1dea-78c6-4d32-ab8b-6b36e7df8c71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea14303c35e3473694a7f91e759b1b02'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:55.064972 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-301c1dea-78c6-4d32-ab8b-6b36e7df8c71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea14303c35e3473694a7f91e759b1b02'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:55.087843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-301c1dea-78c6-4d32-ab8b-6b36e7df8c71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea14303c35e3473694a7f91e759b1b02'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:55.094770 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-301c1dea-78c6-4d32-ab8b-6b36e7df8c71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea14303c35e3473694a7f91e759b1b02'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:55.094883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1336414-1904-49c4-b09d-bd0fd2064ab9 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:55.095672 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-301c1dea-78c6-4d32-ab8b-6b36e7df8c71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea14303c35e3473694a7f91e759b1b02'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:55.100523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b747a-5308-44a1-a96b-b57538149acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:55.101443 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b747a-5308-44a1-a96b-b57538149acd admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:55.101723 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b747a-5308-44a1-a96b-b57538149acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:55.101995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b747a-5308-44a1-a96b-b57538149acd admin admin] PATH_INFO: `/v3/projects/8de609e812ff47c090a6f500116bd1f3/users/e182de3a93ec440096eaa0a005ef066d/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:55.117411 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b747a-5308-44a1-a96b-b57538149acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8de609e812ff47c090a6f500116bd1f3, user_id=e182de3a93ec440096eaa0a005ef066d, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:55.120198 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b747a-5308-44a1-a96b-b57538149acd admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:55.203655 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 992/2017] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:54 2022] DELETE /identity/v3/users/ea14303c35e3473694a7f91e759b1b02 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:55.208429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c1dea-78c6-4d32-ab8b-6b36e7df8c71 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:55.208429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-301c1dea-78c6-4d32-ab8b-6b36e7df8c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:55.261505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1026/2018] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:55 2022] PUT /identity/v3/projects/8de609e812ff47c090a6f500116bd1f3/users/e182de3a93ec440096eaa0a005ef066d/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:55.262845 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33615f9a-4f37-4e96-9e22-63172890895f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:55.263309 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33615f9a-4f37-4e96-9e22-63172890895f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:55.263582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33615f9a-4f37-4e96-9e22-63172890895f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:55.268171 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c1dea-78c6-4d32-ab8b-6b36e7df8c71 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:55.285092 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-33615f9a-4f37-4e96-9e22-63172890895f None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:55.286312 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-33615f9a-4f37-4e96-9e22-63172890895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:55.326032 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c81ce-c159-43b1-bef9-34b01fa80294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:55.326913 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c81ce-c159-43b1-bef9-34b01fa80294 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:55.327188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c81ce-c159-43b1-bef9-34b01fa80294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:55.327467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c81ce-c159-43b1-bef9-34b01fa80294 admin admin] PATH_INFO: `/v3/projects/d3c6164700aa4d2a87819ad713a5fa37/users/4097ea09148b4093914d1c4796e05df8/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:55.341625 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c81ce-c159-43b1-bef9-34b01fa80294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c6164700aa4d2a87819ad713a5fa37, user_id=4097ea09148b4093914d1c4796e05df8, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:55.344322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c81ce-c159-43b1-bef9-34b01fa80294 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:55.349780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1027/2019] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:55.349780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daf2d0-f924-44fa-8300-68816d0bc0fb None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:55.349780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daf2d0-f924-44fa-8300-68816d0bc0fb None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:55.349780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daf2d0-f924-44fa-8300-68816d0bc0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:55.366197 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-14daf2d0-f924-44fa-8300-68816d0bc0fb None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:55.367942 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-14daf2d0-f924-44fa-8300-68816d0bc0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:55.375418 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1028/2020] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:55.379049 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29342a0f-bff9-4bb6-a5c4-6c4b184ba311 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:55.379049 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29342a0f-bff9-4bb6-a5c4-6c4b184ba311 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:55.379049 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29342a0f-bff9-4bb6-a5c4-6c4b184ba311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:55.402874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-29342a0f-bff9-4bb6-a5c4-6c4b184ba311 None None] MFA Rules not processed for user `e182de3a93ec440096eaa0a005ef066d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:55.404070 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-29342a0f-bff9-4bb6-a5c4-6c4b184ba311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:55.443864 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 993/2021] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:55 2022] PUT /identity/v3/projects/d3c6164700aa4d2a87819ad713a5fa37/users/4097ea09148b4093914d1c4796e05df8/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:55.444727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c81ce-c159-43b1-bef9-34b01fa80294 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:55.446449 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6a5c81ce-c159-43b1-bef9-34b01fa80294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:55.466394 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1029/2022] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:55.467310 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29342a0f-bff9-4bb6-a5c4-6c4b184ba311 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:55.468667 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-29342a0f-bff9-4bb6-a5c4-6c4b184ba311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:55.504420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c81ce-c159-43b1-bef9-34b01fa80294 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:55.508401 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25d5ea-70ed-48d4-ada4-e708d2e8a652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:55.509054 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25d5ea-70ed-48d4-ada4-e708d2e8a652 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:55.509385 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25d5ea-70ed-48d4-ada4-e708d2e8a652 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:55.509664 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25d5ea-70ed-48d4-ada4-e708d2e8a652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:55.526104 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29342a0f-bff9-4bb6-a5c4-6c4b184ba311 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:55.529813 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b078c72-991f-45d5-acf7-6e511c2757bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:55.530452 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b078c72-991f-45d5-acf7-6e511c2757bc service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:55.530728 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b078c72-991f-45d5-acf7-6e511c2757bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:55.531022 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b078c72-991f-45d5-acf7-6e511c2757bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:55.569496 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25d5ea-70ed-48d4-ada4-e708d2e8a652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:55.570967 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25d5ea-70ed-48d4-ada4-e708d2e8a652 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:55.580586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 994/2023] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:55.581850 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898e917-cd6b-4ef7-b753-bb167031f90f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:55.582143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898e917-cd6b-4ef7-b753-bb167031f90f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:55.582422 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898e917-cd6b-4ef7-b753-bb167031f90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:55.589894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b078c72-991f-45d5-acf7-6e511c2757bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:55.591330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b078c72-991f-45d5-acf7-6e511c2757bc service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:55.599485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f898e917-cd6b-4ef7-b753-bb167031f90f None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:55.600734 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f898e917-cd6b-4ef7-b753-bb167031f90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:55.603137 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1030/2024] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:55.604096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b078c72-991f-45d5-acf7-6e511c2757bc service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:55.605737 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0b078c72-991f-45d5-acf7-6e511c2757bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:55.609488 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 995/2025] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:55.618523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b078c72-991f-45d5-acf7-6e511c2757bc service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:55.620446 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898e917-cd6b-4ef7-b753-bb167031f90f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:55.621774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f898e917-cd6b-4ef7-b753-bb167031f90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:55.624003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919db79c-6a25-4d80-9adc-f63fbc7008c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:55.624778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919db79c-6a25-4d80-9adc-f63fbc7008c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:55.625064 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919db79c-6a25-4d80-9adc-f63fbc7008c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:55.625339 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919db79c-6a25-4d80-9adc-f63fbc7008c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:55.626043 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919db79c-6a25-4d80-9adc-f63fbc7008c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:55.628034 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919db79c-6a25-4d80-9adc-f63fbc7008c3 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:55.636705 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898e917-cd6b-4ef7-b753-bb167031f90f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:55.641640 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082c75b-ba57-44fe-a3a7-2a4ac1af49d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:55.642568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082c75b-ba57-44fe-a3a7-2a4ac1af49d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:55.642796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082c75b-ba57-44fe-a3a7-2a4ac1af49d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:55.643077 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082c75b-ba57-44fe-a3a7-2a4ac1af49d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:55.655087 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082c75b-ba57-44fe-a3a7-2a4ac1af49d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:55.656728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082c75b-ba57-44fe-a3a7-2a4ac1af49d7 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:55.667278 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 996/2026] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:55.748689 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1031/2027] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:55 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:55.752833 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082c75b-ba57-44fe-a3a7-2a4ac1af49d7 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:55.763101 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082c75b-ba57-44fe-a3a7-2a4ac1af49d7 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:55.825198 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78058116-a70a-4095-bc1a-3694217b9cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:55.825889 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78058116-a70a-4095-bc1a-3694217b9cea admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:55.826171 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78058116-a70a-4095-bc1a-3694217b9cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:55.826451 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78058116-a70a-4095-bc1a-3694217b9cea admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:55.827171 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78058116-a70a-4095-bc1a-3694217b9cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:55.829240 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78058116-a70a-4095-bc1a-3694217b9cea admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:55.947672 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 997/2028] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:55 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:55.952169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919db79c-6a25-4d80-9adc-f63fbc7008c3 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:55.962577 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919db79c-6a25-4d80-9adc-f63fbc7008c3 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:55.967398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30c9f1-6dbb-4b33-b84e-fc7ea2501d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:55.968154 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30c9f1-6dbb-4b33-b84e-fc7ea2501d67 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:55.968439 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30c9f1-6dbb-4b33-b84e-fc7ea2501d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:55.968717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30c9f1-6dbb-4b33-b84e-fc7ea2501d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:55.969478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30c9f1-6dbb-4b33-b84e-fc7ea2501d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:55.971110 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30c9f1-6dbb-4b33-b84e-fc7ea2501d67 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:55.981945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1032/2029] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:55.986514 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78058116-a70a-4095-bc1a-3694217b9cea admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:55.998678 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78058116-a70a-4095-bc1a-3694217b9cea admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:56.003680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e40bd-efe2-4ec9-9fdd-dfb2c93e0b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:56.004386 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e40bd-efe2-4ec9-9fdd-dfb2c93e0b48 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:56.004815 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e40bd-efe2-4ec9-9fdd-dfb2c93e0b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:56.005106 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e40bd-efe2-4ec9-9fdd-dfb2c93e0b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:56.005843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e40bd-efe2-4ec9-9fdd-dfb2c93e0b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:56.007459 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e40bd-efe2-4ec9-9fdd-dfb2c93e0b48 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:56.018786 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 998/2030] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:56.026162 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30c9f1-6dbb-4b33-b84e-fc7ea2501d67 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:56.034250 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30c9f1-6dbb-4b33-b84e-fc7ea2501d67 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:56.039866 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aad3cd-7ea5-488c-8935-b6d4d9f36b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:56.040759 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aad3cd-7ea5-488c-8935-b6d4d9f36b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:56.041033 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aad3cd-7ea5-488c-8935-b6d4d9f36b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:56.041301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aad3cd-7ea5-488c-8935-b6d4d9f36b6f admin admin] PATH_INFO: `/v3/projects/c5126cf87625492b9e19cbbb81fc08fd/users/51c9a830a4b045e19057b1101a927d17/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:56.058984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aad3cd-7ea5-488c-8935-b6d4d9f36b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5126cf87625492b9e19cbbb81fc08fd, user_id=51c9a830a4b045e19057b1101a927d17, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:56.065676 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aad3cd-7ea5-488c-8935-b6d4d9f36b6f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:56.177565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1033/2031] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:56 2022] PUT /identity/v3/projects/c5126cf87625492b9e19cbbb81fc08fd/users/51c9a830a4b045e19057b1101a927d17/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:56.180122 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d0c00-99c5-465a-8896-b0d157257a84 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:56.180834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d0c00-99c5-465a-8896-b0d157257a84 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:56.181179 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d0c00-99c5-465a-8896-b0d157257a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:56.213614 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-643d0c00-99c5-465a-8896-b0d157257a84 None None] MFA Rules not processed for user `51c9a830a4b045e19057b1101a927d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:56.214907 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-643d0c00-99c5-465a-8896-b0d157257a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:56.268189 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aad3cd-7ea5-488c-8935-b6d4d9f36b6f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:56.270146 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-46aad3cd-7ea5-488c-8935-b6d4d9f36b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:56.286811 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 999/2032] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:56.292693 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d0c00-99c5-465a-8896-b0d157257a84 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:56.340096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aad3cd-7ea5-488c-8935-b6d4d9f36b6f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:56.345568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69141dbe-f29c-4e72-a52f-9de9c27d8771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:56.346477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69141dbe-f29c-4e72-a52f-9de9c27d8771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:56.346752 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69141dbe-f29c-4e72-a52f-9de9c27d8771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:56.347029 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69141dbe-f29c-4e72-a52f-9de9c27d8771 admin admin] PATH_INFO: `/v3/projects/f477e99ffc69447d80f55c91e945a1ae` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:56.348285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69141dbe-f29c-4e72-a52f-9de9c27d8771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f477e99ffc69447d80f55c91e945a1ae)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:56.350200 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69141dbe-f29c-4e72-a52f-9de9c27d8771 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:56.368074 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d0c00-99c5-465a-8896-b0d157257a84 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:56.372863 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e3838-f2e8-45a0-9b44-d40924dc0df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:56.373539 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e3838-f2e8-45a0-9b44-d40924dc0df1 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:56.373815 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e3838-f2e8-45a0-9b44-d40924dc0df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:56.374088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e3838-f2e8-45a0-9b44-d40924dc0df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:56.374774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e3838-f2e8-45a0-9b44-d40924dc0df1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:56.376715 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e3838-f2e8-45a0-9b44-d40924dc0df1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:56.512488 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1000/2033] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:56 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:56.513421 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e3838-f2e8-45a0-9b44-d40924dc0df1 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:56.516238 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0a8e3838-f2e8-45a0-9b44-d40924dc0df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:56.525152 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-69141dbe-f29c-4e72-a52f-9de9c27d8771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f477e99ffc69447d80f55c91e945a1ae', 'request_id': 'req-69141dbe-f29c-4e72-a52f-9de9c27d8771'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:56.580836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e3838-f2e8-45a0-9b44-d40924dc0df1 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:56.585506 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804e1f6-98ab-4bf9-837e-00eb7cd4fa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:56.586892 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804e1f6-98ab-4bf9-837e-00eb7cd4fa18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:56.587174 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804e1f6-98ab-4bf9-837e-00eb7cd4fa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:56.587448 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804e1f6-98ab-4bf9-837e-00eb7cd4fa18 admin admin] PATH_INFO: `/v3/projects/188756dc6de54bfd813589b51159942f` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:56.588659 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804e1f6-98ab-4bf9-837e-00eb7cd4fa18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=188756dc6de54bfd813589b51159942f)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:56.590577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804e1f6-98ab-4bf9-837e-00eb7cd4fa18 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:56.637756 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-69141dbe-f29c-4e72-a52f-9de9c27d8771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f477e99ffc69447d80f55c91e945a1ae', 'request_id': 'req-69141dbe-f29c-4e72-a52f-9de9c27d8771'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:56.643741 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-69141dbe-f29c-4e72-a52f-9de9c27d8771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f477e99ffc69447d80f55c91e945a1ae', 'request_id': 'req-69141dbe-f29c-4e72-a52f-9de9c27d8771'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:56.655132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-69141dbe-f29c-4e72-a52f-9de9c27d8771 admin admin] The token cache is being invalidate because project f477e99ffc69447d80f55c91e945a1ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:56.655418 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-69141dbe-f29c-4e72-a52f-9de9c27d8771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:56.656084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-69141dbe-f29c-4e72-a52f-9de9c27d8771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:56.657677 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1034/2034] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:56 2022] DELETE /identity/v3/projects/f477e99ffc69447d80f55c91e945a1ae => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:56.658424 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69141dbe-f29c-4e72-a52f-9de9c27d8771 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:56.659769 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-69141dbe-f29c-4e72-a52f-9de9c27d8771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:56.708225 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7804e1f6-98ab-4bf9-837e-00eb7cd4fa18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188756dc6de54bfd813589b51159942f', 'request_id': 'req-7804e1f6-98ab-4bf9-837e-00eb7cd4fa18'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:56.724569 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69141dbe-f29c-4e72-a52f-9de9c27d8771 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:56.775292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7804e1f6-98ab-4bf9-837e-00eb7cd4fa18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188756dc6de54bfd813589b51159942f', 'request_id': 'req-7804e1f6-98ab-4bf9-837e-00eb7cd4fa18'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:56.781301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190b022-8a33-401d-9ef6-2db35f901d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:56.781692 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7804e1f6-98ab-4bf9-837e-00eb7cd4fa18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188756dc6de54bfd813589b51159942f', 'request_id': 'req-7804e1f6-98ab-4bf9-837e-00eb7cd4fa18'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:56.782011 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190b022-8a33-401d-9ef6-2db35f901d90 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:56.782295 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190b022-8a33-401d-9ef6-2db35f901d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:56.782568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190b022-8a33-401d-9ef6-2db35f901d90 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:56.783274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190b022-8a33-401d-9ef6-2db35f901d90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:56.785248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190b022-8a33-401d-9ef6-2db35f901d90 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:56.794016 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7804e1f6-98ab-4bf9-837e-00eb7cd4fa18 admin admin] The token cache is being invalidate because project 188756dc6de54bfd813589b51159942f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:56.794333 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7804e1f6-98ab-4bf9-837e-00eb7cd4fa18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:56.795046 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7804e1f6-98ab-4bf9-837e-00eb7cd4fa18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:56.796745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1001/2035] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:56 2022] DELETE /identity/v3/projects/188756dc6de54bfd813589b51159942f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:56.797498 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804e1f6-98ab-4bf9-837e-00eb7cd4fa18 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:56.798770 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7804e1f6-98ab-4bf9-837e-00eb7cd4fa18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:56.853145 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804e1f6-98ab-4bf9-837e-00eb7cd4fa18 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:56.856813 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734860a-9f59-4272-b809-d10a8551ce8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:56.857452 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734860a-9f59-4272-b809-d10a8551ce8c service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:56.857734 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734860a-9f59-4272-b809-d10a8551ce8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:56.858005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734860a-9f59-4272-b809-d10a8551ce8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:56.859799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6734860a-9f59-4272-b809-d10a8551ce8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:56.907955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1035/2036] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:56 2022] POST /identity/v3/users => generated 296 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:56.909555 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4320710-09e1-4dc2-a17b-3f490d764d20 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:56.909993 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4320710-09e1-4dc2-a17b-3f490d764d20 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:56.911140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4320710-09e1-4dc2-a17b-3f490d764d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:56.923100 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734860a-9f59-4272-b809-d10a8551ce8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:56.925066 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734860a-9f59-4272-b809-d10a8551ce8c service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:56.930166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-c4320710-09e1-4dc2-a17b-3f490d764d20 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:56.931374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c4320710-09e1-4dc2-a17b-3f490d764d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:56.936445 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1002/2037] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:52:56.937309 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734860a-9f59-4272-b809-d10a8551ce8c service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:56.938825 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6734860a-9f59-4272-b809-d10a8551ce8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:56.961692 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1036/2038] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:56.961692 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4320710-09e1-4dc2-a17b-3f490d764d20 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:56.961692 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c4320710-09e1-4dc2-a17b-3f490d764d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:56.967928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734860a-9f59-4272-b809-d10a8551ce8c service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:56.969651 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4320710-09e1-4dc2-a17b-3f490d764d20 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:56.973155 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ce48b-7075-4f3c-b37e-3db96ff09706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:56.974137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ce48b-7075-4f3c-b37e-3db96ff09706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:56.974421 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ce48b-7075-4f3c-b37e-3db96ff09706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:56.974699 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ce48b-7075-4f3c-b37e-3db96ff09706 admin admin] PATH_INFO: `/v3/users/d55374999c084b3e9c2ffaaea6345886` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:56.976024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ce48b-7075-4f3c-b37e-3db96ff09706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d55374999c084b3e9c2ffaaea6345886)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:56.976636 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a01dc9-1adc-47ed-8ba1-e23924752415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:56.977303 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a01dc9-1adc-47ed-8ba1-e23924752415 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:56.977583 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a01dc9-1adc-47ed-8ba1-e23924752415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:56.977856 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a01dc9-1adc-47ed-8ba1-e23924752415 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:56.978115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ce48b-7075-4f3c-b37e-3db96ff09706 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:56.978588 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a01dc9-1adc-47ed-8ba1-e23924752415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:56.980448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a01dc9-1adc-47ed-8ba1-e23924752415 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:56.999976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1037/2039] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:57.001545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeceb9-e59e-4187-83bd-ff7615f5bbb6 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:57.001833 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeceb9-e59e-4187-83bd-ff7615f5bbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:57.002204 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeceb9-e59e-4187-83bd-ff7615f5bbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:57.024337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4efeceb9-e59e-4187-83bd-ff7615f5bbb6 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:57.024337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4efeceb9-e59e-4187-83bd-ff7615f5bbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:57.031042 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1038/2040] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:57.031925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeceb9-e59e-4187-83bd-ff7615f5bbb6 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:57.041729 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeceb9-e59e-4187-83bd-ff7615f5bbb6 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:57.046428 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17895a6f-5ce0-404b-bc79-2be8fcf4fe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:57.047288 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17895a6f-5ce0-404b-bc79-2be8fcf4fe36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:57.047564 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17895a6f-5ce0-404b-bc79-2be8fcf4fe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:57.047905 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17895a6f-5ce0-404b-bc79-2be8fcf4fe36 admin admin] PATH_INFO: `/v3/projects/9fa0cbcb518440fba32d8c9fdb6308d8/users/461ab849a5fd4883b0cb6e5eca7026a4/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:57.061777 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17895a6f-5ce0-404b-bc79-2be8fcf4fe36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa0cbcb518440fba32d8c9fdb6308d8, user_id=461ab849a5fd4883b0cb6e5eca7026a4, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:57.064454 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17895a6f-5ce0-404b-bc79-2be8fcf4fe36 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:57.146765 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1039/2041] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:57 2022] PUT /identity/v3/projects/9fa0cbcb518440fba32d8c9fdb6308d8/users/461ab849a5fd4883b0cb6e5eca7026a4/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:57.147841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17895a6f-5ce0-404b-bc79-2be8fcf4fe36 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:57.184833 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b20ce48b-7075-4f3c-b37e-3db96ff09706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd55374999c084b3e9c2ffaaea6345886'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:57.185499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b20ce48b-7075-4f3c-b37e-3db96ff09706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd55374999c084b3e9c2ffaaea6345886'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:57.198350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b20ce48b-7075-4f3c-b37e-3db96ff09706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd55374999c084b3e9c2ffaaea6345886'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:57.199227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b20ce48b-7075-4f3c-b37e-3db96ff09706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd55374999c084b3e9c2ffaaea6345886'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:57.208124 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b20ce48b-7075-4f3c-b37e-3db96ff09706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd55374999c084b3e9c2ffaaea6345886'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:57.214279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17895a6f-5ce0-404b-bc79-2be8fcf4fe36 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:57.219096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca64b9-a260-4b71-a07a-3454f896e04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:57.219840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca64b9-a260-4b71-a07a-3454f896e04d admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:57.220128 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca64b9-a260-4b71-a07a-3454f896e04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:57.220405 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca64b9-a260-4b71-a07a-3454f896e04d admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:57.221154 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca64b9-a260-4b71-a07a-3454f896e04d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:52:57.221461 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca64b9-a260-4b71-a07a-3454f896e04d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:57.223117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca64b9-a260-4b71-a07a-3454f896e04d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:57.236270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1040/2042] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:52:57.237145 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca64b9-a260-4b71-a07a-3454f896e04d admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:57.238926 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f6ca64b9-a260-4b71-a07a-3454f896e04d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:57.251789 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca64b9-a260-4b71-a07a-3454f896e04d admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:57.256489 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9105c1-f1b1-439e-b365-e7a3661898ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:57.257168 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9105c1-f1b1-439e-b365-e7a3661898ae admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:57.257989 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9105c1-f1b1-439e-b365-e7a3661898ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:57.258272 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9105c1-f1b1-439e-b365-e7a3661898ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:57.259014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9105c1-f1b1-439e-b365-e7a3661898ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:57.260665 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9105c1-f1b1-439e-b365-e7a3661898ae admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:57.273999 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1041/2043] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:57.274865 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9105c1-f1b1-439e-b365-e7a3661898ae admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:57.278410 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6f9105c1-f1b1-439e-b365-e7a3661898ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:57.292823 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9105c1-f1b1-439e-b365-e7a3661898ae admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:57.297907 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc642bee-9251-4d88-9b2a-2bc7f1f25e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:57.301086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc642bee-9251-4d88-9b2a-2bc7f1f25e24 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:57.301086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc642bee-9251-4d88-9b2a-2bc7f1f25e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:57.301086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc642bee-9251-4d88-9b2a-2bc7f1f25e24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:57.301086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc642bee-9251-4d88-9b2a-2bc7f1f25e24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:57.301822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc642bee-9251-4d88-9b2a-2bc7f1f25e24 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:57.364978 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1003/2044] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:52:56 2022] DELETE /identity/v3/users/d55374999c084b3e9c2ffaaea6345886 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:57.365958 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ce48b-7075-4f3c-b37e-3db96ff09706 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:57.430328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1042/2045] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:57 2022] POST /identity/v3/projects => generated 369 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:57.434063 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc642bee-9251-4d88-9b2a-2bc7f1f25e24 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:57.439120 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ce48b-7075-4f3c-b37e-3db96ff09706 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:57.516394 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc642bee-9251-4d88-9b2a-2bc7f1f25e24 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:57.522043 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e15a2-b085-4d41-b8e2-9014b669022c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:57.523216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e15a2-b085-4d41-b8e2-9014b669022c admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:57.530362 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e15a2-b085-4d41-b8e2-9014b669022c admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:57.530362 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e15a2-b085-4d41-b8e2-9014b669022c admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:57.531077 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ff643-d024-4445-953c-e4b5726d499e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:57.531447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e15a2-b085-4d41-b8e2-9014b669022c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:57.531537 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ff643-d024-4445-953c-e4b5726d499e admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:57.531537 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ff643-d024-4445-953c-e4b5726d499e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:57.531537 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ff643-d024-4445-953c-e4b5726d499e admin admin] PATH_INFO: `/v3/projects/9fa0cbcb518440fba32d8c9fdb6308d8/users/461ab849a5fd4883b0cb6e5eca7026a4/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:57.531793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e15a2-b085-4d41-b8e2-9014b669022c admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:57.534063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ff643-d024-4445-953c-e4b5726d499e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa0cbcb518440fba32d8c9fdb6308d8, user_id=461ab849a5fd4883b0cb6e5eca7026a4, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:57.536920 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ff643-d024-4445-953c-e4b5726d499e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:57.553728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1004/2046] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:57 2022] PUT /identity/v3/projects/9fa0cbcb518440fba32d8c9fdb6308d8/users/461ab849a5fd4883b0cb6e5eca7026a4/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:57.566344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f84ca6-00fb-4afd-a89b-4e8623535b54 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:57.567206 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f84ca6-00fb-4afd-a89b-4e8623535b54 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:57.567490 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f84ca6-00fb-4afd-a89b-4e8623535b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:57.605692 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f6f84ca6-00fb-4afd-a89b-4e8623535b54 None None] MFA Rules not processed for user `461ab849a5fd4883b0cb6e5eca7026a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:57.607525 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f6f84ca6-00fb-4afd-a89b-4e8623535b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:57.627428 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1043/2047] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:57 2022] POST /identity/v3/users => generated 285 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:52:57.628629 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e15a2-b085-4d41-b8e2-9014b669022c admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:57.641016 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e15a2-b085-4d41-b8e2-9014b669022c admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:57.722097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1005/2048] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:52:57.731502 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f84ca6-00fb-4afd-a89b-4e8623535b54 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:57.733213 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f6f84ca6-00fb-4afd-a89b-4e8623535b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:57.752855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6307a8-838d-4c5c-ba05-4aded4a4d87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:57.753768 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6307a8-838d-4c5c-ba05-4aded4a4d87a admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:57.754146 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6307a8-838d-4c5c-ba05-4aded4a4d87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:57.754518 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6307a8-838d-4c5c-ba05-4aded4a4d87a admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:57.755383 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6307a8-838d-4c5c-ba05-4aded4a4d87a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:57.757739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6307a8-838d-4c5c-ba05-4aded4a4d87a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:57.772882 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1044/2049] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 06:52:57.775637 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6307a8-838d-4c5c-ba05-4aded4a4d87a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:57.785885 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6307a8-838d-4c5c-ba05-4aded4a4d87a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:57.792378 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ca718-990c-4428-a851-607cab222988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:57.793156 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ca718-990c-4428-a851-607cab222988 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:57.793539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ca718-990c-4428-a851-607cab222988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:57.793934 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ca718-990c-4428-a851-607cab222988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:57.794802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ca718-990c-4428-a851-607cab222988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:57.796629 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ca718-990c-4428-a851-607cab222988 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:57.813577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f84ca6-00fb-4afd-a89b-4e8623535b54 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:57.814885 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1045/2050] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:57.821359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855430b-7de7-494e-b3ab-73e8bdb24fe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:57.821534 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ca718-990c-4428-a851-607cab222988 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:57.822633 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855430b-7de7-494e-b3ab-73e8bdb24fe9 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:57.823104 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855430b-7de7-494e-b3ab-73e8bdb24fe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:57.823649 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855430b-7de7-494e-b3ab-73e8bdb24fe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:57.833977 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ca718-990c-4428-a851-607cab222988 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:57.836140 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855430b-7de7-494e-b3ab-73e8bdb24fe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:57.837928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855430b-7de7-494e-b3ab-73e8bdb24fe9 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:57.839952 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e01e94-414a-42c7-a8df-d4f33a912588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:57.841052 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e01e94-414a-42c7-a8df-d4f33a912588 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:57.841438 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e01e94-414a-42c7-a8df-d4f33a912588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:57.841720 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e01e94-414a-42c7-a8df-d4f33a912588 admin admin] PATH_INFO: `/v3/projects/b0c408cf5ab3437692373b44053f9659/users/514e0c0399e64952b2a63cd0e81678d3/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:57.863837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1006/2051] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 06:52:57.878053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e01e94-414a-42c7-a8df-d4f33a912588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c408cf5ab3437692373b44053f9659, user_id=514e0c0399e64952b2a63cd0e81678d3, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:57.880900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e01e94-414a-42c7-a8df-d4f33a912588 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:58.008362 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855430b-7de7-494e-b3ab-73e8bdb24fe9 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:58.016700 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855430b-7de7-494e-b3ab-73e8bdb24fe9 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:58.020451 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4240f05-f077-4dd7-ab08-7ba34029c071 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:58.021097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4240f05-f077-4dd7-ab08-7ba34029c071 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:58.021376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4240f05-f077-4dd7-ab08-7ba34029c071 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:58.021631 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4240f05-f077-4dd7-ab08-7ba34029c071 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:58.023456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d4240f05-f077-4dd7-ab08-7ba34029c071 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:58.063821 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1046/2052] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:57 2022] PUT /identity/v3/projects/b0c408cf5ab3437692373b44053f9659/users/514e0c0399e64952b2a63cd0e81678d3/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:58.074161 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd558f3-1f19-465a-b2d1-94470aec94c3 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:58.074727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd558f3-1f19-465a-b2d1-94470aec94c3 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:58.075004 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd558f3-1f19-465a-b2d1-94470aec94c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:58.091793 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4240f05-f077-4dd7-ab08-7ba34029c071 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:58.094758 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4240f05-f077-4dd7-ab08-7ba34029c071 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:58.117708 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-8bd558f3-1f19-465a-b2d1-94470aec94c3 None None] MFA Rules not processed for user `514e0c0399e64952b2a63cd0e81678d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:58.118958 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8bd558f3-1f19-465a-b2d1-94470aec94c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:58.130113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1007/2053] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 06:52:58.143593 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4240f05-f077-4dd7-ab08-7ba34029c071 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:58.147977 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d4240f05-f077-4dd7-ab08-7ba34029c071 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:58.194625 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4240f05-f077-4dd7-ab08-7ba34029c071 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:58.235749 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1047/2054] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:52:58.246271 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd558f3-1f19-465a-b2d1-94470aec94c3 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:58.249232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8bd558f3-1f19-465a-b2d1-94470aec94c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:58.294545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7c2b8-b484-439f-982a-1fe2d78926c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:58.295513 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7c2b8-b484-439f-982a-1fe2d78926c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:58.295901 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7c2b8-b484-439f-982a-1fe2d78926c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:58.296251 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7c2b8-b484-439f-982a-1fe2d78926c4 admin admin] PATH_INFO: `/v3/projects/adfd862148404f9d814460e9e059b307` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:58.297583 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7c2b8-b484-439f-982a-1fe2d78926c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adfd862148404f9d814460e9e059b307)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:58.299629 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7c2b8-b484-439f-982a-1fe2d78926c4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:58.325690 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd558f3-1f19-465a-b2d1-94470aec94c3 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:58.329717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386214d-2c24-4891-bd19-ea04954d3e74 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a08d8e39f6f42bc9b93dd6d2311bcbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:58.330377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386214d-2c24-4891-bd19-ea04954d3e74 service glance] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:58.330656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386214d-2c24-4891-bd19-ea04954d3e74 service glance] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:58.330926 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386214d-2c24-4891-bd19-ea04954d3e74 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:58.342811 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386214d-2c24-4891-bd19-ea04954d3e74 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:58.344314 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386214d-2c24-4891-bd19-ea04954d3e74 service glance] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:58.357720 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1048/2055] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 06:52:58.506749 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4fb7c2b8-b484-439f-982a-1fe2d78926c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adfd862148404f9d814460e9e059b307', 'request_id': 'req-4fb7c2b8-b484-439f-982a-1fe2d78926c4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:58.607398 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4fb7c2b8-b484-439f-982a-1fe2d78926c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adfd862148404f9d814460e9e059b307', 'request_id': 'req-4fb7c2b8-b484-439f-982a-1fe2d78926c4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:58.618858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4fb7c2b8-b484-439f-982a-1fe2d78926c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adfd862148404f9d814460e9e059b307', 'request_id': 'req-4fb7c2b8-b484-439f-982a-1fe2d78926c4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:58.631286 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4fb7c2b8-b484-439f-982a-1fe2d78926c4 admin admin] The token cache is being invalidate because project adfd862148404f9d814460e9e059b307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:52:58.631575 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4fb7c2b8-b484-439f-982a-1fe2d78926c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:58.632347 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4fb7c2b8-b484-439f-982a-1fe2d78926c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:52:58.634883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1008/2056] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:52:58 2022] DELETE /identity/v3/projects/adfd862148404f9d814460e9e059b307 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:58.640003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e53f71-741c-4d42-b1f4-0b2fcf8c6946 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:58.640467 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e53f71-741c-4d42-b1f4-0b2fcf8c6946 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:58.640559 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e53f71-741c-4d42-b1f4-0b2fcf8c6946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:58.686232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-73e53f71-741c-4d42-b1f4-0b2fcf8c6946 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:58.686232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-73e53f71-741c-4d42-b1f4-0b2fcf8c6946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:58.785601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1049/2057] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:58.794169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf838d-704d-401b-8237-f53a11d11ab5 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:58.794454 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf838d-704d-401b-8237-f53a11d11ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:58.794755 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf838d-704d-401b-8237-f53a11d11ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:58.818832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4cbf838d-704d-401b-8237-f53a11d11ab5 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:58.820560 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4cbf838d-704d-401b-8237-f53a11d11ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:58.835271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1009/2058] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:58.837128 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e53f71-741c-4d42-b1f4-0b2fcf8c6946 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:58.846988 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e53f71-741c-4d42-b1f4-0b2fcf8c6946 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:58.852503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f842a-51c6-4851-8c72-8d21afe715a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:58.853161 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f842a-51c6-4851-8c72-8d21afe715a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:58.853562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f842a-51c6-4851-8c72-8d21afe715a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:58.853839 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f842a-51c6-4851-8c72-8d21afe715a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:58.854575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f842a-51c6-4851-8c72-8d21afe715a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:52:58.854876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f842a-51c6-4851-8c72-8d21afe715a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:58.856506 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f842a-51c6-4851-8c72-8d21afe715a6 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:58.872041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1050/2059] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 06:52:58.873161 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf838d-704d-401b-8237-f53a11d11ab5 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:58.883400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf838d-704d-401b-8237-f53a11d11ab5 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:58.889265 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe190a-ed8f-4810-b5ca-571a563b09c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:58.890027 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe190a-ed8f-4810-b5ca-571a563b09c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:58.890389 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe190a-ed8f-4810-b5ca-571a563b09c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:58.890776 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe190a-ed8f-4810-b5ca-571a563b09c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:58.891564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe190a-ed8f-4810-b5ca-571a563b09c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:58.893611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe190a-ed8f-4810-b5ca-571a563b09c4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:59.004595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1010/2060] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:52:58 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:52:59.009533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f842a-51c6-4851-8c72-8d21afe715a6 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:59.028504 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f842a-51c6-4851-8c72-8d21afe715a6 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:59.134217 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063085dc-8c43-4d8d-aad8-7abe13a1cb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:59.134217 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063085dc-8c43-4d8d-aad8-7abe13a1cb32 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:59.134217 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063085dc-8c43-4d8d-aad8-7abe13a1cb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:59.134217 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063085dc-8c43-4d8d-aad8-7abe13a1cb32 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:59.134570 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063085dc-8c43-4d8d-aad8-7abe13a1cb32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:59.134570 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063085dc-8c43-4d8d-aad8-7abe13a1cb32 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:59.456839 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1051/2061] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:52:59 2022] POST /identity/v3/users => generated 293 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:52:59.457015 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe190a-ed8f-4810-b5ca-571a563b09c4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:59.465365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe190a-ed8f-4810-b5ca-571a563b09c4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:59.474993 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8d3d1-1d28-4858-acf7-8f7e30f9c509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:59.476028 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8d3d1-1d28-4858-acf7-8f7e30f9c509 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:59.476414 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8d3d1-1d28-4858-acf7-8f7e30f9c509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:59.476667 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8d3d1-1d28-4858-acf7-8f7e30f9c509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:59.478215 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8d3d1-1d28-4858-acf7-8f7e30f9c509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:59.479322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8d3d1-1d28-4858-acf7-8f7e30f9c509 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:59.496167 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1011/2062] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:59.500351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063085dc-8c43-4d8d-aad8-7abe13a1cb32 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:59.514747 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063085dc-8c43-4d8d-aad8-7abe13a1cb32 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:59.520481 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c2ce0-68d6-438e-af0f-182631719a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:59.521176 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c2ce0-68d6-438e-af0f-182631719a06 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:59.521460 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c2ce0-68d6-438e-af0f-182631719a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:59.521736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c2ce0-68d6-438e-af0f-182631719a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:59.522527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c2ce0-68d6-438e-af0f-182631719a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:59.524938 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c2ce0-68d6-438e-af0f-182631719a06 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:59.538826 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1052/2063] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:52:59.540658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8d3d1-1d28-4858-acf7-8f7e30f9c509 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:59.568989 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8d3d1-1d28-4858-acf7-8f7e30f9c509 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:52:59.568989 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a93239-dcbd-4d93-a63e-7764b106c77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:52:59.568989 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a93239-dcbd-4d93-a63e-7764b106c77c admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:59.568989 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a93239-dcbd-4d93-a63e-7764b106c77c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:59.569288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a93239-dcbd-4d93-a63e-7764b106c77c admin admin] PATH_INFO: `/v3/projects/8616a7dd8df940eba1d270f2712f9775/users/87cbec3afdb045bb953f09bf2662d681/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:59.578380 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a93239-dcbd-4d93-a63e-7764b106c77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8616a7dd8df940eba1d270f2712f9775, user_id=87cbec3afdb045bb953f09bf2662d681, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:52:59.581098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a93239-dcbd-4d93-a63e-7764b106c77c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:52:59.743586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1012/2064] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:52:59 2022] PUT /identity/v3/projects/8616a7dd8df940eba1d270f2712f9775/users/87cbec3afdb045bb953f09bf2662d681/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:52:59.749656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad79c1b-6f16-40b5-a68d-16b8deafa1cd None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:52:59.750076 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad79c1b-6f16-40b5-a68d-16b8deafa1cd None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:52:59.750203 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad79c1b-6f16-40b5-a68d-16b8deafa1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:52:59.789557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-2ad79c1b-6f16-40b5-a68d-16b8deafa1cd None None] MFA Rules not processed for user `87cbec3afdb045bb953f09bf2662d681`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:52:59.791082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2ad79c1b-6f16-40b5-a68d-16b8deafa1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:52:59.875167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1053/2065] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:52:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:52:59.942302 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a93239-dcbd-4d93-a63e-7764b106c77c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:52:59.944076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a4a93239-dcbd-4d93-a63e-7764b106c77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:00.016244 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a93239-dcbd-4d93-a63e-7764b106c77c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:00.021511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79631a67-6213-458e-b01e-fe163d81bda9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:00.021511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79631a67-6213-458e-b01e-fe163d81bda9 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:00.021511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79631a67-6213-458e-b01e-fe163d81bda9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:00.021511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79631a67-6213-458e-b01e-fe163d81bda9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:00.031182 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79631a67-6213-458e-b01e-fe163d81bda9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:00.032643 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79631a67-6213-458e-b01e-fe163d81bda9 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:00.042296 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1013/2066] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:52:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:53:00.446968 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad79c1b-6f16-40b5-a68d-16b8deafa1cd None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:00.451515 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2ad79c1b-6f16-40b5-a68d-16b8deafa1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:00.468194 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad79c1b-6f16-40b5-a68d-16b8deafa1cd None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:00.477915 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c6107-7d40-4f91-a840-462bdbaf7147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:00.477915 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c6107-7d40-4f91-a840-462bdbaf7147 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:00.477915 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c6107-7d40-4f91-a840-462bdbaf7147 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:00.477915 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c6107-7d40-4f91-a840-462bdbaf7147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:00.478475 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d63c6107-7d40-4f91-a840-462bdbaf7147 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:00.598440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c6107-7d40-4f91-a840-462bdbaf7147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:00.600008 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c6107-7d40-4f91-a840-462bdbaf7147 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:00.618616 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1054/2067] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:53:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:53:02.941377 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d232fa3-f6ba-4e28-8fd8-ef02d5d13955 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:02.941901 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d232fa3-f6ba-4e28-8fd8-ef02d5d13955 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:02.942006 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d232fa3-f6ba-4e28-8fd8-ef02d5d13955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:02.984149 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5d232fa3-f6ba-4e28-8fd8-ef02d5d13955 None None] MFA Rules not processed for user `4097ea09148b4093914d1c4796e05df8`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:02.985690 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5d232fa3-f6ba-4e28-8fd8-ef02d5d13955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:03.077274 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1014/2068] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:03.092673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c6107-7d40-4f91-a840-462bdbaf7147 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:03.093621 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d63c6107-7d40-4f91-a840-462bdbaf7147 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:03.191058 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c6107-7d40-4f91-a840-462bdbaf7147 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:03.197167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611ef8c-4afc-4ba7-867c-b46ddec2222f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:03.197809 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611ef8c-4afc-4ba7-867c-b46ddec2222f service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:03.198106 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611ef8c-4afc-4ba7-867c-b46ddec2222f service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:03.198362 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611ef8c-4afc-4ba7-867c-b46ddec2222f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:03.205938 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611ef8c-4afc-4ba7-867c-b46ddec2222f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:03.207611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611ef8c-4afc-4ba7-867c-b46ddec2222f service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:03.218351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1055/2069] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:53:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:53:05.697856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b90051-a434-4aee-80a2-48bf947c0a9b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:05.698309 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b90051-a434-4aee-80a2-48bf947c0a9b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:05.698399 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b90051-a434-4aee-80a2-48bf947c0a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:05.722095 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-16b90051-a434-4aee-80a2-48bf947c0a9b None None] MFA Rules not processed for user `4097ea09148b4093914d1c4796e05df8`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:05.723417 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-16b90051-a434-4aee-80a2-48bf947c0a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:05.735980 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1015/2070] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:06.737314 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611ef8c-4afc-4ba7-867c-b46ddec2222f service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:06.739437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f611ef8c-4afc-4ba7-867c-b46ddec2222f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:06.835163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611ef8c-4afc-4ba7-867c-b46ddec2222f service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:06.839934 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6751677-613b-4415-9592-ea94fc20961a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:06.840846 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6751677-613b-4415-9592-ea94fc20961a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:06.841169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6751677-613b-4415-9592-ea94fc20961a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:06.841523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6751677-613b-4415-9592-ea94fc20961a admin admin] PATH_INFO: `/v3/users/e182de3a93ec440096eaa0a005ef066d` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:06.842815 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6751677-613b-4415-9592-ea94fc20961a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e182de3a93ec440096eaa0a005ef066d)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:06.844772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6751677-613b-4415-9592-ea94fc20961a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:07.058492 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d6751677-613b-4415-9592-ea94fc20961a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e182de3a93ec440096eaa0a005ef066d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:07.059074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d6751677-613b-4415-9592-ea94fc20961a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e182de3a93ec440096eaa0a005ef066d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:07.059678 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d6751677-613b-4415-9592-ea94fc20961a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e182de3a93ec440096eaa0a005ef066d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:07.075831 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d6751677-613b-4415-9592-ea94fc20961a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e182de3a93ec440096eaa0a005ef066d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:07.086089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d6751677-613b-4415-9592-ea94fc20961a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e182de3a93ec440096eaa0a005ef066d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:07.248226 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1056/2071] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:53:06 2022] DELETE /identity/v3/users/e182de3a93ec440096eaa0a005ef066d => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:07.268365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ce5f4-127e-4a71-8086-fa7126a55fca None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:07.268810 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ce5f4-127e-4a71-8086-fa7126a55fca None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:07.268927 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ce5f4-127e-4a71-8086-fa7126a55fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:07.289286 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-244ce5f4-127e-4a71-8086-fa7126a55fca None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:07.291304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-244ce5f4-127e-4a71-8086-fa7126a55fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:07.353230 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1016/2072] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:07.365141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6751677-613b-4415-9592-ea94fc20961a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:07.365279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d6751677-613b-4415-9592-ea94fc20961a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:07.424242 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6751677-613b-4415-9592-ea94fc20961a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:07.428003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105da4fb-a867-4214-98b0-fa726cb09d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:07.428652 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105da4fb-a867-4214-98b0-fa726cb09d41 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:07.428937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105da4fb-a867-4214-98b0-fa726cb09d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:07.429245 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105da4fb-a867-4214-98b0-fa726cb09d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:07.439852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105da4fb-a867-4214-98b0-fa726cb09d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:07.440066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105da4fb-a867-4214-98b0-fa726cb09d41 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:07.454913 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1057/2073] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:53:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:53:07.927795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ce5f4-127e-4a71-8086-fa7126a55fca None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:07.927795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-244ce5f4-127e-4a71-8086-fa7126a55fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:07.941321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ce5f4-127e-4a71-8086-fa7126a55fca None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:07.947354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99604f48-8f58-4fee-830a-f20401de335e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:07.948348 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99604f48-8f58-4fee-830a-f20401de335e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:07.948633 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99604f48-8f58-4fee-830a-f20401de335e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:07.949257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99604f48-8f58-4fee-830a-f20401de335e admin admin] PATH_INFO: `/v3/projects/8de609e812ff47c090a6f500116bd1f3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:07.956788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99604f48-8f58-4fee-830a-f20401de335e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8de609e812ff47c090a6f500116bd1f3)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:07.956788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99604f48-8f58-4fee-830a-f20401de335e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:08.147878 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-99604f48-8f58-4fee-830a-f20401de335e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8de609e812ff47c090a6f500116bd1f3', 'request_id': 'req-99604f48-8f58-4fee-830a-f20401de335e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:08.208564 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105da4fb-a867-4214-98b0-fa726cb09d41 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:08.210019 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-105da4fb-a867-4214-98b0-fa726cb09d41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:08.225047 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105da4fb-a867-4214-98b0-fa726cb09d41 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:08.290423 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cef777-4772-42ee-9ce0-1bf3b557f250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:08.291413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cef777-4772-42ee-9ce0-1bf3b557f250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:08.291677 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-99604f48-8f58-4fee-830a-f20401de335e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8de609e812ff47c090a6f500116bd1f3', 'request_id': 'req-99604f48-8f58-4fee-830a-f20401de335e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:08.292138 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cef777-4772-42ee-9ce0-1bf3b557f250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:08.292138 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cef777-4772-42ee-9ce0-1bf3b557f250 admin admin] PATH_INFO: `/v3/users/a72d4abb5ab14beaae418e4f69f2d66b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:08.293784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cef777-4772-42ee-9ce0-1bf3b557f250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72d4abb5ab14beaae418e4f69f2d66b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:08.295944 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cef777-4772-42ee-9ce0-1bf3b557f250 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:08.303549 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-99604f48-8f58-4fee-830a-f20401de335e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8de609e812ff47c090a6f500116bd1f3', 'request_id': 'req-99604f48-8f58-4fee-830a-f20401de335e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:08.320313 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-99604f48-8f58-4fee-830a-f20401de335e admin admin] The token cache is being invalidate because project 8de609e812ff47c090a6f500116bd1f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:53:08.320623 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-99604f48-8f58-4fee-830a-f20401de335e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:08.321291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-99604f48-8f58-4fee-830a-f20401de335e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:08.323220 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1017/2074] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:53:07 2022] DELETE /identity/v3/projects/8de609e812ff47c090a6f500116bd1f3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:08.327067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99604f48-8f58-4fee-830a-f20401de335e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:08.328540 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-99604f48-8f58-4fee-830a-f20401de335e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:08.341690 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99604f48-8f58-4fee-830a-f20401de335e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:08.346385 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d35fe-7479-4477-a48f-b78959c1d81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:08.347248 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d35fe-7479-4477-a48f-b78959c1d81f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:08.347528 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d35fe-7479-4477-a48f-b78959c1d81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:08.347841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d35fe-7479-4477-a48f-b78959c1d81f admin admin] PATH_INFO: `/v3/users/51c9a830a4b045e19057b1101a927d17` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:08.349048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d35fe-7479-4477-a48f-b78959c1d81f admin admin] RBAC: Authorizing `identity:delete_user(user_id=51c9a830a4b045e19057b1101a927d17)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:08.351011 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d35fe-7479-4477-a48f-b78959c1d81f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:08.567741 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-66cef777-4772-42ee-9ce0-1bf3b557f250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72d4abb5ab14beaae418e4f69f2d66b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:08.568709 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-66cef777-4772-42ee-9ce0-1bf3b557f250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72d4abb5ab14beaae418e4f69f2d66b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:08.569359 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-66cef777-4772-42ee-9ce0-1bf3b557f250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72d4abb5ab14beaae418e4f69f2d66b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:08.583275 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-66cef777-4772-42ee-9ce0-1bf3b557f250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72d4abb5ab14beaae418e4f69f2d66b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:08.590377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-66cef777-4772-42ee-9ce0-1bf3b557f250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72d4abb5ab14beaae418e4f69f2d66b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:08.603060 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ef1d35fe-7479-4477-a48f-b78959c1d81f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51c9a830a4b045e19057b1101a927d17'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:08.603766 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ef1d35fe-7479-4477-a48f-b78959c1d81f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51c9a830a4b045e19057b1101a927d17'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:08.615927 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ef1d35fe-7479-4477-a48f-b78959c1d81f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51c9a830a4b045e19057b1101a927d17'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:08.616591 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ef1d35fe-7479-4477-a48f-b78959c1d81f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51c9a830a4b045e19057b1101a927d17'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:08.623929 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ef1d35fe-7479-4477-a48f-b78959c1d81f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51c9a830a4b045e19057b1101a927d17'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:08.694488 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1058/2075] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:53:08 2022] DELETE /identity/v3/users/a72d4abb5ab14beaae418e4f69f2d66b => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:53:08.699423 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389207e-394a-4f94-9eee-d5461c9eb8d3 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:08.699729 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389207e-394a-4f94-9eee-d5461c9eb8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:08.700008 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389207e-394a-4f94-9eee-d5461c9eb8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:08.716964 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6389207e-394a-4f94-9eee-d5461c9eb8d3 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:08.718147 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6389207e-394a-4f94-9eee-d5461c9eb8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:08.779404 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1059/2076] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:53:08.786051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389207e-394a-4f94-9eee-d5461c9eb8d3 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:08.787514 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6389207e-394a-4f94-9eee-d5461c9eb8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:08.787861 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1018/2077] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:53:08 2022] DELETE /identity/v3/users/51c9a830a4b045e19057b1101a927d17 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:53:08.855445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389207e-394a-4f94-9eee-d5461c9eb8d3 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:08.916836 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855af75-9f00-4874-b30c-37145ae40087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:08.917733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855af75-9f00-4874-b30c-37145ae40087 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:08.918130 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855af75-9f00-4874-b30c-37145ae40087 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:08.918511 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855af75-9f00-4874-b30c-37145ae40087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:08.983276 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855af75-9f00-4874-b30c-37145ae40087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:08.984752 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855af75-9f00-4874-b30c-37145ae40087 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:08.995064 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1060/2078] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:53:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 06:53:09.345824 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d35fe-7479-4477-a48f-b78959c1d81f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:09.347855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ef1d35fe-7479-4477-a48f-b78959c1d81f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:09.362634 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d35fe-7479-4477-a48f-b78959c1d81f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:09.370187 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7cacc-720b-4390-9039-df19976c4be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:09.371820 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7cacc-720b-4390-9039-df19976c4be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:09.380400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7cacc-720b-4390-9039-df19976c4be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:09.380400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7cacc-720b-4390-9039-df19976c4be6 admin admin] PATH_INFO: `/v3/projects/c5126cf87625492b9e19cbbb81fc08fd` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:09.380400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7cacc-720b-4390-9039-df19976c4be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5126cf87625492b9e19cbbb81fc08fd)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:09.380400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7cacc-720b-4390-9039-df19976c4be6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:09.474979 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855af75-9f00-4874-b30c-37145ae40087 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:09.484242 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a855af75-9f00-4874-b30c-37145ae40087 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:09.502243 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855af75-9f00-4874-b30c-37145ae40087 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:09.509544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e01e9-83f2-410a-bef8-4ce6e53e0248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:09.510975 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e01e9-83f2-410a-bef8-4ce6e53e0248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:09.511942 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e01e9-83f2-410a-bef8-4ce6e53e0248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:09.512887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e01e9-83f2-410a-bef8-4ce6e53e0248 admin admin] PATH_INFO: `/v3/projects/6194e4b8913c47b48d41b7dcc3f9d2cc` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:09.514600 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e01e9-83f2-410a-bef8-4ce6e53e0248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6194e4b8913c47b48d41b7dcc3f9d2cc)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:09.516613 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e01e9-83f2-410a-bef8-4ce6e53e0248 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:09.523481 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d9e7cacc-720b-4390-9039-df19976c4be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5126cf87625492b9e19cbbb81fc08fd', 'request_id': 'req-d9e7cacc-720b-4390-9039-df19976c4be6'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:09.594154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d9e7cacc-720b-4390-9039-df19976c4be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5126cf87625492b9e19cbbb81fc08fd', 'request_id': 'req-d9e7cacc-720b-4390-9039-df19976c4be6'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:09.600126 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d9e7cacc-720b-4390-9039-df19976c4be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5126cf87625492b9e19cbbb81fc08fd', 'request_id': 'req-d9e7cacc-720b-4390-9039-df19976c4be6'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:09.614256 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d9e7cacc-720b-4390-9039-df19976c4be6 admin admin] The token cache is being invalidate because project c5126cf87625492b9e19cbbb81fc08fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:53:09.614541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d9e7cacc-720b-4390-9039-df19976c4be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:09.615646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d9e7cacc-720b-4390-9039-df19976c4be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:09.617390 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1019/2079] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:53:09 2022] DELETE /identity/v3/projects/c5126cf87625492b9e19cbbb81fc08fd => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:09.621356 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7cacc-720b-4390-9039-df19976c4be6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:09.622640 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d9e7cacc-720b-4390-9039-df19976c4be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:09.655262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-970e01e9-83f2-410a-bef8-4ce6e53e0248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6194e4b8913c47b48d41b7dcc3f9d2cc', 'request_id': 'req-970e01e9-83f2-410a-bef8-4ce6e53e0248'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:09.689237 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7cacc-720b-4390-9039-df19976c4be6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:09.740656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-970e01e9-83f2-410a-bef8-4ce6e53e0248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6194e4b8913c47b48d41b7dcc3f9d2cc', 'request_id': 'req-970e01e9-83f2-410a-bef8-4ce6e53e0248'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:09.743325 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e775f-fb84-44d8-8bf6-334522460011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:09.744230 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e775f-fb84-44d8-8bf6-334522460011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:09.744547 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e775f-fb84-44d8-8bf6-334522460011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:09.744897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e775f-fb84-44d8-8bf6-334522460011 admin admin] PATH_INFO: `/v3/users/461ab849a5fd4883b0cb6e5eca7026a4` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:09.746141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e775f-fb84-44d8-8bf6-334522460011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=461ab849a5fd4883b0cb6e5eca7026a4)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:09.747492 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-970e01e9-83f2-410a-bef8-4ce6e53e0248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6194e4b8913c47b48d41b7dcc3f9d2cc', 'request_id': 'req-970e01e9-83f2-410a-bef8-4ce6e53e0248'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:09.748063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e775f-fb84-44d8-8bf6-334522460011 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:09.758650 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-970e01e9-83f2-410a-bef8-4ce6e53e0248 admin admin] The token cache is being invalidate because project 6194e4b8913c47b48d41b7dcc3f9d2cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:53:09.758937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-970e01e9-83f2-410a-bef8-4ce6e53e0248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:09.759714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-970e01e9-83f2-410a-bef8-4ce6e53e0248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:09.761290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1061/2080] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:53:09 2022] DELETE /identity/v3/projects/6194e4b8913c47b48d41b7dcc3f9d2cc => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:09.768653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e01e9-83f2-410a-bef8-4ce6e53e0248 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:09.770010 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-970e01e9-83f2-410a-bef8-4ce6e53e0248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:09.782653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e01e9-83f2-410a-bef8-4ce6e53e0248 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:09.787257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f86831-4fb2-4f0a-99d3-310df5ce45b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:09.788138 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f86831-4fb2-4f0a-99d3-310df5ce45b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:09.788414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f86831-4fb2-4f0a-99d3-310df5ce45b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:09.789231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f86831-4fb2-4f0a-99d3-310df5ce45b2 admin admin] PATH_INFO: `/v3/users/5fb4be83fd4744b399c710b5adaec660` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:09.793459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f86831-4fb2-4f0a-99d3-310df5ce45b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb4be83fd4744b399c710b5adaec660)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:09.793459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f86831-4fb2-4f0a-99d3-310df5ce45b2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:09.981656 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-418e775f-fb84-44d8-8bf6-334522460011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '461ab849a5fd4883b0cb6e5eca7026a4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:09.982375 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-418e775f-fb84-44d8-8bf6-334522460011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '461ab849a5fd4883b0cb6e5eca7026a4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:09.995759 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-418e775f-fb84-44d8-8bf6-334522460011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '461ab849a5fd4883b0cb6e5eca7026a4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:09.996267 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-418e775f-fb84-44d8-8bf6-334522460011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '461ab849a5fd4883b0cb6e5eca7026a4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:10.003128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-418e775f-fb84-44d8-8bf6-334522460011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '461ab849a5fd4883b0cb6e5eca7026a4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:10.076776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-27f86831-4fb2-4f0a-99d3-310df5ce45b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb4be83fd4744b399c710b5adaec660'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:10.077434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-27f86831-4fb2-4f0a-99d3-310df5ce45b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb4be83fd4744b399c710b5adaec660'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:10.078036 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-27f86831-4fb2-4f0a-99d3-310df5ce45b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb4be83fd4744b399c710b5adaec660'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:10.089978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-27f86831-4fb2-4f0a-99d3-310df5ce45b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb4be83fd4744b399c710b5adaec660'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:10.096832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-27f86831-4fb2-4f0a-99d3-310df5ce45b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb4be83fd4744b399c710b5adaec660'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:10.129506 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1020/2081] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:53:09 2022] DELETE /identity/v3/users/461ab849a5fd4883b0cb6e5eca7026a4 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:53:10.312340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1062/2082] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:53:09 2022] DELETE /identity/v3/users/5fb4be83fd4744b399c710b5adaec660 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:10.916856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e775f-fb84-44d8-8bf6-334522460011 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:10.919137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-418e775f-fb84-44d8-8bf6-334522460011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:10.931267 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f86831-4fb2-4f0a-99d3-310df5ce45b2 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:10.932645 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-27f86831-4fb2-4f0a-99d3-310df5ce45b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:11.013698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e775f-fb84-44d8-8bf6-334522460011 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:11.016693 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f86831-4fb2-4f0a-99d3-310df5ce45b2 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:11.019612 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30039c59-2eed-4744-8c95-ce9d79bd5fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:11.020717 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30039c59-2eed-4744-8c95-ce9d79bd5fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:11.021212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30039c59-2eed-4744-8c95-ce9d79bd5fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:11.021728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30039c59-2eed-4744-8c95-ce9d79bd5fc8 admin admin] PATH_INFO: `/v3/projects/6f87015faa37463ca1f54e90ffc20237` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:11.022064 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a61f5-9268-4e62-9ed7-0edb08bd74e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:11.023888 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a61f5-9268-4e62-9ed7-0edb08bd74e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:11.024245 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a61f5-9268-4e62-9ed7-0edb08bd74e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:11.024471 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30039c59-2eed-4744-8c95-ce9d79bd5fc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f87015faa37463ca1f54e90ffc20237)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:11.024911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a61f5-9268-4e62-9ed7-0edb08bd74e0 admin admin] PATH_INFO: `/v3/users/87cbec3afdb045bb953f09bf2662d681` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:11.026527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a61f5-9268-4e62-9ed7-0edb08bd74e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87cbec3afdb045bb953f09bf2662d681)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:11.027132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30039c59-2eed-4744-8c95-ce9d79bd5fc8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:11.028548 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a61f5-9268-4e62-9ed7-0edb08bd74e0 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:11.329124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-421a61f5-9268-4e62-9ed7-0edb08bd74e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87cbec3afdb045bb953f09bf2662d681'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:11.329895 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-421a61f5-9268-4e62-9ed7-0edb08bd74e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87cbec3afdb045bb953f09bf2662d681'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:11.331336 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-421a61f5-9268-4e62-9ed7-0edb08bd74e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87cbec3afdb045bb953f09bf2662d681'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:11.341703 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-30039c59-2eed-4744-8c95-ce9d79bd5fc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f87015faa37463ca1f54e90ffc20237', 'request_id': 'req-30039c59-2eed-4744-8c95-ce9d79bd5fc8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:11.358068 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-421a61f5-9268-4e62-9ed7-0edb08bd74e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87cbec3afdb045bb953f09bf2662d681'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:11.374905 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-421a61f5-9268-4e62-9ed7-0edb08bd74e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87cbec3afdb045bb953f09bf2662d681'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:11.444180 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-30039c59-2eed-4744-8c95-ce9d79bd5fc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f87015faa37463ca1f54e90ffc20237', 'request_id': 'req-30039c59-2eed-4744-8c95-ce9d79bd5fc8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:11.450183 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-30039c59-2eed-4744-8c95-ce9d79bd5fc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f87015faa37463ca1f54e90ffc20237', 'request_id': 'req-30039c59-2eed-4744-8c95-ce9d79bd5fc8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:11.461628 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-30039c59-2eed-4744-8c95-ce9d79bd5fc8 admin admin] The token cache is being invalidate because project 6f87015faa37463ca1f54e90ffc20237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:53:11.461912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-30039c59-2eed-4744-8c95-ce9d79bd5fc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:11.462565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-30039c59-2eed-4744-8c95-ce9d79bd5fc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:11.464150 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1021/2083] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:53:10 2022] DELETE /identity/v3/projects/6f87015faa37463ca1f54e90ffc20237 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:11.467839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30039c59-2eed-4744-8c95-ce9d79bd5fc8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:11.469170 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-30039c59-2eed-4744-8c95-ce9d79bd5fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:11.543933 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30039c59-2eed-4744-8c95-ce9d79bd5fc8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:11.551155 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1063/2084] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:53:10 2022] DELETE /identity/v3/users/87cbec3afdb045bb953f09bf2662d681 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:11.551155 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a61f5-9268-4e62-9ed7-0edb08bd74e0 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:11.551155 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-421a61f5-9268-4e62-9ed7-0edb08bd74e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:11.555318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4a7c4-1c14-485d-8850-6da09b5be26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:11.556447 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4a7c4-1c14-485d-8850-6da09b5be26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:11.560138 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4a7c4-1c14-485d-8850-6da09b5be26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:11.560138 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4a7c4-1c14-485d-8850-6da09b5be26d admin admin] PATH_INFO: `/v3/projects/9fa0cbcb518440fba32d8c9fdb6308d8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:11.560138 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4a7c4-1c14-485d-8850-6da09b5be26d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fa0cbcb518440fba32d8c9fdb6308d8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:11.561369 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4a7c4-1c14-485d-8850-6da09b5be26d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:11.648427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a61f5-9268-4e62-9ed7-0edb08bd74e0 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:11.653529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe1c0c-0279-4d91-841f-6ee2370fd0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:11.654429 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe1c0c-0279-4d91-841f-6ee2370fd0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:11.654743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe1c0c-0279-4d91-841f-6ee2370fd0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:11.655025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe1c0c-0279-4d91-841f-6ee2370fd0b9 admin admin] PATH_INFO: `/v3/users/8e81eedaf4b24a36b656f4b431ec7833` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:11.656264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe1c0c-0279-4d91-841f-6ee2370fd0b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e81eedaf4b24a36b656f4b431ec7833)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:11.658225 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe1c0c-0279-4d91-841f-6ee2370fd0b9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:11.685433 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-85d4a7c4-1c14-485d-8850-6da09b5be26d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fa0cbcb518440fba32d8c9fdb6308d8', 'request_id': 'req-85d4a7c4-1c14-485d-8850-6da09b5be26d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:11.769573 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-85d4a7c4-1c14-485d-8850-6da09b5be26d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fa0cbcb518440fba32d8c9fdb6308d8', 'request_id': 'req-85d4a7c4-1c14-485d-8850-6da09b5be26d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:11.778209 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-85d4a7c4-1c14-485d-8850-6da09b5be26d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fa0cbcb518440fba32d8c9fdb6308d8', 'request_id': 'req-85d4a7c4-1c14-485d-8850-6da09b5be26d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:11.793530 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-85d4a7c4-1c14-485d-8850-6da09b5be26d admin admin] The token cache is being invalidate because project 9fa0cbcb518440fba32d8c9fdb6308d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:53:11.793896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-85d4a7c4-1c14-485d-8850-6da09b5be26d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:11.794514 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-85d4a7c4-1c14-485d-8850-6da09b5be26d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:11.805837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1022/2085] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:53:11 2022] DELETE /identity/v3/projects/9fa0cbcb518440fba32d8c9fdb6308d8 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:11.807304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff091d-d240-44e6-b542-da6c0390a825 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:11.807596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff091d-d240-44e6-b542-da6c0390a825 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:11.807924 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff091d-d240-44e6-b542-da6c0390a825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:11.848628 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-02fe1c0c-0279-4d91-841f-6ee2370fd0b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e81eedaf4b24a36b656f4b431ec7833'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:11.849410 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-02fe1c0c-0279-4d91-841f-6ee2370fd0b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e81eedaf4b24a36b656f4b431ec7833'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:11.850052 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-02fe1c0c-0279-4d91-841f-6ee2370fd0b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e81eedaf4b24a36b656f4b431ec7833'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:11.855141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4dff091d-d240-44e6-b542-da6c0390a825 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:11.858083 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4dff091d-d240-44e6-b542-da6c0390a825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:11.876996 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-02fe1c0c-0279-4d91-841f-6ee2370fd0b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e81eedaf4b24a36b656f4b431ec7833'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:11.892024 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-02fe1c0c-0279-4d91-841f-6ee2370fd0b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e81eedaf4b24a36b656f4b431ec7833'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:11.937439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1023/2086] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:11.939104 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eaca32-6667-4a2e-ad19-af23c17805f8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:11.939397 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eaca32-6667-4a2e-ad19-af23c17805f8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:11.939824 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eaca32-6667-4a2e-ad19-af23c17805f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:11.961780 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-11eaca32-6667-4a2e-ad19-af23c17805f8 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:11.963190 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-11eaca32-6667-4a2e-ad19-af23c17805f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:11.972276 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1024/2087] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:11.977761 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eaca32-6667-4a2e-ad19-af23c17805f8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:11.979450 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-11eaca32-6667-4a2e-ad19-af23c17805f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:11.999021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1064/2088] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:53:11 2022] DELETE /identity/v3/users/8e81eedaf4b24a36b656f4b431ec7833 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:12.004164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635632a-c53e-412a-b4f6-d5b4d5698579 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:12.004164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635632a-c53e-412a-b4f6-d5b4d5698579 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:12.004164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635632a-c53e-412a-b4f6-d5b4d5698579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:12.026317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-1635632a-c53e-412a-b4f6-d5b4d5698579 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:12.027555 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1635632a-c53e-412a-b4f6-d5b4d5698579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:12.064867 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eaca32-6667-4a2e-ad19-af23c17805f8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:12.138852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d633645-ddda-498e-8b42-475a84cf7181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:12.139650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d633645-ddda-498e-8b42-475a84cf7181 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:12.139968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d633645-ddda-498e-8b42-475a84cf7181 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:12.140435 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d633645-ddda-498e-8b42-475a84cf7181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:12.149388 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1065/2089] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:12.154022 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635632a-c53e-412a-b4f6-d5b4d5698579 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:12.165428 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635632a-c53e-412a-b4f6-d5b4d5698579 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:12.170583 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53708856-ff76-44d0-9e77-c5b7e92efc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:12.171319 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53708856-ff76-44d0-9e77-c5b7e92efc2f admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:12.171654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53708856-ff76-44d0-9e77-c5b7e92efc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:12.172018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53708856-ff76-44d0-9e77-c5b7e92efc2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:12.173326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53708856-ff76-44d0-9e77-c5b7e92efc2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:53:12.173326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53708856-ff76-44d0-9e77-c5b7e92efc2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:12.175397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53708856-ff76-44d0-9e77-c5b7e92efc2f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:12.188512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1066/2090] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:53:12.193084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53708856-ff76-44d0-9e77-c5b7e92efc2f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:12.204101 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53708856-ff76-44d0-9e77-c5b7e92efc2f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:12.430206 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb2ef0-3088-483c-a759-9291457b3124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:12.430206 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb2ef0-3088-483c-a759-9291457b3124 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:12.430206 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb2ef0-3088-483c-a759-9291457b3124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:12.430206 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb2ef0-3088-483c-a759-9291457b3124 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:12.430828 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb2ef0-3088-483c-a759-9291457b3124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:12.430828 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb2ef0-3088-483c-a759-9291457b3124 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:12.430999 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d633645-ddda-498e-8b42-475a84cf7181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:12.430999 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d633645-ddda-498e-8b42-475a84cf7181 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:12.430999 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1025/2091] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:53:12.568627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1067/2092] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:53:12 2022] POST /identity/v3/projects => generated 365 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:53:12.569793 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d633645-ddda-498e-8b42-475a84cf7181 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:12.579309 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d633645-ddda-498e-8b42-475a84cf7181 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:12.678140 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15302a5-668f-48b4-b12a-dac13e6094f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:12.679338 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15302a5-668f-48b4-b12a-dac13e6094f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:12.681352 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15302a5-668f-48b4-b12a-dac13e6094f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:12.681877 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15302a5-668f-48b4-b12a-dac13e6094f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:12.684292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15302a5-668f-48b4-b12a-dac13e6094f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:12.686374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15302a5-668f-48b4-b12a-dac13e6094f1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:12.760773 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1026/2093] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:53:12 2022] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:53:12.764129 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb2ef0-3088-483c-a759-9291457b3124 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:12.778091 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb2ef0-3088-483c-a759-9291457b3124 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:12.790137 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721de866-3b7a-41ca-b547-32c843a6b7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:12.791026 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721de866-3b7a-41ca-b547-32c843a6b7cb admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:12.791317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721de866-3b7a-41ca-b547-32c843a6b7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:12.791587 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721de866-3b7a-41ca-b547-32c843a6b7cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:12.795676 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721de866-3b7a-41ca-b547-32c843a6b7cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:12.799056 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721de866-3b7a-41ca-b547-32c843a6b7cb admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:12.821716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1068/2094] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:53:12.825909 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15302a5-668f-48b4-b12a-dac13e6094f1 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:12.837339 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15302a5-668f-48b4-b12a-dac13e6094f1 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:12.843480 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b430d-2329-461d-a99b-3a626bce905f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:12.844330 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b430d-2329-461d-a99b-3a626bce905f admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:12.844724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b430d-2329-461d-a99b-3a626bce905f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:12.845068 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b430d-2329-461d-a99b-3a626bce905f admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:12.845934 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b430d-2329-461d-a99b-3a626bce905f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:12.848358 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b430d-2329-461d-a99b-3a626bce905f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:12.879631 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1027/2095] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:53:12.884918 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721de866-3b7a-41ca-b547-32c843a6b7cb admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:12.900565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721de866-3b7a-41ca-b547-32c843a6b7cb admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:12.906369 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23695a5b-bb02-4943-b989-68c05f4a612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:12.907413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23695a5b-bb02-4943-b989-68c05f4a612b admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:12.907832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23695a5b-bb02-4943-b989-68c05f4a612b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:12.908181 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23695a5b-bb02-4943-b989-68c05f4a612b admin admin] PATH_INFO: `/v3/projects/0db26094a3764d7fa60ed773f96f3344/users/74853f347d744b9b924b03b7530e4dfd/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:12.925218 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23695a5b-bb02-4943-b989-68c05f4a612b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0db26094a3764d7fa60ed773f96f3344, user_id=74853f347d744b9b924b03b7530e4dfd, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:12.928353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23695a5b-bb02-4943-b989-68c05f4a612b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:12.950467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b430d-2329-461d-a99b-3a626bce905f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:12.952284 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-472b430d-2329-461d-a99b-3a626bce905f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:12.994702 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b430d-2329-461d-a99b-3a626bce905f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:13.000141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25d1f0-f876-4852-b58a-ad653746cd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:13.001490 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25d1f0-f876-4852-b58a-ad653746cd3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:13.001994 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25d1f0-f876-4852-b58a-ad653746cd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:13.002466 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25d1f0-f876-4852-b58a-ad653746cd3d admin admin] PATH_INFO: `/v3/projects/8616a7dd8df940eba1d270f2712f9775` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:13.004337 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25d1f0-f876-4852-b58a-ad653746cd3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8616a7dd8df940eba1d270f2712f9775)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:13.007014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25d1f0-f876-4852-b58a-ad653746cd3d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:13.045481 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1069/2096] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:53:12 2022] PUT /identity/v3/projects/0db26094a3764d7fa60ed773f96f3344/users/74853f347d744b9b924b03b7530e4dfd/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:13.047052 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23695a5b-bb02-4943-b989-68c05f4a612b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:13.057241 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-23695a5b-bb02-4943-b989-68c05f4a612b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:13.156789 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7c25d1f0-f876-4852-b58a-ad653746cd3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8616a7dd8df940eba1d270f2712f9775', 'request_id': 'req-7c25d1f0-f876-4852-b58a-ad653746cd3d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:13.176393 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23695a5b-bb02-4943-b989-68c05f4a612b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:13.243515 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759d40b-9744-44ca-9270-6203a39888eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:13.244468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759d40b-9744-44ca-9270-6203a39888eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:13.244758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759d40b-9744-44ca-9270-6203a39888eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:13.245055 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759d40b-9744-44ca-9270-6203a39888eb admin admin] PATH_INFO: `/v3/projects/100900deedff45518fa0e37eb0ad2ab0` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:13.246289 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759d40b-9744-44ca-9270-6203a39888eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=100900deedff45518fa0e37eb0ad2ab0)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:13.248279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759d40b-9744-44ca-9270-6203a39888eb admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:13.278019 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7c25d1f0-f876-4852-b58a-ad653746cd3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8616a7dd8df940eba1d270f2712f9775', 'request_id': 'req-7c25d1f0-f876-4852-b58a-ad653746cd3d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:13.284022 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7c25d1f0-f876-4852-b58a-ad653746cd3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8616a7dd8df940eba1d270f2712f9775', 'request_id': 'req-7c25d1f0-f876-4852-b58a-ad653746cd3d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:13.296840 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7c25d1f0-f876-4852-b58a-ad653746cd3d admin admin] The token cache is being invalidate because project 8616a7dd8df940eba1d270f2712f9775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:53:13.297126 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7c25d1f0-f876-4852-b58a-ad653746cd3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:13.297790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7c25d1f0-f876-4852-b58a-ad653746cd3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:13.299475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1028/2097] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:53:12 2022] DELETE /identity/v3/projects/8616a7dd8df940eba1d270f2712f9775 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:53:13.301128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b205f-0515-420d-ae2b-9d5ede5a990f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:13.306625 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b205f-0515-420d-ae2b-9d5ede5a990f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:13.306625 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b205f-0515-420d-ae2b-9d5ede5a990f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:13.329209 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0c1b205f-0515-420d-ae2b-9d5ede5a990f None None] MFA Rules not processed for user `74853f347d744b9b924b03b7530e4dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:13.330433 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0c1b205f-0515-420d-ae2b-9d5ede5a990f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:13.385787 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0759d40b-9744-44ca-9270-6203a39888eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100900deedff45518fa0e37eb0ad2ab0', 'request_id': 'req-0759d40b-9744-44ca-9270-6203a39888eb'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:13.433777 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1029/2098] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:13.433777 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad99bc-3db7-475d-a139-20a6dec5de6a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:13.433777 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad99bc-3db7-475d-a139-20a6dec5de6a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:13.433777 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad99bc-3db7-475d-a139-20a6dec5de6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:13.454287 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-31ad99bc-3db7-475d-a139-20a6dec5de6a None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:13.455414 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-31ad99bc-3db7-475d-a139-20a6dec5de6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:13.461683 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0759d40b-9744-44ca-9270-6203a39888eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100900deedff45518fa0e37eb0ad2ab0', 'request_id': 'req-0759d40b-9744-44ca-9270-6203a39888eb'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:13.471803 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0759d40b-9744-44ca-9270-6203a39888eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100900deedff45518fa0e37eb0ad2ab0', 'request_id': 'req-0759d40b-9744-44ca-9270-6203a39888eb'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:13.489021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0759d40b-9744-44ca-9270-6203a39888eb admin admin] The token cache is being invalidate because project 100900deedff45518fa0e37eb0ad2ab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:53:13.489598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0759d40b-9744-44ca-9270-6203a39888eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:13.490455 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0759d40b-9744-44ca-9270-6203a39888eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:13.492212 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1070/2099] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:53:13 2022] DELETE /identity/v3/projects/100900deedff45518fa0e37eb0ad2ab0 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:13.496665 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759d40b-9744-44ca-9270-6203a39888eb admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:13.498416 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0759d40b-9744-44ca-9270-6203a39888eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:13.544181 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1030/2100] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:13.545585 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64642c-d0de-487f-a173-3824746ca477 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:13.546576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64642c-d0de-487f-a173-3824746ca477 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:13.546707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64642c-d0de-487f-a173-3824746ca477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:13.576460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-cc64642c-d0de-487f-a173-3824746ca477 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:13.577864 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cc64642c-d0de-487f-a173-3824746ca477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:13.591729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1031/2101] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:13.591729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad809c-813b-4e50-b965-92e68cb033c6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:13.591729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad809c-813b-4e50-b965-92e68cb033c6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:13.591729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad809c-813b-4e50-b965-92e68cb033c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:13.596128 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759d40b-9744-44ca-9270-6203a39888eb admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:13.608612 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652b77c-5b31-48ac-b661-efc9638a13f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:13.609422 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652b77c-5b31-48ac-b661-efc9638a13f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:13.609813 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652b77c-5b31-48ac-b661-efc9638a13f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:13.610315 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652b77c-5b31-48ac-b661-efc9638a13f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:13.611142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652b77c-5b31-48ac-b661-efc9638a13f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:13.614240 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652b77c-5b31-48ac-b661-efc9638a13f2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:13.634437 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-39ad809c-813b-4e50-b965-92e68cb033c6 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:13.641153 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-39ad809c-813b-4e50-b965-92e68cb033c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:13.661083 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1032/2102] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:13.661083 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50deb3-8a2c-41d1-9f3f-3863378e4b9a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:13.661083 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50deb3-8a2c-41d1-9f3f-3863378e4b9a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:13.661083 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50deb3-8a2c-41d1-9f3f-3863378e4b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:13.680998 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ed50deb3-8a2c-41d1-9f3f-3863378e4b9a None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:13.682245 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ed50deb3-8a2c-41d1-9f3f-3863378e4b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:13.697346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1033/2103] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:13.698292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50deb3-8a2c-41d1-9f3f-3863378e4b9a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:13.708479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50deb3-8a2c-41d1-9f3f-3863378e4b9a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:13.711049 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1071/2104] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:53:13 2022] POST /identity/v3/projects => generated 367 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:53:13.712622 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652b77c-5b31-48ac-b661-efc9638a13f2 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:13.780282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cff484-22c1-4190-9652-4277caecb54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:13.780953 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cff484-22c1-4190-9652-4277caecb54b admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:13.781233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cff484-22c1-4190-9652-4277caecb54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:13.781505 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cff484-22c1-4190-9652-4277caecb54b admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:13.782456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cff484-22c1-4190-9652-4277caecb54b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:53:13.782766 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cff484-22c1-4190-9652-4277caecb54b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:13.784451 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cff484-22c1-4190-9652-4277caecb54b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:13.793945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652b77c-5b31-48ac-b661-efc9638a13f2 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:13.800219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1034/2105] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:53:13.800885 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cff484-22c1-4190-9652-4277caecb54b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:13.808529 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc1f4a-e775-46e4-8531-a7b68211411f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:13.809827 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc1f4a-e775-46e4-8531-a7b68211411f admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:13.809827 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc1f4a-e775-46e4-8531-a7b68211411f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:13.809827 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc1f4a-e775-46e4-8531-a7b68211411f admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:13.811804 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc1f4a-e775-46e4-8531-a7b68211411f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:53:13.811804 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc1f4a-e775-46e4-8531-a7b68211411f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:13.812583 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc1f4a-e775-46e4-8531-a7b68211411f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:13.817432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cff484-22c1-4190-9652-4277caecb54b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:13.824349 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7a2f3-52c1-408b-8150-db23e7ddf652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:13.826673 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7a2f3-52c1-408b-8150-db23e7ddf652 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:13.826673 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7a2f3-52c1-408b-8150-db23e7ddf652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:13.826673 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7a2f3-52c1-408b-8150-db23e7ddf652 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:13.827077 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7a2f3-52c1-408b-8150-db23e7ddf652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:13.830380 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7a2f3-52c1-408b-8150-db23e7ddf652 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:13.831187 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1072/2106] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:53:13.831895 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc1f4a-e775-46e4-8531-a7b68211411f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:13.842801 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc1f4a-e775-46e4-8531-a7b68211411f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:13.847757 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a895f0b-af44-4597-b793-f5320617c85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:13.848409 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a895f0b-af44-4597-b793-f5320617c85a admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:13.848688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a895f0b-af44-4597-b793-f5320617c85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:13.848960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a895f0b-af44-4597-b793-f5320617c85a admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:13.849655 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a895f0b-af44-4597-b793-f5320617c85a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:13.852412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a895f0b-af44-4597-b793-f5320617c85a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:13.922533 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1035/2107] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:53:13 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:53:13.922533 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7a2f3-52c1-408b-8150-db23e7ddf652 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:13.933659 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7a2f3-52c1-408b-8150-db23e7ddf652 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:13.937294 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73023c2a-3715-48e7-ad29-80d99d788fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:13.937943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73023c2a-3715-48e7-ad29-80d99d788fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:13.938220 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73023c2a-3715-48e7-ad29-80d99d788fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:13.938890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73023c2a-3715-48e7-ad29-80d99d788fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:13.939579 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73023c2a-3715-48e7-ad29-80d99d788fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:13.941540 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73023c2a-3715-48e7-ad29-80d99d788fc6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:13.967910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1073/2108] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:53:13 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:53:13.967910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a895f0b-af44-4597-b793-f5320617c85a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:14.033004 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a895f0b-af44-4597-b793-f5320617c85a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:14.037978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200db63-d899-4356-a6a2-5a40cc03a117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:14.043093 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200db63-d899-4356-a6a2-5a40cc03a117 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:14.043093 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200db63-d899-4356-a6a2-5a40cc03a117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:14.043093 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200db63-d899-4356-a6a2-5a40cc03a117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:14.043093 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200db63-d899-4356-a6a2-5a40cc03a117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:14.043093 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200db63-d899-4356-a6a2-5a40cc03a117 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:14.047035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1036/2109] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:53:13 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:53:14.051050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73023c2a-3715-48e7-ad29-80d99d788fc6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:14.053295 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1074/2110] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:53:14.054318 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200db63-d899-4356-a6a2-5a40cc03a117 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:14.067825 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200db63-d899-4356-a6a2-5a40cc03a117 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:14.124522 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73023c2a-3715-48e7-ad29-80d99d788fc6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:14.128300 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2e0f5-9008-4769-9e69-2eb743c00439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:14.128982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2e0f5-9008-4769-9e69-2eb743c00439 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:14.129267 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2e0f5-9008-4769-9e69-2eb743c00439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:14.129554 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2e0f5-9008-4769-9e69-2eb743c00439 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:14.130113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7ff64-7052-4ba2-b0aa-4be66c1cc958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:14.130231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2e0f5-9008-4769-9e69-2eb743c00439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:14.130853 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7ff64-7052-4ba2-b0aa-4be66c1cc958 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:14.131213 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7ff64-7052-4ba2-b0aa-4be66c1cc958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:14.131552 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7ff64-7052-4ba2-b0aa-4be66c1cc958 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:14.132179 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2e0f5-9008-4769-9e69-2eb743c00439 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:14.132495 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7ff64-7052-4ba2-b0aa-4be66c1cc958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:14.134460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7ff64-7052-4ba2-b0aa-4be66c1cc958 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:14.307777 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1075/2111] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:53:14 2022] POST /identity/v3/users => generated 286 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:53:14.308737 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2e0f5-9008-4769-9e69-2eb743c00439 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:14.318410 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1037/2112] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:53:14 2022] POST /identity/v3/users => generated 286 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:53:14.318594 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2e0f5-9008-4769-9e69-2eb743c00439 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:14.319608 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7ff64-7052-4ba2-b0aa-4be66c1cc958 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:14.323932 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd5b04-79cf-441c-a23b-d200a08977e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:14.324811 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd5b04-79cf-441c-a23b-d200a08977e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:14.325103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd5b04-79cf-441c-a23b-d200a08977e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:14.325382 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd5b04-79cf-441c-a23b-d200a08977e2 admin admin] PATH_INFO: `/v3/projects/d18fa6dfa5bf48a5a8ed44fadb5afef0/users/c75206c0fc034d5ab104d6d9eda0fdb5/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:14.330091 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7ff64-7052-4ba2-b0aa-4be66c1cc958 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:14.334728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abf0f6-58a0-4b25-87e4-11cb2566d274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:14.335975 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abf0f6-58a0-4b25-87e4-11cb2566d274 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:14.336274 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abf0f6-58a0-4b25-87e4-11cb2566d274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:14.336545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abf0f6-58a0-4b25-87e4-11cb2566d274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:14.337265 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abf0f6-58a0-4b25-87e4-11cb2566d274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:14.338835 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abf0f6-58a0-4b25-87e4-11cb2566d274 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:14.341479 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd5b04-79cf-441c-a23b-d200a08977e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18fa6dfa5bf48a5a8ed44fadb5afef0, user_id=c75206c0fc034d5ab104d6d9eda0fdb5, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:14.345400 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd5b04-79cf-441c-a23b-d200a08977e2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:14.348852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1038/2113] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:53:14.349661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abf0f6-58a0-4b25-87e4-11cb2566d274 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:14.359084 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abf0f6-58a0-4b25-87e4-11cb2566d274 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:14.363729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb52af1-e8c3-4ac9-abaf-09372291ca94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:14.364370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb52af1-e8c3-4ac9-abaf-09372291ca94 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:14.364649 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb52af1-e8c3-4ac9-abaf-09372291ca94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:14.364922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb52af1-e8c3-4ac9-abaf-09372291ca94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:14.365635 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb52af1-e8c3-4ac9-abaf-09372291ca94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:14.367230 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb52af1-e8c3-4ac9-abaf-09372291ca94 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:14.377648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1039/2114] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:53:14.378435 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb52af1-e8c3-4ac9-abaf-09372291ca94 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:14.388464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb52af1-e8c3-4ac9-abaf-09372291ca94 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:14.393574 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c6865-7445-4f0d-b395-eb1b4e0ee014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:14.394235 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c6865-7445-4f0d-b395-eb1b4e0ee014 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:14.394515 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c6865-7445-4f0d-b395-eb1b4e0ee014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:14.394787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c6865-7445-4f0d-b395-eb1b4e0ee014 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:14.395661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c6865-7445-4f0d-b395-eb1b4e0ee014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:14.397728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c6865-7445-4f0d-b395-eb1b4e0ee014 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:14.408955 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1040/2115] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:53:14.409967 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c6865-7445-4f0d-b395-eb1b4e0ee014 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:14.421856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c6865-7445-4f0d-b395-eb1b4e0ee014 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:14.427519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15748e68-4261-41c6-8856-24d624ddb101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:14.428248 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15748e68-4261-41c6-8856-24d624ddb101 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:14.428523 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15748e68-4261-41c6-8856-24d624ddb101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:14.428877 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15748e68-4261-41c6-8856-24d624ddb101 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:14.430171 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15748e68-4261-41c6-8856-24d624ddb101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:14.432101 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15748e68-4261-41c6-8856-24d624ddb101 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:14.445550 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1041/2116] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:53:14.445550 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15748e68-4261-41c6-8856-24d624ddb101 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:14.452695 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15748e68-4261-41c6-8856-24d624ddb101 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:14.457208 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947df476-4aad-4a7c-a0e8-23b08f4c5946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:14.458043 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947df476-4aad-4a7c-a0e8-23b08f4c5946 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:14.458381 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947df476-4aad-4a7c-a0e8-23b08f4c5946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:14.458659 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947df476-4aad-4a7c-a0e8-23b08f4c5946 admin admin] PATH_INFO: `/v3/projects/e59759391f6e4650b3bbd3059dd3f9f7/users/d16de05b788c42b5979a20ff3b26340c/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:14.473096 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947df476-4aad-4a7c-a0e8-23b08f4c5946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59759391f6e4650b3bbd3059dd3f9f7, user_id=d16de05b788c42b5979a20ff3b26340c, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:14.475823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947df476-4aad-4a7c-a0e8-23b08f4c5946 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:14.494822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1076/2117] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:53:14 2022] PUT /identity/v3/projects/d18fa6dfa5bf48a5a8ed44fadb5afef0/users/c75206c0fc034d5ab104d6d9eda0fdb5/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:14.500032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd5b04-79cf-441c-a23b-d200a08977e2 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:14.553877 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd5b04-79cf-441c-a23b-d200a08977e2 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:14.558552 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580825dd-d764-4589-9a62-277154f52a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:14.559433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580825dd-d764-4589-9a62-277154f52a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:14.559742 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580825dd-d764-4589-9a62-277154f52a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:14.560047 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580825dd-d764-4589-9a62-277154f52a1b admin admin] PATH_INFO: `/v3/projects/9623ac5b3c664e44bf4e0bacb398a8a3/users/4edf41df1d4940028966ad901d3f5847/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:14.573716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580825dd-d764-4589-9a62-277154f52a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9623ac5b3c664e44bf4e0bacb398a8a3, user_id=4edf41df1d4940028966ad901d3f5847, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:14.576400 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580825dd-d764-4589-9a62-277154f52a1b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:14.592874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1042/2118] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:53:14 2022] PUT /identity/v3/projects/e59759391f6e4650b3bbd3059dd3f9f7/users/d16de05b788c42b5979a20ff3b26340c/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:14.597443 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947df476-4aad-4a7c-a0e8-23b08f4c5946 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:14.658909 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947df476-4aad-4a7c-a0e8-23b08f4c5946 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:14.664551 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d05db9-ed3b-4a1e-9d2f-728f07909e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:14.665494 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d05db9-ed3b-4a1e-9d2f-728f07909e26 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:14.665910 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d05db9-ed3b-4a1e-9d2f-728f07909e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:14.666208 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d05db9-ed3b-4a1e-9d2f-728f07909e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:14.666945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d05db9-ed3b-4a1e-9d2f-728f07909e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:14.668556 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d05db9-ed3b-4a1e-9d2f-728f07909e26 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:14.678856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1043/2119] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:53:14.680558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbec017-1069-4d84-a49a-7c5b3a1111f8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:14.680849 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbec017-1069-4d84-a49a-7c5b3a1111f8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:14.681127 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbec017-1069-4d84-a49a-7c5b3a1111f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:14.689871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1077/2120] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:53:14 2022] PUT /identity/v3/projects/9623ac5b3c664e44bf4e0bacb398a8a3/users/4edf41df1d4940028966ad901d3f5847/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:14.696055 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580825dd-d764-4589-9a62-277154f52a1b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:14.700545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4bbec017-1069-4d84-a49a-7c5b3a1111f8 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:14.701818 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4bbec017-1069-4d84-a49a-7c5b3a1111f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:14.774748 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1044/2121] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:14.775605 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df2ff5-be51-40b4-b580-ba1c168a6996 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:14.776069 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df2ff5-be51-40b4-b580-ba1c168a6996 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:14.778604 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580825dd-d764-4589-9a62-277154f52a1b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:14.782111 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df2ff5-be51-40b4-b580-ba1c168a6996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:14.784299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8433be-1da9-4b9d-83e4-d6b93c0e0108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:14.785201 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8433be-1da9-4b9d-83e4-d6b93c0e0108 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:14.785489 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8433be-1da9-4b9d-83e4-d6b93c0e0108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:14.785764 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8433be-1da9-4b9d-83e4-d6b93c0e0108 admin admin] PATH_INFO: `/v3/projects/d18fa6dfa5bf48a5a8ed44fadb5afef0/users/c75206c0fc034d5ab104d6d9eda0fdb5/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:14.787873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8433be-1da9-4b9d-83e4-d6b93c0e0108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18fa6dfa5bf48a5a8ed44fadb5afef0, user_id=c75206c0fc034d5ab104d6d9eda0fdb5, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:14.790927 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8433be-1da9-4b9d-83e4-d6b93c0e0108 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:14.802201 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-89df2ff5-be51-40b4-b580-ba1c168a6996 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:14.803974 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-89df2ff5-be51-40b4-b580-ba1c168a6996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:14.808538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1078/2122] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:53:14 2022] PUT /identity/v3/projects/d18fa6dfa5bf48a5a8ed44fadb5afef0/users/c75206c0fc034d5ab104d6d9eda0fdb5/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:14.811327 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8433be-1da9-4b9d-83e4-d6b93c0e0108 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:14.820517 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9c8433be-1da9-4b9d-83e4-d6b93c0e0108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:14.886890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1045/2123] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:14.888835 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312cb92-993f-46e1-86f7-07ae3facaea8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:14.889767 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312cb92-993f-46e1-86f7-07ae3facaea8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:14.890460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312cb92-993f-46e1-86f7-07ae3facaea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:14.897671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8433be-1da9-4b9d-83e4-d6b93c0e0108 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:14.902942 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900148b-a376-49cd-a2b6-9989deaecab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:14.903595 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900148b-a376-49cd-a2b6-9989deaecab4 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:14.903911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900148b-a376-49cd-a2b6-9989deaecab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:14.904189 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900148b-a376-49cd-a2b6-9989deaecab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:14.915030 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900148b-a376-49cd-a2b6-9989deaecab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:14.916564 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900148b-a376-49cd-a2b6-9989deaecab4 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:14.926395 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4312cb92-993f-46e1-86f7-07ae3facaea8 None None] MFA Rules not processed for user `c75206c0fc034d5ab104d6d9eda0fdb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:14.927747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4312cb92-993f-46e1-86f7-07ae3facaea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:14.929689 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1079/2124] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:53:14.941138 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900148b-a376-49cd-a2b6-9989deaecab4 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:14.951987 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900148b-a376-49cd-a2b6-9989deaecab4 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:14.955967 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f8a87-f98b-42aa-9cfa-d23bded233cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:14.956591 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f8a87-f98b-42aa-9cfa-d23bded233cf service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:14.956875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f8a87-f98b-42aa-9cfa-d23bded233cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:14.957152 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f8a87-f98b-42aa-9cfa-d23bded233cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:14.971456 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f8a87-f98b-42aa-9cfa-d23bded233cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:14.973067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f8a87-f98b-42aa-9cfa-d23bded233cf service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:14.983415 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1080/2125] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:53:15.015056 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1046/2126] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:14 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:15.026871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f8a87-f98b-42aa-9cfa-d23bded233cf service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:15.032547 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9f5f8a87-f98b-42aa-9cfa-d23bded233cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:15.086755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f8a87-f98b-42aa-9cfa-d23bded233cf service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:15.097952 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7501eb-1cc1-482a-9135-50807dbaf79d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:15.098650 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7501eb-1cc1-482a-9135-50807dbaf79d service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:15.098959 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7501eb-1cc1-482a-9135-50807dbaf79d service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:15.099243 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7501eb-1cc1-482a-9135-50807dbaf79d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:15.115484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7501eb-1cc1-482a-9135-50807dbaf79d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:15.118779 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7501eb-1cc1-482a-9135-50807dbaf79d service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:15.127858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1081/2127] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:53:15 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:53:15.379954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312cb92-993f-46e1-86f7-07ae3facaea8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:15.390066 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312cb92-993f-46e1-86f7-07ae3facaea8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:15.393929 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c313b9-4adf-4013-aaea-bbf155bce875 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:15.394556 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c313b9-4adf-4013-aaea-bbf155bce875 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:15.394865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c313b9-4adf-4013-aaea-bbf155bce875 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:15.395142 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c313b9-4adf-4013-aaea-bbf155bce875 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:15.396992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-58c313b9-4adf-4013-aaea-bbf155bce875 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:15.455820 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c313b9-4adf-4013-aaea-bbf155bce875 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:15.457259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c313b9-4adf-4013-aaea-bbf155bce875 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:15.466961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1047/2128] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:53:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:53:17.117595 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474d151-3687-476c-a98d-0280ac4b9597 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:17.118138 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474d151-3687-476c-a98d-0280ac4b9597 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:17.118138 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474d151-3687-476c-a98d-0280ac4b9597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:17.144304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e474d151-3687-476c-a98d-0280ac4b9597 None None] MFA Rules not processed for user `d16de05b788c42b5979a20ff3b26340c`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:17.145791 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e474d151-3687-476c-a98d-0280ac4b9597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:17.213782 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1082/2129] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:17.224696 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c313b9-4adf-4013-aaea-bbf155bce875 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:17.227337 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-58c313b9-4adf-4013-aaea-bbf155bce875 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:17.238304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c313b9-4adf-4013-aaea-bbf155bce875 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:17.242509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069907b-efad-4b49-b3c9-2dc062f1a08e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:17.243214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069907b-efad-4b49-b3c9-2dc062f1a08e service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:17.243443 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069907b-efad-4b49-b3c9-2dc062f1a08e service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:17.243936 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069907b-efad-4b49-b3c9-2dc062f1a08e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:17.260691 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069907b-efad-4b49-b3c9-2dc062f1a08e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:17.262540 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069907b-efad-4b49-b3c9-2dc062f1a08e service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:17.273969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1048/2130] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:53:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:53:19.139054 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2f467-d6bc-4ad1-9adf-6d6b052b41d6 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:19.139587 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2f467-d6bc-4ad1-9adf-6d6b052b41d6 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:19.140139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2f467-d6bc-4ad1-9adf-6d6b052b41d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:19.160264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-dbf2f467-d6bc-4ad1-9adf-6d6b052b41d6 None None] MFA Rules not processed for user `d16de05b788c42b5979a20ff3b26340c`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:19.161482 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-dbf2f467-d6bc-4ad1-9adf-6d6b052b41d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:19.169511 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1083/2131] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:22.970974 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069907b-efad-4b49-b3c9-2dc062f1a08e service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:22.995709 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069907b-efad-4b49-b3c9-2dc062f1a08e service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:23.019302 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69384a83-5ac0-428a-90b4-d24956a821ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:23.020623 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69384a83-5ac0-428a-90b4-d24956a821ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:23.021040 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69384a83-5ac0-428a-90b4-d24956a821ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:23.021469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69384a83-5ac0-428a-90b4-d24956a821ff admin admin] PATH_INFO: `/v3/users/74853f347d744b9b924b03b7530e4dfd` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:23.023322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69384a83-5ac0-428a-90b4-d24956a821ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=74853f347d744b9b924b03b7530e4dfd)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:23.026438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69384a83-5ac0-428a-90b4-d24956a821ff admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:23.264922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-69384a83-5ac0-428a-90b4-d24956a821ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74853f347d744b9b924b03b7530e4dfd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:23.266182 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-69384a83-5ac0-428a-90b4-d24956a821ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74853f347d744b9b924b03b7530e4dfd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:23.284860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-69384a83-5ac0-428a-90b4-d24956a821ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74853f347d744b9b924b03b7530e4dfd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:23.287959 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-69384a83-5ac0-428a-90b4-d24956a821ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74853f347d744b9b924b03b7530e4dfd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:23.298937 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-69384a83-5ac0-428a-90b4-d24956a821ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74853f347d744b9b924b03b7530e4dfd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:23.363506 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ba503-27ec-44d0-9af1-61f265431fae None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:23.364630 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ba503-27ec-44d0-9af1-61f265431fae None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:23.365061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ba503-27ec-44d0-9af1-61f265431fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:23.435056 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-549ba503-27ec-44d0-9af1-61f265431fae None None] MFA Rules not processed for user `4edf41df1d4940028966ad901d3f5847`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:23.436356 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-549ba503-27ec-44d0-9af1-61f265431fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:23.445912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1049/2132] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:53:22 2022] DELETE /identity/v3/users/74853f347d744b9b924b03b7530e4dfd => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:23.450313 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983369a1-0ee0-4f95-80f1-96dfabad8727 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:23.450979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983369a1-0ee0-4f95-80f1-96dfabad8727 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:23.451306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983369a1-0ee0-4f95-80f1-96dfabad8727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:23.502035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-983369a1-0ee0-4f95-80f1-96dfabad8727 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:23.502035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-983369a1-0ee0-4f95-80f1-96dfabad8727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:23.543488 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1084/2133] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:23.565396 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ba503-27ec-44d0-9af1-61f265431fae None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:23.567619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-549ba503-27ec-44d0-9af1-61f265431fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:23.605407 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1050/2134] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:23.606861 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ba503-27ec-44d0-9af1-61f265431fae None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:23.607916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983369a1-0ee0-4f95-80f1-96dfabad8727 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:23.610878 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-983369a1-0ee0-4f95-80f1-96dfabad8727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:23.623594 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ed629-90db-46ed-8aad-98c328e4bfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:23.624609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ed629-90db-46ed-8aad-98c328e4bfd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:23.627415 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ed629-90db-46ed-8aad-98c328e4bfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:23.627919 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ed629-90db-46ed-8aad-98c328e4bfd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:23.628825 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ed629-90db-46ed-8aad-98c328e4bfd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:23.641564 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ed629-90db-46ed-8aad-98c328e4bfd3 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:23.708673 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983369a1-0ee0-4f95-80f1-96dfabad8727 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:23.719188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e8936-2df1-45d5-b5d9-d71d9f3250bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:23.719914 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e8936-2df1-45d5-b5d9-d71d9f3250bf service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:23.720203 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e8936-2df1-45d5-b5d9-d71d9f3250bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:23.720481 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e8936-2df1-45d5-b5d9-d71d9f3250bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:23.736865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e8936-2df1-45d5-b5d9-d71d9f3250bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:23.738862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e8936-2df1-45d5-b5d9-d71d9f3250bf service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:23.751523 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1051/2135] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:53:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:53:23.850147 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1085/2136] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:53:23 2022] POST /identity/v3/projects => generated 373 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:53:23.855604 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e8936-2df1-45d5-b5d9-d71d9f3250bf service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:23.866869 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e8936-2df1-45d5-b5d9-d71d9f3250bf service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:24.011193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b263a7-51bf-41dc-97a6-281a00595f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:24.011193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b263a7-51bf-41dc-97a6-281a00595f03 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:24.011193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b263a7-51bf-41dc-97a6-281a00595f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:24.011193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b263a7-51bf-41dc-97a6-281a00595f03 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:24.012081 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b263a7-51bf-41dc-97a6-281a00595f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:24.013226 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b263a7-51bf-41dc-97a6-281a00595f03 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:24.142694 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1052/2137] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:53:23 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:53:24.146305 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ed629-90db-46ed-8aad-98c328e4bfd3 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:24.162154 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ed629-90db-46ed-8aad-98c328e4bfd3 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:24.175672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e78d21-032c-4810-af26-be75c1ffd994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:24.176735 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e78d21-032c-4810-af26-be75c1ffd994 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:24.177199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e78d21-032c-4810-af26-be75c1ffd994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:24.177867 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e78d21-032c-4810-af26-be75c1ffd994 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:24.180174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e78d21-032c-4810-af26-be75c1ffd994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:24.185003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e78d21-032c-4810-af26-be75c1ffd994 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:24.203961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1086/2138] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:53:24.206980 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b263a7-51bf-41dc-97a6-281a00595f03 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:24.221685 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b263a7-51bf-41dc-97a6-281a00595f03 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:24.239048 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d281d8-8734-4a2d-bd46-a02a14cbacb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:24.240195 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d281d8-8734-4a2d-bd46-a02a14cbacb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:24.241621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d281d8-8734-4a2d-bd46-a02a14cbacb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:24.241922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d281d8-8734-4a2d-bd46-a02a14cbacb2 admin admin] PATH_INFO: `/v3/projects/2384ab7018db4ce7bb45e1a778874d06/users/ede00a65c4ed46249ece7de1a67af841/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:24.270248 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d281d8-8734-4a2d-bd46-a02a14cbacb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2384ab7018db4ce7bb45e1a778874d06, user_id=ede00a65c4ed46249ece7de1a67af841, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:24.274407 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d281d8-8734-4a2d-bd46-a02a14cbacb2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:24.432518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1053/2139] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:53:24 2022] PUT /identity/v3/projects/2384ab7018db4ce7bb45e1a778874d06/users/ede00a65c4ed46249ece7de1a67af841/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:24.436780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e78d21-032c-4810-af26-be75c1ffd994 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:24.448657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e78d21-032c-4810-af26-be75c1ffd994 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:24.595040 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258ea23-234b-4c33-9a25-3ffeb8f0b977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:24.596194 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258ea23-234b-4c33-9a25-3ffeb8f0b977 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:24.596724 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258ea23-234b-4c33-9a25-3ffeb8f0b977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:24.610301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258ea23-234b-4c33-9a25-3ffeb8f0b977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:24.610301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258ea23-234b-4c33-9a25-3ffeb8f0b977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:24.610301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258ea23-234b-4c33-9a25-3ffeb8f0b977 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:24.620788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d281d8-8734-4a2d-bd46-a02a14cbacb2 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:24.621357 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1087/2140] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 06:53:24.651613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d281d8-8734-4a2d-bd46-a02a14cbacb2 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:24.651613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed22ee-7cd0-42b6-973c-e51e55d7a266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:24.651613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed22ee-7cd0-42b6-973c-e51e55d7a266 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:24.651613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed22ee-7cd0-42b6-973c-e51e55d7a266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:24.651979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed22ee-7cd0-42b6-973c-e51e55d7a266 admin admin] PATH_INFO: `/v3/projects/2384ab7018db4ce7bb45e1a778874d06/users/ede00a65c4ed46249ece7de1a67af841/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:24.651979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed22ee-7cd0-42b6-973c-e51e55d7a266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2384ab7018db4ce7bb45e1a778874d06, user_id=ede00a65c4ed46249ece7de1a67af841, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:24.651979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed22ee-7cd0-42b6-973c-e51e55d7a266 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:24.661787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1054/2141] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:53:24 2022] PUT /identity/v3/projects/2384ab7018db4ce7bb45e1a778874d06/users/ede00a65c4ed46249ece7de1a67af841/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:24.711082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258ea23-234b-4c33-9a25-3ffeb8f0b977 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:24.713239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d258ea23-234b-4c33-9a25-3ffeb8f0b977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:24.727906 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258ea23-234b-4c33-9a25-3ffeb8f0b977 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:24.787158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0fd54-c34c-46be-abec-cc4ca4b0d440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:24.788085 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0fd54-c34c-46be-abec-cc4ca4b0d440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:24.788973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0fd54-c34c-46be-abec-cc4ca4b0d440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:24.789328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0fd54-c34c-46be-abec-cc4ca4b0d440 admin admin] PATH_INFO: `/v3/projects/0db26094a3764d7fa60ed773f96f3344` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:24.790841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0fd54-c34c-46be-abec-cc4ca4b0d440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0db26094a3764d7fa60ed773f96f3344)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:24.792852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0fd54-c34c-46be-abec-cc4ca4b0d440 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:25.092957 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-02c0fd54-c34c-46be-abec-cc4ca4b0d440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0db26094a3764d7fa60ed773f96f3344', 'request_id': 'req-02c0fd54-c34c-46be-abec-cc4ca4b0d440'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:25.203645 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-02c0fd54-c34c-46be-abec-cc4ca4b0d440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0db26094a3764d7fa60ed773f96f3344', 'request_id': 'req-02c0fd54-c34c-46be-abec-cc4ca4b0d440'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:25.214814 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-02c0fd54-c34c-46be-abec-cc4ca4b0d440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0db26094a3764d7fa60ed773f96f3344', 'request_id': 'req-02c0fd54-c34c-46be-abec-cc4ca4b0d440'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:25.232501 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-02c0fd54-c34c-46be-abec-cc4ca4b0d440 admin admin] The token cache is being invalidate because project 0db26094a3764d7fa60ed773f96f3344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:53:25.232886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-02c0fd54-c34c-46be-abec-cc4ca4b0d440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:25.233856 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-02c0fd54-c34c-46be-abec-cc4ca4b0d440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:25.239644 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1088/2142] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:53:24 2022] DELETE /identity/v3/projects/0db26094a3764d7fa60ed773f96f3344 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:25.243725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed22ee-7cd0-42b6-973c-e51e55d7a266 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:25.245593 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-91ed22ee-7cd0-42b6-973c-e51e55d7a266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:25.262631 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed22ee-7cd0-42b6-973c-e51e55d7a266 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:25.340730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd4577-3e34-42d5-b62b-ccd804f9603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:25.341687 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd4577-3e34-42d5-b62b-ccd804f9603c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:25.341975 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd4577-3e34-42d5-b62b-ccd804f9603c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:25.342252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd4577-3e34-42d5-b62b-ccd804f9603c admin admin] PATH_INFO: `/v3/users/c75206c0fc034d5ab104d6d9eda0fdb5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:25.343481 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd4577-3e34-42d5-b62b-ccd804f9603c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c75206c0fc034d5ab104d6d9eda0fdb5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:25.345589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd4577-3e34-42d5-b62b-ccd804f9603c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:25.724121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d2dd4577-3e34-42d5-b62b-ccd804f9603c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c75206c0fc034d5ab104d6d9eda0fdb5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:25.725140 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d2dd4577-3e34-42d5-b62b-ccd804f9603c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c75206c0fc034d5ab104d6d9eda0fdb5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:25.737000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d2dd4577-3e34-42d5-b62b-ccd804f9603c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c75206c0fc034d5ab104d6d9eda0fdb5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:25.737668 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d2dd4577-3e34-42d5-b62b-ccd804f9603c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c75206c0fc034d5ab104d6d9eda0fdb5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:25.772005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d2dd4577-3e34-42d5-b62b-ccd804f9603c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c75206c0fc034d5ab104d6d9eda0fdb5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:25.864805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1055/2143] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:53:25 2022] DELETE /identity/v3/users/c75206c0fc034d5ab104d6d9eda0fdb5 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:26.562943 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0fd54-c34c-46be-abec-cc4ca4b0d440 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:26.577970 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0fd54-c34c-46be-abec-cc4ca4b0d440 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:26.706609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672baa8a-4f56-48e8-83e8-a80a1b4fb4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:26.707914 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672baa8a-4f56-48e8-83e8-a80a1b4fb4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:26.708600 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672baa8a-4f56-48e8-83e8-a80a1b4fb4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:26.709045 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672baa8a-4f56-48e8-83e8-a80a1b4fb4a3 admin admin] PATH_INFO: `/v3/projects/d18fa6dfa5bf48a5a8ed44fadb5afef0` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:26.710571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672baa8a-4f56-48e8-83e8-a80a1b4fb4a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d18fa6dfa5bf48a5a8ed44fadb5afef0)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:26.713565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672baa8a-4f56-48e8-83e8-a80a1b4fb4a3 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:26.993521 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-672baa8a-4f56-48e8-83e8-a80a1b4fb4a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd18fa6dfa5bf48a5a8ed44fadb5afef0', 'request_id': 'req-672baa8a-4f56-48e8-83e8-a80a1b4fb4a3'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:27.096986 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-672baa8a-4f56-48e8-83e8-a80a1b4fb4a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd18fa6dfa5bf48a5a8ed44fadb5afef0', 'request_id': 'req-672baa8a-4f56-48e8-83e8-a80a1b4fb4a3'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:27.105337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-672baa8a-4f56-48e8-83e8-a80a1b4fb4a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd18fa6dfa5bf48a5a8ed44fadb5afef0', 'request_id': 'req-672baa8a-4f56-48e8-83e8-a80a1b4fb4a3'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:27.125373 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-672baa8a-4f56-48e8-83e8-a80a1b4fb4a3 admin admin] The token cache is being invalidate because project d18fa6dfa5bf48a5a8ed44fadb5afef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:53:27.125853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-672baa8a-4f56-48e8-83e8-a80a1b4fb4a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:27.126661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-672baa8a-4f56-48e8-83e8-a80a1b4fb4a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:27.134900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1089/2144] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:53:26 2022] DELETE /identity/v3/projects/d18fa6dfa5bf48a5a8ed44fadb5afef0 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:27.141339 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcdb19-a425-4835-9c77-14cf9dc16140 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:27.141339 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcdb19-a425-4835-9c77-14cf9dc16140 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:27.141339 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcdb19-a425-4835-9c77-14cf9dc16140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:27.164672 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1ddcdb19-a425-4835-9c77-14cf9dc16140 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:27.166509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1ddcdb19-a425-4835-9c77-14cf9dc16140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:27.276026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1056/2145] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:27.277670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170394f-ced7-4825-8c55-5e0cfd62b831 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:27.277963 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170394f-ced7-4825-8c55-5e0cfd62b831 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:27.278242 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170394f-ced7-4825-8c55-5e0cfd62b831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:27.300261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6170394f-ced7-4825-8c55-5e0cfd62b831 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:27.301857 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6170394f-ced7-4825-8c55-5e0cfd62b831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:27.312349 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1090/2146] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:53:27.316808 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcdb19-a425-4835-9c77-14cf9dc16140 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:27.326925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcdb19-a425-4835-9c77-14cf9dc16140 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:27.331818 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802548b4-292a-4524-95e6-222a1ca1fd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:27.332550 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802548b4-292a-4524-95e6-222a1ca1fd54 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:27.332898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802548b4-292a-4524-95e6-222a1ca1fd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:27.333235 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802548b4-292a-4524-95e6-222a1ca1fd54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:27.334156 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802548b4-292a-4524-95e6-222a1ca1fd54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:53:27.334519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802548b4-292a-4524-95e6-222a1ca1fd54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:27.336734 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802548b4-292a-4524-95e6-222a1ca1fd54 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:27.348884 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1057/2147] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:53:27.358077 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170394f-ced7-4825-8c55-5e0cfd62b831 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:27.368339 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170394f-ced7-4825-8c55-5e0cfd62b831 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:27.374413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f59d29-5385-42e1-a4bf-443cf53b7949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:27.375075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f59d29-5385-42e1-a4bf-443cf53b7949 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:27.375358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f59d29-5385-42e1-a4bf-443cf53b7949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:27.375720 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f59d29-5385-42e1-a4bf-443cf53b7949 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:27.376698 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f59d29-5385-42e1-a4bf-443cf53b7949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:27.378784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f59d29-5385-42e1-a4bf-443cf53b7949 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:27.558771 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1091/2148] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:53:27 2022] POST /identity/v3/projects => generated 375 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:53:27.563140 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802548b4-292a-4524-95e6-222a1ca1fd54 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:27.579052 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802548b4-292a-4524-95e6-222a1ca1fd54 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:27.645757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429748f-28b6-4ad3-a007-1be8b7844dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:27.646527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429748f-28b6-4ad3-a007-1be8b7844dfd admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:27.646812 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429748f-28b6-4ad3-a007-1be8b7844dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:27.647087 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429748f-28b6-4ad3-a007-1be8b7844dfd admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:27.648054 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429748f-28b6-4ad3-a007-1be8b7844dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:27.650064 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429748f-28b6-4ad3-a007-1be8b7844dfd admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:27.750473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1058/2149] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:53:27 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:53:27.754586 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f59d29-5385-42e1-a4bf-443cf53b7949 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:27.778442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f59d29-5385-42e1-a4bf-443cf53b7949 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:27.785459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a097c3-5fac-47e6-b4bf-266d02311b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:27.785935 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a097c3-5fac-47e6-b4bf-266d02311b11 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:27.786222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a097c3-5fac-47e6-b4bf-266d02311b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:27.786500 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a097c3-5fac-47e6-b4bf-266d02311b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:27.787324 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a097c3-5fac-47e6-b4bf-266d02311b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:27.801019 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a097c3-5fac-47e6-b4bf-266d02311b11 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:27.838080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1092/2150] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 06:53:27.839763 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429748f-28b6-4ad3-a007-1be8b7844dfd admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:27.854039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429748f-28b6-4ad3-a007-1be8b7844dfd admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:27.859303 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65407d15-9858-40b8-8a22-3696e12374dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:27.860002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65407d15-9858-40b8-8a22-3696e12374dc admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:27.860208 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65407d15-9858-40b8-8a22-3696e12374dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:27.860489 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65407d15-9858-40b8-8a22-3696e12374dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:27.861295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65407d15-9858-40b8-8a22-3696e12374dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:27.862907 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65407d15-9858-40b8-8a22-3696e12374dc admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:27.885200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1059/2151] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:53:27.889022 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a097c3-5fac-47e6-b4bf-266d02311b11 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:27.908109 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a097c3-5fac-47e6-b4bf-266d02311b11 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:27.925096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d7860-20fc-48d6-a8a4-63ad9c595f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:27.926290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d7860-20fc-48d6-a8a4-63ad9c595f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:27.926644 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d7860-20fc-48d6-a8a4-63ad9c595f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:27.926988 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d7860-20fc-48d6-a8a4-63ad9c595f33 admin admin] PATH_INFO: `/v3/projects/cc5be471e4544b51abc540026f2bb96f/users/0a29488498284620995810fd613f8fdd/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:27.954177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d7860-20fc-48d6-a8a4-63ad9c595f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5be471e4544b51abc540026f2bb96f, user_id=0a29488498284620995810fd613f8fdd, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:27.957056 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d7860-20fc-48d6-a8a4-63ad9c595f33 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:28.074453 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1093/2152] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:53:27 2022] PUT /identity/v3/projects/cc5be471e4544b51abc540026f2bb96f/users/0a29488498284620995810fd613f8fdd/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:28.084138 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a3e0e-cf26-4251-877b-cfe24c783a92 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:28.084427 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a3e0e-cf26-4251-877b-cfe24c783a92 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:28.084708 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a3e0e-cf26-4251-877b-cfe24c783a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:28.140199 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-035a3e0e-cf26-4251-877b-cfe24c783a92 None None] MFA Rules not processed for user `0a29488498284620995810fd613f8fdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:28.141528 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-035a3e0e-cf26-4251-877b-cfe24c783a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:28.218156 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1060/2153] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:28.229963 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d7860-20fc-48d6-a8a4-63ad9c595f33 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:28.232397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-400d7860-20fc-48d6-a8a4-63ad9c595f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:28.297776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d7860-20fc-48d6-a8a4-63ad9c595f33 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:28.301951 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb59f2-acea-4161-a2c3-d357ec2c299f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a08d8e39f6f42bc9b93dd6d2311bcbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:28.302659 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb59f2-acea-4161-a2c3-d357ec2c299f service glance] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:28.302950 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb59f2-acea-4161-a2c3-d357ec2c299f service glance] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:28.303226 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb59f2-acea-4161-a2c3-d357ec2c299f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:28.313080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb59f2-acea-4161-a2c3-d357ec2c299f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:28.314508 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb59f2-acea-4161-a2c3-d357ec2c299f service glance] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:28.324635 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1094/2154] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:53:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 06:53:32.756617 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152a1ae-2638-4367-8e85-d92d17500023 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:32.757739 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152a1ae-2638-4367-8e85-d92d17500023 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:32.757961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152a1ae-2638-4367-8e85-d92d17500023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:32.784475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a152a1ae-2638-4367-8e85-d92d17500023 None None] MFA Rules not processed for user `ede00a65c4ed46249ece7de1a67af841`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:32.785825 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a152a1ae-2638-4367-8e85-d92d17500023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:32.856984 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1061/2155] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:32.872411 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb59f2-acea-4161-a2c3-d357ec2c299f service glance] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:32.877188 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1ebb59f2-acea-4161-a2c3-d357ec2c299f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:32.967955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb59f2-acea-4161-a2c3-d357ec2c299f service glance] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:32.974864 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c424056-3af7-42b9-9ce8-8edef80c0ba0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:32.975713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c424056-3af7-42b9-9ce8-8edef80c0ba0 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:32.977163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c424056-3af7-42b9-9ce8-8edef80c0ba0 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:32.977163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c424056-3af7-42b9-9ce8-8edef80c0ba0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:32.978523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7c424056-3af7-42b9-9ce8-8edef80c0ba0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:33.048365 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c424056-3af7-42b9-9ce8-8edef80c0ba0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:33.050279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c424056-3af7-42b9-9ce8-8edef80c0ba0 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:33.077562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1095/2156] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:53:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:53:36.461526 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152a1ae-2638-4367-8e85-d92d17500023 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:36.463162 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a152a1ae-2638-4367-8e85-d92d17500023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:36.586470 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152a1ae-2638-4367-8e85-d92d17500023 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:36.593848 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac6419-fce2-4835-8faa-ac2ed2f90dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:36.594798 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac6419-fce2-4835-8faa-ac2ed2f90dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:36.599384 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac6419-fce2-4835-8faa-ac2ed2f90dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:36.599384 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac6419-fce2-4835-8faa-ac2ed2f90dde admin admin] PATH_INFO: `/v3/users/514e0c0399e64952b2a63cd0e81678d3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:36.599384 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac6419-fce2-4835-8faa-ac2ed2f90dde admin admin] RBAC: Authorizing `identity:delete_user(user_id=514e0c0399e64952b2a63cd0e81678d3)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:36.601212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac6419-fce2-4835-8faa-ac2ed2f90dde admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:36.808807 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e9ac6419-fce2-4835-8faa-ac2ed2f90dde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '514e0c0399e64952b2a63cd0e81678d3'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:36.818608 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e9ac6419-fce2-4835-8faa-ac2ed2f90dde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '514e0c0399e64952b2a63cd0e81678d3'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:36.848879 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e9ac6419-fce2-4835-8faa-ac2ed2f90dde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '514e0c0399e64952b2a63cd0e81678d3'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:36.851248 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e9ac6419-fce2-4835-8faa-ac2ed2f90dde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '514e0c0399e64952b2a63cd0e81678d3'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:36.860485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e9ac6419-fce2-4835-8faa-ac2ed2f90dde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '514e0c0399e64952b2a63cd0e81678d3'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:36.920151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c15a6-b7a6-4673-b096-3f2602d29bda None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:36.920738 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c15a6-b7a6-4673-b096-3f2602d29bda None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:36.920738 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c15a6-b7a6-4673-b096-3f2602d29bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:36.943087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-a30c15a6-b7a6-4673-b096-3f2602d29bda None None] MFA Rules not processed for user `4edf41df1d4940028966ad901d3f5847`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:36.945060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a30c15a6-b7a6-4673-b096-3f2602d29bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:36.955446 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1096/2157] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:53:37.046511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1062/2158] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:53:36 2022] DELETE /identity/v3/users/514e0c0399e64952b2a63cd0e81678d3 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:37.060121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b868a32-d8d6-4587-8a83-298b58965858 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:37.060121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b868a32-d8d6-4587-8a83-298b58965858 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:37.060121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b868a32-d8d6-4587-8a83-298b58965858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:37.094340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-1b868a32-d8d6-4587-8a83-298b58965858 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:37.095572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1b868a32-d8d6-4587-8a83-298b58965858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:37.220124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1097/2159] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:37.229496 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac6419-fce2-4835-8faa-ac2ed2f90dde admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:37.231255 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e9ac6419-fce2-4835-8faa-ac2ed2f90dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:37.367367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac6419-fce2-4835-8faa-ac2ed2f90dde admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:37.371638 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c56fbb-49c6-44c9-a5c2-eec30946671e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:37.372363 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c56fbb-49c6-44c9-a5c2-eec30946671e service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:37.372676 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c56fbb-49c6-44c9-a5c2-eec30946671e service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:37.372954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c56fbb-49c6-44c9-a5c2-eec30946671e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:37.385443 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c56fbb-49c6-44c9-a5c2-eec30946671e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:37.386940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c56fbb-49c6-44c9-a5c2-eec30946671e service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:37.403783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1063/2160] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:53:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:53:38.083661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de2ecb-53ce-4101-b6e3-74270129eea6 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:38.084262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de2ecb-53ce-4101-b6e3-74270129eea6 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:38.084497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de2ecb-53ce-4101-b6e3-74270129eea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:38.107249 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-49de2ecb-53ce-4101-b6e3-74270129eea6 None None] MFA Rules not processed for user `d77bf80654c24c8c8336ce395f789ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:38.112050 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-49de2ecb-53ce-4101-b6e3-74270129eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:38.161924 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c56fbb-49c6-44c9-a5c2-eec30946671e service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:38.166707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a5c56fbb-49c6-44c9-a5c2-eec30946671e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:38.215000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c56fbb-49c6-44c9-a5c2-eec30946671e service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:38.230172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b7c40-617e-4b11-a231-94a9034954cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:38.233460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b7c40-617e-4b11-a231-94a9034954cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:38.233748 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b7c40-617e-4b11-a231-94a9034954cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:38.234027 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b7c40-617e-4b11-a231-94a9034954cd admin admin] PATH_INFO: `/v3/projects/b0c408cf5ab3437692373b44053f9659` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:38.237913 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b7c40-617e-4b11-a231-94a9034954cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c408cf5ab3437692373b44053f9659)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:38.244058 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b7c40-617e-4b11-a231-94a9034954cd admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:38.248596 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1098/2161] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:38.424778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d03b7c40-617e-4b11-a231-94a9034954cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c408cf5ab3437692373b44053f9659', 'request_id': 'req-d03b7c40-617e-4b11-a231-94a9034954cd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:38.485132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d03b7c40-617e-4b11-a231-94a9034954cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c408cf5ab3437692373b44053f9659', 'request_id': 'req-d03b7c40-617e-4b11-a231-94a9034954cd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:38.500447 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d03b7c40-617e-4b11-a231-94a9034954cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c408cf5ab3437692373b44053f9659', 'request_id': 'req-d03b7c40-617e-4b11-a231-94a9034954cd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:38.528793 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d03b7c40-617e-4b11-a231-94a9034954cd admin admin] The token cache is being invalidate because project b0c408cf5ab3437692373b44053f9659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:53:38.529413 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d03b7c40-617e-4b11-a231-94a9034954cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:38.530385 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d03b7c40-617e-4b11-a231-94a9034954cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:38.532489 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1064/2162] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:53:38 2022] DELETE /identity/v3/projects/b0c408cf5ab3437692373b44053f9659 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:38.540005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda39e8-0468-4e35-afe7-b3f16900c809 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:38.541168 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda39e8-0468-4e35-afe7-b3f16900c809 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:38.542311 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda39e8-0468-4e35-afe7-b3f16900c809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:38.574353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-abda39e8-0468-4e35-afe7-b3f16900c809 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:38.575679 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-abda39e8-0468-4e35-afe7-b3f16900c809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:38.661838 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1099/2163] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:38.670815 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d2770-11a2-4d39-8d60-058bb81cfd1e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:38.671113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d2770-11a2-4d39-8d60-058bb81cfd1e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:38.671393 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d2770-11a2-4d39-8d60-058bb81cfd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:38.699524 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-804d2770-11a2-4d39-8d60-058bb81cfd1e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:38.702877 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-804d2770-11a2-4d39-8d60-058bb81cfd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:38.712258 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1065/2164] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:38.716447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda39e8-0468-4e35-afe7-b3f16900c809 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:38.728768 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda39e8-0468-4e35-afe7-b3f16900c809 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:38.737059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef5db8-e5b0-40cc-be76-2123980f9dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:38.744225 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef5db8-e5b0-40cc-be76-2123980f9dce admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:38.744225 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef5db8-e5b0-40cc-be76-2123980f9dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:38.744225 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef5db8-e5b0-40cc-be76-2123980f9dce admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:38.744225 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef5db8-e5b0-40cc-be76-2123980f9dce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:53:38.744225 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef5db8-e5b0-40cc-be76-2123980f9dce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:38.744225 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef5db8-e5b0-40cc-be76-2123980f9dce admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:38.777997 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1100/2165] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:53:38.778701 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d2770-11a2-4d39-8d60-058bb81cfd1e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:38.796442 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d2770-11a2-4d39-8d60-058bb81cfd1e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:38.807635 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58227972-4268-421e-8f19-06d0739446be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:38.809652 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58227972-4268-421e-8f19-06d0739446be admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:38.810103 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58227972-4268-421e-8f19-06d0739446be admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:38.810541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58227972-4268-421e-8f19-06d0739446be admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:38.812956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58227972-4268-421e-8f19-06d0739446be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:38.813946 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58227972-4268-421e-8f19-06d0739446be admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:38.983558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1066/2166] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:53:38 2022] POST /identity/v3/projects => generated 365 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:53:38.992300 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef5db8-e5b0-40cc-be76-2123980f9dce admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:39.002234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef5db8-e5b0-40cc-be76-2123980f9dce admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:39.059096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a46d8-0012-494c-b422-51e559e91477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:39.059805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a46d8-0012-494c-b422-51e559e91477 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:39.060131 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a46d8-0012-494c-b422-51e559e91477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:39.060409 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a46d8-0012-494c-b422-51e559e91477 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:39.061121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a46d8-0012-494c-b422-51e559e91477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:39.063015 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a46d8-0012-494c-b422-51e559e91477 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:39.200007 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1101/2167] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:53:38 2022] POST /identity/v3/users => generated 283 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:53:39.208601 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58227972-4268-421e-8f19-06d0739446be admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:39.219488 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58227972-4268-421e-8f19-06d0739446be admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:39.224705 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e5b19-8e24-4b48-a277-2223feefce6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:39.225527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e5b19-8e24-4b48-a277-2223feefce6e admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:39.225716 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e5b19-8e24-4b48-a277-2223feefce6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:39.225996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e5b19-8e24-4b48-a277-2223feefce6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:39.226843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e5b19-8e24-4b48-a277-2223feefce6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:39.228518 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e5b19-8e24-4b48-a277-2223feefce6e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:39.239770 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1067/2168] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:53:39.243775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a46d8-0012-494c-b422-51e559e91477 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:39.254075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a46d8-0012-494c-b422-51e559e91477 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:39.259828 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e076d6a-d9b0-4511-9f93-81295081a124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:39.259991 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e076d6a-d9b0-4511-9f93-81295081a124 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:39.260263 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e076d6a-d9b0-4511-9f93-81295081a124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:39.260553 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e076d6a-d9b0-4511-9f93-81295081a124 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:39.261288 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e076d6a-d9b0-4511-9f93-81295081a124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:39.262897 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e076d6a-d9b0-4511-9f93-81295081a124 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:39.275450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1102/2169] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:53:39.283290 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e5b19-8e24-4b48-a277-2223feefce6e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:39.298238 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e5b19-8e24-4b48-a277-2223feefce6e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:39.306984 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8198d-830c-4a63-9c75-deeccbee6ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:39.308147 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8198d-830c-4a63-9c75-deeccbee6ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:39.314554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8198d-830c-4a63-9c75-deeccbee6ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:39.315033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8198d-830c-4a63-9c75-deeccbee6ad6 admin admin] PATH_INFO: `/v3/projects/992913e9698345b29cb39154f0ec14ae/users/f66af96caf344b7c85ec51c50b9c2489/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:39.333185 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8198d-830c-4a63-9c75-deeccbee6ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=992913e9698345b29cb39154f0ec14ae, user_id=f66af96caf344b7c85ec51c50b9c2489, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:39.336167 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8198d-830c-4a63-9c75-deeccbee6ad6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:39.468453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1068/2170] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:53:39 2022] PUT /identity/v3/projects/992913e9698345b29cb39154f0ec14ae/users/f66af96caf344b7c85ec51c50b9c2489/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:39.480326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369e9c1-ce0c-4839-a3ee-9fa52d31aeac None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:39.480632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369e9c1-ce0c-4839-a3ee-9fa52d31aeac None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:39.480906 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369e9c1-ce0c-4839-a3ee-9fa52d31aeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:39.512185 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-7369e9c1-ce0c-4839-a3ee-9fa52d31aeac None None] MFA Rules not processed for user `f66af96caf344b7c85ec51c50b9c2489`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:39.513689 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7369e9c1-ce0c-4839-a3ee-9fa52d31aeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:39.586903 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1103/2171] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:39.597927 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8198d-830c-4a63-9c75-deeccbee6ad6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:39.599619 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fcb8198d-830c-4a63-9c75-deeccbee6ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:39.666929 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8198d-830c-4a63-9c75-deeccbee6ad6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:39.671211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d790b-33e8-4dbb-8fd2-c2e160cea154 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:39.672583 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d790b-33e8-4dbb-8fd2-c2e160cea154 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:39.673019 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d790b-33e8-4dbb-8fd2-c2e160cea154 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:39.673295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d790b-33e8-4dbb-8fd2-c2e160cea154 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:39.684850 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d790b-33e8-4dbb-8fd2-c2e160cea154 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:39.686441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d790b-33e8-4dbb-8fd2-c2e160cea154 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:39.697592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1069/2172] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:53:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:53:51.330843 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c04fa-f5c1-4ca1-a8f4-da725d390270 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:51.331377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c04fa-f5c1-4ca1-a8f4-da725d390270 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:51.331473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c04fa-f5c1-4ca1-a8f4-da725d390270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:51.358821 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4a7c04fa-f5c1-4ca1-a8f4-da725d390270 None None] MFA Rules not processed for user `13ef78da38e941b3a09f1de838581d54`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:51.360034 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4a7c04fa-f5c1-4ca1-a8f4-da725d390270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:51.432908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1104/2173] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:53.531422 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d790b-33e8-4dbb-8fd2-c2e160cea154 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:53.532840 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-366d790b-33e8-4dbb-8fd2-c2e160cea154 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:53.758327 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d790b-33e8-4dbb-8fd2-c2e160cea154 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:53.763634 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d2336-d9e0-4bb1-b427-507a34919cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:53.764572 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d2336-d9e0-4bb1-b427-507a34919cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:53.764847 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d2336-d9e0-4bb1-b427-507a34919cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:53.765117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d2336-d9e0-4bb1-b427-507a34919cd0 admin admin] PATH_INFO: `/v3/users/0a29488498284620995810fd613f8fdd` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:53.766364 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d2336-d9e0-4bb1-b427-507a34919cd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a29488498284620995810fd613f8fdd)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:53.769988 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d2336-d9e0-4bb1-b427-507a34919cd0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:54.008841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-da8d2336-d9e0-4bb1-b427-507a34919cd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a29488498284620995810fd613f8fdd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:54.009764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-da8d2336-d9e0-4bb1-b427-507a34919cd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a29488498284620995810fd613f8fdd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:54.034459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80799140-b07d-40e7-8720-2d9b79e22817 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:54.034459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80799140-b07d-40e7-8720-2d9b79e22817 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:54.034459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80799140-b07d-40e7-8720-2d9b79e22817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:54.039607 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-da8d2336-d9e0-4bb1-b427-507a34919cd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a29488498284620995810fd613f8fdd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:54.040455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-da8d2336-d9e0-4bb1-b427-507a34919cd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a29488498284620995810fd613f8fdd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:54.054763 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-80799140-b07d-40e7-8720-2d9b79e22817 None None] MFA Rules not processed for user `d16de05b788c42b5979a20ff3b26340c`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:54.056941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-80799140-b07d-40e7-8720-2d9b79e22817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:54.062970 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-da8d2336-d9e0-4bb1-b427-507a34919cd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a29488498284620995810fd613f8fdd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:54.134086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1105/2174] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:53:54.328337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b95ec-1cc9-4bca-bdc3-90ed8f5ca232 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:54.328699 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b95ec-1cc9-4bca-bdc3-90ed8f5ca232 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:54.328949 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b95ec-1cc9-4bca-bdc3-90ed8f5ca232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:54.330476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1070/2175] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:53:53 2022] DELETE /identity/v3/users/0a29488498284620995810fd613f8fdd => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:54.377463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d25b95ec-1cc9-4bca-bdc3-90ed8f5ca232 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:54.379261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d25b95ec-1cc9-4bca-bdc3-90ed8f5ca232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:54.498212 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1106/2176] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:54.520959 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d2336-d9e0-4bb1-b427-507a34919cd0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:54.523031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-da8d2336-d9e0-4bb1-b427-507a34919cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:54.641150 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d2336-d9e0-4bb1-b427-507a34919cd0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:54.648174 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20beaa-6ec8-497a-96bd-ffe9cac4cffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:54.649024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20beaa-6ec8-497a-96bd-ffe9cac4cffd service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:54.649384 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20beaa-6ec8-497a-96bd-ffe9cac4cffd service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:54.649754 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20beaa-6ec8-497a-96bd-ffe9cac4cffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:54.661984 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20beaa-6ec8-497a-96bd-ffe9cac4cffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:54.664937 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20beaa-6ec8-497a-96bd-ffe9cac4cffd service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:54.678389 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1071/2177] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:53:55.629415 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b95ec-1cc9-4bca-bdc3-90ed8f5ca232 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:55.632232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d25b95ec-1cc9-4bca-bdc3-90ed8f5ca232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:55.648825 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b95ec-1cc9-4bca-bdc3-90ed8f5ca232 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:55.654547 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f01ee8-80e6-4b28-9866-2919657a288d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:55.666322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f01ee8-80e6-4b28-9866-2919657a288d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:55.666322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f01ee8-80e6-4b28-9866-2919657a288d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:55.666322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f01ee8-80e6-4b28-9866-2919657a288d admin admin] PATH_INFO: `/v3/projects/cc5be471e4544b51abc540026f2bb96f` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:55.666322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f01ee8-80e6-4b28-9866-2919657a288d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc5be471e4544b51abc540026f2bb96f)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:55.666322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f01ee8-80e6-4b28-9866-2919657a288d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:55.818344 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-77f01ee8-80e6-4b28-9866-2919657a288d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc5be471e4544b51abc540026f2bb96f', 'request_id': 'req-77f01ee8-80e6-4b28-9866-2919657a288d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:55.913502 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-77f01ee8-80e6-4b28-9866-2919657a288d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc5be471e4544b51abc540026f2bb96f', 'request_id': 'req-77f01ee8-80e6-4b28-9866-2919657a288d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:55.919902 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-77f01ee8-80e6-4b28-9866-2919657a288d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc5be471e4544b51abc540026f2bb96f', 'request_id': 'req-77f01ee8-80e6-4b28-9866-2919657a288d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:55.933135 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-77f01ee8-80e6-4b28-9866-2919657a288d admin admin] The token cache is being invalidate because project cc5be471e4544b51abc540026f2bb96f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:53:55.933634 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-77f01ee8-80e6-4b28-9866-2919657a288d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:55.934791 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-77f01ee8-80e6-4b28-9866-2919657a288d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:53:55.936793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1107/2178] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:53:55 2022] DELETE /identity/v3/projects/cc5be471e4544b51abc540026f2bb96f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:55.942173 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd59a4f-0219-4a9f-a780-e00020b6e6ff None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:55.942612 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd59a4f-0219-4a9f-a780-e00020b6e6ff None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:55.942707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd59a4f-0219-4a9f-a780-e00020b6e6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:56.024203 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8bd59a4f-0219-4a9f-a780-e00020b6e6ff None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:56.026350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8bd59a4f-0219-4a9f-a780-e00020b6e6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:56.112945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1072/2179] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:56.122016 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe214ce6-8901-4183-bf9d-c2b87d96e83f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:56.122514 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe214ce6-8901-4183-bf9d-c2b87d96e83f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:56.123223 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe214ce6-8901-4183-bf9d-c2b87d96e83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:56.148738 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-fe214ce6-8901-4183-bf9d-c2b87d96e83f None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:56.150018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fe214ce6-8901-4183-bf9d-c2b87d96e83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:56.160072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1108/2180] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:53:56.164116 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd59a4f-0219-4a9f-a780-e00020b6e6ff None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:56.176121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd59a4f-0219-4a9f-a780-e00020b6e6ff None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:56.183560 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927bc04-abbc-4316-9c54-1815b92d53e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:56.184548 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927bc04-abbc-4316-9c54-1815b92d53e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:56.185393 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927bc04-abbc-4316-9c54-1815b92d53e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:56.185889 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927bc04-abbc-4316-9c54-1815b92d53e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:56.186923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927bc04-abbc-4316-9c54-1815b92d53e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:53:56.187433 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927bc04-abbc-4316-9c54-1815b92d53e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:56.189332 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927bc04-abbc-4316-9c54-1815b92d53e3 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:56.203486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1073/2181] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:53:56.207864 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe214ce6-8901-4183-bf9d-c2b87d96e83f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:56.219433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe214ce6-8901-4183-bf9d-c2b87d96e83f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:56.227357 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1698b-25e6-4bc8-aab2-10412a934e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:56.228507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1698b-25e6-4bc8-aab2-10412a934e9d admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:56.229110 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1698b-25e6-4bc8-aab2-10412a934e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:56.229647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1698b-25e6-4bc8-aab2-10412a934e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:56.230976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1698b-25e6-4bc8-aab2-10412a934e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:56.233280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1698b-25e6-4bc8-aab2-10412a934e9d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:56.449035 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1109/2182] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:53:56 2022] POST /identity/v3/projects => generated 371 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:53:56.450860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927bc04-abbc-4316-9c54-1815b92d53e3 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:56.462986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927bc04-abbc-4316-9c54-1815b92d53e3 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:56.524366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf27553-9fac-4876-b1aa-87fe0858c24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:56.525296 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf27553-9fac-4876-b1aa-87fe0858c24f admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:56.525580 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf27553-9fac-4876-b1aa-87fe0858c24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:56.526066 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf27553-9fac-4876-b1aa-87fe0858c24f admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:56.526902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf27553-9fac-4876-b1aa-87fe0858c24f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:56.529576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf27553-9fac-4876-b1aa-87fe0858c24f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:56.689962 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1074/2183] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:53:56 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:53:56.691557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1698b-25e6-4bc8-aab2-10412a934e9d admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:56.702835 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1698b-25e6-4bc8-aab2-10412a934e9d admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:56.708651 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69bbba-86ac-4e29-9978-1af7562d72ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:56.709325 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69bbba-86ac-4e29-9978-1af7562d72ab admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:56.710143 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69bbba-86ac-4e29-9978-1af7562d72ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:56.710415 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69bbba-86ac-4e29-9978-1af7562d72ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:56.711795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69bbba-86ac-4e29-9978-1af7562d72ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:56.713878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69bbba-86ac-4e29-9978-1af7562d72ab admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:56.734661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1110/2184] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:53:56.735571 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf27553-9fac-4876-b1aa-87fe0858c24f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:56.746423 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf27553-9fac-4876-b1aa-87fe0858c24f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:56.752286 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207803a-47d6-4fc4-ac1d-7f5a52dca9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:56.753016 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207803a-47d6-4fc4-ac1d-7f5a52dca9dc admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:56.753449 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207803a-47d6-4fc4-ac1d-7f5a52dca9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:56.753734 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207803a-47d6-4fc4-ac1d-7f5a52dca9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:56.754476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207803a-47d6-4fc4-ac1d-7f5a52dca9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:56.756126 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207803a-47d6-4fc4-ac1d-7f5a52dca9dc admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:56.767830 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1075/2185] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 06:53:56.770977 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69bbba-86ac-4e29-9978-1af7562d72ab admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:56.783133 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69bbba-86ac-4e29-9978-1af7562d72ab admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:56.789404 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bf170-09a9-4180-8eb5-3a82db797f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:56.790406 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bf170-09a9-4180-8eb5-3a82db797f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:56.790761 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bf170-09a9-4180-8eb5-3a82db797f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:56.791398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bf170-09a9-4180-8eb5-3a82db797f11 admin admin] PATH_INFO: `/v3/projects/1573ad8a49304b6c956cc3f80eaad35d/users/e7c3574374e543158f3116222126dd14/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:56.813089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bf170-09a9-4180-8eb5-3a82db797f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1573ad8a49304b6c956cc3f80eaad35d, user_id=e7c3574374e543158f3116222126dd14, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:56.815986 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bf170-09a9-4180-8eb5-3a82db797f11 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:56.988518 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1111/2186] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:53:56 2022] PUT /identity/v3/projects/1573ad8a49304b6c956cc3f80eaad35d/users/e7c3574374e543158f3116222126dd14/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:53:57.000843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab8355-2788-4575-ab23-6ca1364da213 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:57.000843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab8355-2788-4575-ab23-6ca1364da213 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:57.000843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab8355-2788-4575-ab23-6ca1364da213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:57.030231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-64ab8355-2788-4575-ab23-6ca1364da213 None None] MFA Rules not processed for user `e7c3574374e543158f3116222126dd14`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:57.031458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-64ab8355-2788-4575-ab23-6ca1364da213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:57.097717 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1076/2187] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:53:57.098809 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bf170-09a9-4180-8eb5-3a82db797f11 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:57.171016 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bf170-09a9-4180-8eb5-3a82db797f11 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:57.176233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154e45a-5f32-435a-aaca-86598203d5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:57.176903 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154e45a-5f32-435a-aaca-86598203d5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:57.177208 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154e45a-5f32-435a-aaca-86598203d5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:57.177482 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154e45a-5f32-435a-aaca-86598203d5b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:57.178222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154e45a-5f32-435a-aaca-86598203d5b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:57.180254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154e45a-5f32-435a-aaca-86598203d5b9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:57.320537 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1112/2188] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:53:57 2022] POST /identity/v3/projects => generated 375 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:53:57.324454 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab8355-2788-4575-ab23-6ca1364da213 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:57.334818 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab8355-2788-4575-ab23-6ca1364da213 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:57.392987 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2729ab-2bcd-4ebf-93a1-ef6f1c2e0b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:57.393692 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2729ab-2bcd-4ebf-93a1-ef6f1c2e0b66 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:57.393974 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2729ab-2bcd-4ebf-93a1-ef6f1c2e0b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:57.394245 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2729ab-2bcd-4ebf-93a1-ef6f1c2e0b66 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:57.394943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2729ab-2bcd-4ebf-93a1-ef6f1c2e0b66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:57.396891 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2729ab-2bcd-4ebf-93a1-ef6f1c2e0b66 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:57.533373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1077/2189] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:53:57 2022] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:53:57.534638 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154e45a-5f32-435a-aaca-86598203d5b9 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:57.546081 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154e45a-5f32-435a-aaca-86598203d5b9 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:57.551266 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b972407-06ba-45f1-86aa-e358cc416678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:57.552072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b972407-06ba-45f1-86aa-e358cc416678 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:57.552424 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b972407-06ba-45f1-86aa-e358cc416678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:57.552821 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b972407-06ba-45f1-86aa-e358cc416678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:57.554207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b972407-06ba-45f1-86aa-e358cc416678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:57.555991 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b972407-06ba-45f1-86aa-e358cc416678 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:57.566875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1113/2190] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:53:57.571754 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2729ab-2bcd-4ebf-93a1-ef6f1c2e0b66 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:57.582405 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2729ab-2bcd-4ebf-93a1-ef6f1c2e0b66 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:57.587172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970bbd9-1a97-4743-b1fd-16e8e4e9ae2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:57.588081 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970bbd9-1a97-4743-b1fd-16e8e4e9ae2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:57.588376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970bbd9-1a97-4743-b1fd-16e8e4e9ae2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:57.588667 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970bbd9-1a97-4743-b1fd-16e8e4e9ae2a admin admin] PATH_INFO: `/v3/projects/0c22d958d2a54c76ad637a00132d63eb/users/51326c60966c4cf488b431fea1add89c/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:57.603061 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970bbd9-1a97-4743-b1fd-16e8e4e9ae2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c22d958d2a54c76ad637a00132d63eb, user_id=51326c60966c4cf488b431fea1add89c, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:57.605812 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970bbd9-1a97-4743-b1fd-16e8e4e9ae2a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:57.761801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1078/2191] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:53:57 2022] PUT /identity/v3/projects/0c22d958d2a54c76ad637a00132d63eb/users/51326c60966c4cf488b431fea1add89c/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:53:57.765466 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b972407-06ba-45f1-86aa-e358cc416678 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:57.776261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b972407-06ba-45f1-86aa-e358cc416678 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:57.845444 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f8016-6dea-4d80-b361-f752611d27db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:57.846093 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f8016-6dea-4d80-b361-f752611d27db admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:57.846368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f8016-6dea-4d80-b361-f752611d27db admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:57.846647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f8016-6dea-4d80-b361-f752611d27db admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:57.847387 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f8016-6dea-4d80-b361-f752611d27db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:57.849034 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f8016-6dea-4d80-b361-f752611d27db admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:57.863718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1114/2192] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:53:57.864667 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970bbd9-1a97-4743-b1fd-16e8e4e9ae2a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:57.876642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970bbd9-1a97-4743-b1fd-16e8e4e9ae2a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:57.882066 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abc8cb-a17d-41c3-b7d5-790eddd287df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:57.882883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abc8cb-a17d-41c3-b7d5-790eddd287df admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:57.883331 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abc8cb-a17d-41c3-b7d5-790eddd287df admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:57.883645 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abc8cb-a17d-41c3-b7d5-790eddd287df admin admin] PATH_INFO: `/v3/projects/0c22d958d2a54c76ad637a00132d63eb/users/51326c60966c4cf488b431fea1add89c/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:57.886141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abc8cb-a17d-41c3-b7d5-790eddd287df admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c22d958d2a54c76ad637a00132d63eb, user_id=51326c60966c4cf488b431fea1add89c, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:57.888984 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abc8cb-a17d-41c3-b7d5-790eddd287df admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:57.900869 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1079/2193] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:53:57 2022] PUT /identity/v3/projects/0c22d958d2a54c76ad637a00132d63eb/users/51326c60966c4cf488b431fea1add89c/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:53:57.914472 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6c3ad-7032-4b48-807e-b677f49fc613 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:57.914771 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6c3ad-7032-4b48-807e-b677f49fc613 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:57.915056 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6c3ad-7032-4b48-807e-b677f49fc613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:57.945368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-1ba6c3ad-7032-4b48-807e-b677f49fc613 None None] MFA Rules not processed for user `51326c60966c4cf488b431fea1add89c`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:53:57.946532 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1ba6c3ad-7032-4b48-807e-b677f49fc613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:58.032037 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1115/2194] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:53:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:53:58.044409 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abc8cb-a17d-41c3-b7d5-790eddd287df admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:53:58.047607 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e6abc8cb-a17d-41c3-b7d5-790eddd287df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:53:58.108192 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abc8cb-a17d-41c3-b7d5-790eddd287df admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:53:58.111920 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f9c03-4b3b-4aa9-9e61-362211be87c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:53:58.114945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f9c03-4b3b-4aa9-9e61-362211be87c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:53:58.114945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f9c03-4b3b-4aa9-9e61-362211be87c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:53:58.114945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f9c03-4b3b-4aa9-9e61-362211be87c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:53:58.186147 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f9c03-4b3b-4aa9-9e61-362211be87c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:53:58.188697 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f9c03-4b3b-4aa9-9e61-362211be87c7 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:53:58.199251 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1080/2195] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:53:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:54:01.642894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6c3ad-7032-4b48-807e-b677f49fc613 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:01.714624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6c3ad-7032-4b48-807e-b677f49fc613 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:01.719319 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e0079-9bb3-4595-a08b-92c5ead02d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:01.720233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e0079-9bb3-4595-a08b-92c5ead02d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:01.720521 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e0079-9bb3-4595-a08b-92c5ead02d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:01.720799 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e0079-9bb3-4595-a08b-92c5ead02d38 admin admin] PATH_INFO: `/v3/users/e7c3574374e543158f3116222126dd14` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:01.722011 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e0079-9bb3-4595-a08b-92c5ead02d38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c3574374e543158f3116222126dd14)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:01.723980 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e0079-9bb3-4595-a08b-92c5ead02d38 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:01.945509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9f6e0079-9bb3-4595-a08b-92c5ead02d38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c3574374e543158f3116222126dd14'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:01.946309 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9f6e0079-9bb3-4595-a08b-92c5ead02d38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c3574374e543158f3116222126dd14'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:01.948740 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9f6e0079-9bb3-4595-a08b-92c5ead02d38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c3574374e543158f3116222126dd14'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:01.964919 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9f6e0079-9bb3-4595-a08b-92c5ead02d38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c3574374e543158f3116222126dd14'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:01.972144 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9f6e0079-9bb3-4595-a08b-92c5ead02d38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c3574374e543158f3116222126dd14'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:02.056413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1116/2196] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:54:01 2022] DELETE /identity/v3/users/e7c3574374e543158f3116222126dd14 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:54:02.061097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54068f1e-3801-4d14-a8b4-57b30065cdea None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:02.061587 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54068f1e-3801-4d14-a8b4-57b30065cdea None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:02.061671 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54068f1e-3801-4d14-a8b4-57b30065cdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:02.082013 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-54068f1e-3801-4d14-a8b4-57b30065cdea None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:54:02.083218 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-54068f1e-3801-4d14-a8b4-57b30065cdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:02.150098 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1081/2197] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:54:02.160422 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e0079-9bb3-4595-a08b-92c5ead02d38 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:02.161821 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9f6e0079-9bb3-4595-a08b-92c5ead02d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:02.224195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e0079-9bb3-4595-a08b-92c5ead02d38 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:02.228999 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6828c2-99c5-48b3-aa1e-ce83702313cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:02.229544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6828c2-99c5-48b3-aa1e-ce83702313cc service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:02.229830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6828c2-99c5-48b3-aa1e-ce83702313cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:02.230260 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6828c2-99c5-48b3-aa1e-ce83702313cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:02.240058 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6828c2-99c5-48b3-aa1e-ce83702313cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:02.242150 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6828c2-99c5-48b3-aa1e-ce83702313cc service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:02.255556 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1117/2198] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:54:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:54:02.879593 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54068f1e-3801-4d14-a8b4-57b30065cdea None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:02.881090 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-54068f1e-3801-4d14-a8b4-57b30065cdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:02.893523 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54068f1e-3801-4d14-a8b4-57b30065cdea None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:02.898731 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d7ccb-0805-40a8-87ff-8ac01959aa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:02.899589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d7ccb-0805-40a8-87ff-8ac01959aa41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:02.899919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d7ccb-0805-40a8-87ff-8ac01959aa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:02.900204 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d7ccb-0805-40a8-87ff-8ac01959aa41 admin admin] PATH_INFO: `/v3/projects/1573ad8a49304b6c956cc3f80eaad35d` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:02.901398 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d7ccb-0805-40a8-87ff-8ac01959aa41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1573ad8a49304b6c956cc3f80eaad35d)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:02.903361 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d7ccb-0805-40a8-87ff-8ac01959aa41 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:03.032850 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e18d7ccb-0805-40a8-87ff-8ac01959aa41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1573ad8a49304b6c956cc3f80eaad35d', 'request_id': 'req-e18d7ccb-0805-40a8-87ff-8ac01959aa41'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:03.112696 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e18d7ccb-0805-40a8-87ff-8ac01959aa41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1573ad8a49304b6c956cc3f80eaad35d', 'request_id': 'req-e18d7ccb-0805-40a8-87ff-8ac01959aa41'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:03.118727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e18d7ccb-0805-40a8-87ff-8ac01959aa41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1573ad8a49304b6c956cc3f80eaad35d', 'request_id': 'req-e18d7ccb-0805-40a8-87ff-8ac01959aa41'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:03.130535 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e18d7ccb-0805-40a8-87ff-8ac01959aa41 admin admin] The token cache is being invalidate because project 1573ad8a49304b6c956cc3f80eaad35d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:54:03.130802 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e18d7ccb-0805-40a8-87ff-8ac01959aa41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:03.131955 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e18d7ccb-0805-40a8-87ff-8ac01959aa41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:03.133554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1082/2199] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:54:02 2022] DELETE /identity/v3/projects/1573ad8a49304b6c956cc3f80eaad35d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:54:03.137510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6828c2-99c5-48b3-aa1e-ce83702313cc service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:03.150221 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6828c2-99c5-48b3-aa1e-ce83702313cc service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:03.206839 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fe2b0-af67-4f73-85b3-7fdd98f731ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:03.207782 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fe2b0-af67-4f73-85b3-7fdd98f731ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:03.208231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fe2b0-af67-4f73-85b3-7fdd98f731ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:03.208562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fe2b0-af67-4f73-85b3-7fdd98f731ef admin admin] PATH_INFO: `/v3/users/51326c60966c4cf488b431fea1add89c` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:03.210599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fe2b0-af67-4f73-85b3-7fdd98f731ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=51326c60966c4cf488b431fea1add89c)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:03.213160 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fe2b0-af67-4f73-85b3-7fdd98f731ef admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:03.423452 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a68fe2b0-af67-4f73-85b3-7fdd98f731ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51326c60966c4cf488b431fea1add89c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:03.424363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a68fe2b0-af67-4f73-85b3-7fdd98f731ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51326c60966c4cf488b431fea1add89c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:03.425056 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a68fe2b0-af67-4f73-85b3-7fdd98f731ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51326c60966c4cf488b431fea1add89c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:03.439572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a68fe2b0-af67-4f73-85b3-7fdd98f731ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51326c60966c4cf488b431fea1add89c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:03.447159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a68fe2b0-af67-4f73-85b3-7fdd98f731ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51326c60966c4cf488b431fea1add89c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:03.535468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1118/2200] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:54:03 2022] DELETE /identity/v3/users/51326c60966c4cf488b431fea1add89c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:54:04.259930 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d7ccb-0805-40a8-87ff-8ac01959aa41 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:04.261380 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e18d7ccb-0805-40a8-87ff-8ac01959aa41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:04.275588 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d7ccb-0805-40a8-87ff-8ac01959aa41 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:04.332169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afe22a-6ac8-4463-8d50-cbc7e3ee2751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:04.333016 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afe22a-6ac8-4463-8d50-cbc7e3ee2751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:04.333297 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afe22a-6ac8-4463-8d50-cbc7e3ee2751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:04.333627 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afe22a-6ac8-4463-8d50-cbc7e3ee2751 admin admin] PATH_INFO: `/v3/projects/0c22d958d2a54c76ad637a00132d63eb` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:04.335375 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afe22a-6ac8-4463-8d50-cbc7e3ee2751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c22d958d2a54c76ad637a00132d63eb)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:04.337306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afe22a-6ac8-4463-8d50-cbc7e3ee2751 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:04.484670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e7afe22a-6ac8-4463-8d50-cbc7e3ee2751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c22d958d2a54c76ad637a00132d63eb', 'request_id': 'req-e7afe22a-6ac8-4463-8d50-cbc7e3ee2751'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:04.570469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e7afe22a-6ac8-4463-8d50-cbc7e3ee2751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c22d958d2a54c76ad637a00132d63eb', 'request_id': 'req-e7afe22a-6ac8-4463-8d50-cbc7e3ee2751'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:04.576966 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e7afe22a-6ac8-4463-8d50-cbc7e3ee2751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c22d958d2a54c76ad637a00132d63eb', 'request_id': 'req-e7afe22a-6ac8-4463-8d50-cbc7e3ee2751'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:04.588858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e7afe22a-6ac8-4463-8d50-cbc7e3ee2751 admin admin] The token cache is being invalidate because project 0c22d958d2a54c76ad637a00132d63eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:54:04.589144 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e7afe22a-6ac8-4463-8d50-cbc7e3ee2751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:04.589800 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e7afe22a-6ac8-4463-8d50-cbc7e3ee2751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:04.591641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1083/2201] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:54:04 2022] DELETE /identity/v3/projects/0c22d958d2a54c76ad637a00132d63eb => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:54:04.597601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88a1a0-caa6-4806-b3bc-34c687624554 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:04.598742 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88a1a0-caa6-4806-b3bc-34c687624554 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:04.599213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88a1a0-caa6-4806-b3bc-34c687624554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:04.618628 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-7b88a1a0-caa6-4806-b3bc-34c687624554 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:54:04.619888 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7b88a1a0-caa6-4806-b3bc-34c687624554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:04.688075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1119/2202] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:54:04.697408 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d4d63-2d20-4d05-a53a-28fe35c8a866 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:04.697695 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d4d63-2d20-4d05-a53a-28fe35c8a866 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:04.697976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d4d63-2d20-4d05-a53a-28fe35c8a866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:04.741411 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e02d4d63-2d20-4d05-a53a-28fe35c8a866 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:54:04.742728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e02d4d63-2d20-4d05-a53a-28fe35c8a866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:04.762917 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1084/2203] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:54:04.765021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88a1a0-caa6-4806-b3bc-34c687624554 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:04.775451 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88a1a0-caa6-4806-b3bc-34c687624554 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:04.780313 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd0edc-9f67-4adf-9024-3d734afc17e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:04.780973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd0edc-9f67-4adf-9024-3d734afc17e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:04.781254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd0edc-9f67-4adf-9024-3d734afc17e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:04.781665 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd0edc-9f67-4adf-9024-3d734afc17e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:04.782409 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd0edc-9f67-4adf-9024-3d734afc17e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:54:04.782716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd0edc-9f67-4adf-9024-3d734afc17e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:04.784955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd0edc-9f67-4adf-9024-3d734afc17e5 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:04.805375 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1120/2204] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:54:04.809861 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d4d63-2d20-4d05-a53a-28fe35c8a866 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:04.820358 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d4d63-2d20-4d05-a53a-28fe35c8a866 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:04.825364 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e400f93-5711-40c6-bf3b-59287331a3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:04.826138 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e400f93-5711-40c6-bf3b-59287331a3fc admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:04.826519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e400f93-5711-40c6-bf3b-59287331a3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:04.826884 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e400f93-5711-40c6-bf3b-59287331a3fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:04.827647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e400f93-5711-40c6-bf3b-59287331a3fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:04.829856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e400f93-5711-40c6-bf3b-59287331a3fc admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:04.942601 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1085/2205] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:54:04 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:54:04.947466 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd0edc-9f67-4adf-9024-3d734afc17e5 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:04.957566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd0edc-9f67-4adf-9024-3d734afc17e5 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:05.031374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71fed4-7453-43c2-850f-f9fdd0406910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:05.032093 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71fed4-7453-43c2-850f-f9fdd0406910 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:05.032377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71fed4-7453-43c2-850f-f9fdd0406910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:05.032650 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71fed4-7453-43c2-850f-f9fdd0406910 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:05.033350 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71fed4-7453-43c2-850f-f9fdd0406910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:05.035250 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71fed4-7453-43c2-850f-f9fdd0406910 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:05.136952 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1121/2206] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:54:04 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:54:05.140885 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e400f93-5711-40c6-bf3b-59287331a3fc admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:05.151089 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e400f93-5711-40c6-bf3b-59287331a3fc admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:05.156006 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74451c-98b6-43a7-9250-c01b709f9bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:05.156727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74451c-98b6-43a7-9250-c01b709f9bde admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:05.157040 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74451c-98b6-43a7-9250-c01b709f9bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:05.157312 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74451c-98b6-43a7-9250-c01b709f9bde admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:05.158036 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74451c-98b6-43a7-9250-c01b709f9bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:05.159647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74451c-98b6-43a7-9250-c01b709f9bde admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:05.170589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1086/2207] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 06:54:05.174627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71fed4-7453-43c2-850f-f9fdd0406910 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:05.185938 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71fed4-7453-43c2-850f-f9fdd0406910 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:05.191774 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcbd5a-dcc5-4744-a0d2-7d49c80a4811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:05.192443 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcbd5a-dcc5-4744-a0d2-7d49c80a4811 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:05.192725 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcbd5a-dcc5-4744-a0d2-7d49c80a4811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:05.193000 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcbd5a-dcc5-4744-a0d2-7d49c80a4811 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:05.193755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bcbd5a-dcc5-4744-a0d2-7d49c80a4811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:05.195373 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bcbd5a-dcc5-4744-a0d2-7d49c80a4811 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:05.205718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1122/2208] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 06:54:05.209894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74451c-98b6-43a7-9250-c01b709f9bde admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:05.221372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74451c-98b6-43a7-9250-c01b709f9bde admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:05.226947 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc4d10-24a4-462c-a353-4bc097fbfa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:05.228102 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc4d10-24a4-462c-a353-4bc097fbfa43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:05.228392 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc4d10-24a4-462c-a353-4bc097fbfa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:05.228670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc4d10-24a4-462c-a353-4bc097fbfa43 admin admin] PATH_INFO: `/v3/projects/135eede75e7f46d7a01194379a490aff/users/29ae2496e46249af9d97af718fcd81c2/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:05.246957 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc4d10-24a4-462c-a353-4bc097fbfa43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=135eede75e7f46d7a01194379a490aff, user_id=29ae2496e46249af9d97af718fcd81c2, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:05.249972 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc4d10-24a4-462c-a353-4bc097fbfa43 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:05.517928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1087/2209] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:54:05 2022] PUT /identity/v3/projects/135eede75e7f46d7a01194379a490aff/users/29ae2496e46249af9d97af718fcd81c2/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:54:05.528977 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6944ef8-c3b5-4161-b693-adf37dfd1afe None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:05.529269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6944ef8-c3b5-4161-b693-adf37dfd1afe None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:05.529546 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6944ef8-c3b5-4161-b693-adf37dfd1afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:05.558857 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d6944ef8-c3b5-4161-b693-adf37dfd1afe None None] MFA Rules not processed for user `29ae2496e46249af9d97af718fcd81c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:54:05.560106 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d6944ef8-c3b5-4161-b693-adf37dfd1afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:05.635050 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1123/2210] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:54:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:54:05.639654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc4d10-24a4-462c-a353-4bc097fbfa43 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:05.715125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc4d10-24a4-462c-a353-4bc097fbfa43 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:05.719676 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12fe93-f9ad-495e-8f95-0660f133f37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:05.720372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12fe93-f9ad-495e-8f95-0660f133f37c admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:05.720677 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12fe93-f9ad-495e-8f95-0660f133f37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:05.720945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12fe93-f9ad-495e-8f95-0660f133f37c admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:05.721628 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12fe93-f9ad-495e-8f95-0660f133f37c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:05.723533 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12fe93-f9ad-495e-8f95-0660f133f37c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:05.821544 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1088/2211] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:54:05 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:54:05.822758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6944ef8-c3b5-4161-b693-adf37dfd1afe None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:05.836648 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6944ef8-c3b5-4161-b693-adf37dfd1afe None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:05.914081 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335a9dd-a36b-4867-b249-0a23b54921bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:05.914761 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335a9dd-a36b-4867-b249-0a23b54921bd admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:05.915041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335a9dd-a36b-4867-b249-0a23b54921bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:05.915314 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335a9dd-a36b-4867-b249-0a23b54921bd admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:05.916340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335a9dd-a36b-4867-b249-0a23b54921bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:05.918460 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335a9dd-a36b-4867-b249-0a23b54921bd admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:06.046240 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1124/2212] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:54:05 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:54:06.049907 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12fe93-f9ad-495e-8f95-0660f133f37c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:06.062490 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12fe93-f9ad-495e-8f95-0660f133f37c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:06.067135 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ad63b-6971-48a2-b098-f0f4b7442b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:06.067840 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ad63b-6971-48a2-b098-f0f4b7442b7a admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:06.072992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ad63b-6971-48a2-b098-f0f4b7442b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:06.072992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ad63b-6971-48a2-b098-f0f4b7442b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:06.072992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ad63b-6971-48a2-b098-f0f4b7442b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:06.072992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ad63b-6971-48a2-b098-f0f4b7442b7a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:06.083461 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1089/2213] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:54:06.088320 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335a9dd-a36b-4867-b249-0a23b54921bd admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:06.099903 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335a9dd-a36b-4867-b249-0a23b54921bd admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:06.105313 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87091b5-ac93-4f56-9cfd-c66cb188852f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:06.106084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87091b5-ac93-4f56-9cfd-c66cb188852f admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:06.106454 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87091b5-ac93-4f56-9cfd-c66cb188852f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:06.106762 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87091b5-ac93-4f56-9cfd-c66cb188852f admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:06.107746 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87091b5-ac93-4f56-9cfd-c66cb188852f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:06.109651 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87091b5-ac93-4f56-9cfd-c66cb188852f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:06.128216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1125/2214] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:54:06.130302 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ad63b-6971-48a2-b098-f0f4b7442b7a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:06.141063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ad63b-6971-48a2-b098-f0f4b7442b7a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:06.145697 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a27e77-d62f-41a8-97cb-1ecbc662cf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:06.146571 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a27e77-d62f-41a8-97cb-1ecbc662cf31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:06.146888 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a27e77-d62f-41a8-97cb-1ecbc662cf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:06.147815 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a27e77-d62f-41a8-97cb-1ecbc662cf31 admin admin] PATH_INFO: `/v3/projects/60f918c329a24526b30c18c408f354d7/users/ebbc08467dfd428ea06c9d9d5331a4da/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:06.162619 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a27e77-d62f-41a8-97cb-1ecbc662cf31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f918c329a24526b30c18c408f354d7, user_id=ebbc08467dfd428ea06c9d9d5331a4da, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:06.165405 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a27e77-d62f-41a8-97cb-1ecbc662cf31 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:06.279934 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1090/2215] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:54:06 2022] PUT /identity/v3/projects/60f918c329a24526b30c18c408f354d7/users/ebbc08467dfd428ea06c9d9d5331a4da/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:54:06.350311 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4ab89-6be1-4269-ae58-e0523de2f694 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:06.350898 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4ab89-6be1-4269-ae58-e0523de2f694 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:06.351237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4ab89-6be1-4269-ae58-e0523de2f694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:06.383666 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d7a4ab89-6be1-4269-ae58-e0523de2f694 None None] MFA Rules not processed for user `ebbc08467dfd428ea06c9d9d5331a4da`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:54:06.384905 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d7a4ab89-6be1-4269-ae58-e0523de2f694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:06.454927 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1126/2216] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:54:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:54:06.456466 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a27e77-d62f-41a8-97cb-1ecbc662cf31 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:06.532388 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a27e77-d62f-41a8-97cb-1ecbc662cf31 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:06.537698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f388a5f-995e-4491-98ba-8f3f0066c059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:06.538384 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f388a5f-995e-4491-98ba-8f3f0066c059 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:06.538669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f388a5f-995e-4491-98ba-8f3f0066c059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:06.538949 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f388a5f-995e-4491-98ba-8f3f0066c059 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:06.542516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f388a5f-995e-4491-98ba-8f3f0066c059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:06.542516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f388a5f-995e-4491-98ba-8f3f0066c059 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:06.681187 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1091/2217] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:54:06 2022] POST /identity/v3/projects => generated 383 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:54:06.684781 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4ab89-6be1-4269-ae58-e0523de2f694 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:06.696623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4ab89-6be1-4269-ae58-e0523de2f694 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:06.767665 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d159ed-a3d2-494e-81dd-98a72b22a062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:06.768634 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d159ed-a3d2-494e-81dd-98a72b22a062 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:06.769072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d159ed-a3d2-494e-81dd-98a72b22a062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:06.769527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d159ed-a3d2-494e-81dd-98a72b22a062 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:06.770375 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d159ed-a3d2-494e-81dd-98a72b22a062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:06.772560 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d159ed-a3d2-494e-81dd-98a72b22a062 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:06.890075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1127/2218] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:54:06 2022] POST /identity/v3/users => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:54:06.894069 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f388a5f-995e-4491-98ba-8f3f0066c059 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:06.906617 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f388a5f-995e-4491-98ba-8f3f0066c059 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:06.911465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abe485-520f-484b-890a-04e1bf4a6e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:06.912169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abe485-520f-484b-890a-04e1bf4a6e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:06.912452 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abe485-520f-484b-890a-04e1bf4a6e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:06.912721 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abe485-520f-484b-890a-04e1bf4a6e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:06.913457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abe485-520f-484b-890a-04e1bf4a6e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:06.915107 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abe485-520f-484b-890a-04e1bf4a6e07 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:06.926570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1092/2219] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:54:06.930781 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d159ed-a3d2-494e-81dd-98a72b22a062 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:06.942089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d159ed-a3d2-494e-81dd-98a72b22a062 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:06.947465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453c11d-e464-4bb9-89b6-890ae10ea5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:06.948456 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453c11d-e464-4bb9-89b6-890ae10ea5fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:06.948738 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453c11d-e464-4bb9-89b6-890ae10ea5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:06.949611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453c11d-e464-4bb9-89b6-890ae10ea5fd admin admin] PATH_INFO: `/v3/projects/8664d5b0e380496ca2a5933648f1f60c/users/3fd56778086849cb9a139f64c5b46c9f/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:06.973731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453c11d-e464-4bb9-89b6-890ae10ea5fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8664d5b0e380496ca2a5933648f1f60c, user_id=3fd56778086849cb9a139f64c5b46c9f, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:06.978362 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453c11d-e464-4bb9-89b6-890ae10ea5fd admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:07.124547 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1128/2220] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:54:06 2022] PUT /identity/v3/projects/8664d5b0e380496ca2a5933648f1f60c/users/3fd56778086849cb9a139f64c5b46c9f/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:54:07.128211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abe485-520f-484b-890a-04e1bf4a6e07 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:07.139085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abe485-520f-484b-890a-04e1bf4a6e07 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:07.233979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c039fa1-f12e-432b-8f68-38bb272c52f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:07.234996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c039fa1-f12e-432b-8f68-38bb272c52f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:07.234996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c039fa1-f12e-432b-8f68-38bb272c52f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:07.235233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c039fa1-f12e-432b-8f68-38bb272c52f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:07.236089 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c039fa1-f12e-432b-8f68-38bb272c52f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:07.237684 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c039fa1-f12e-432b-8f68-38bb272c52f9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:07.248795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1093/2221] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 06:54:07.252960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453c11d-e464-4bb9-89b6-890ae10ea5fd admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:07.264014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453c11d-e464-4bb9-89b6-890ae10ea5fd admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:07.268858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee65d5-f4cd-4588-a188-ece9bf67f578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:07.269745 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee65d5-f4cd-4588-a188-ece9bf67f578 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:07.275678 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee65d5-f4cd-4588-a188-ece9bf67f578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:07.275678 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee65d5-f4cd-4588-a188-ece9bf67f578 admin admin] PATH_INFO: `/v3/projects/8664d5b0e380496ca2a5933648f1f60c/users/3fd56778086849cb9a139f64c5b46c9f/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:07.275678 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee65d5-f4cd-4588-a188-ece9bf67f578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8664d5b0e380496ca2a5933648f1f60c, user_id=3fd56778086849cb9a139f64c5b46c9f, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:07.275678 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee65d5-f4cd-4588-a188-ece9bf67f578 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:07.285161 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1129/2222] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:54:07 2022] PUT /identity/v3/projects/8664d5b0e380496ca2a5933648f1f60c/users/3fd56778086849cb9a139f64c5b46c9f/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:54:07.295596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1a809-77bb-4604-9faa-e339d978fdf6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:07.295915 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1a809-77bb-4604-9faa-e339d978fdf6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:07.296194 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1a809-77bb-4604-9faa-e339d978fdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:07.323218 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c0f1a809-77bb-4604-9faa-e339d978fdf6 None None] MFA Rules not processed for user `3fd56778086849cb9a139f64c5b46c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:54:07.324456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c0f1a809-77bb-4604-9faa-e339d978fdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:07.404178 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1094/2223] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:54:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:54:07.411644 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee65d5-f4cd-4588-a188-ece9bf67f578 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:07.414245 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7aee65d5-f4cd-4588-a188-ece9bf67f578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:07.482273 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee65d5-f4cd-4588-a188-ece9bf67f578 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:07.486913 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507f644-23ff-453a-be31-0acc14404b4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:07.487553 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507f644-23ff-453a-be31-0acc14404b4b service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:07.487883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507f644-23ff-453a-be31-0acc14404b4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:07.488160 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507f644-23ff-453a-be31-0acc14404b4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:07.556287 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507f644-23ff-453a-be31-0acc14404b4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:07.557959 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507f644-23ff-453a-be31-0acc14404b4b service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:07.566968 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1130/2224] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:54:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:54:10.065664 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1a809-77bb-4604-9faa-e339d978fdf6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:10.081754 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1a809-77bb-4604-9faa-e339d978fdf6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:10.089429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ab69b-bd60-40c6-a36b-e1bad47f565f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:10.090405 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ab69b-bd60-40c6-a36b-e1bad47f565f service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:10.090743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ab69b-bd60-40c6-a36b-e1bad47f565f service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:10.096114 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ab69b-bd60-40c6-a36b-e1bad47f565f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:10.171613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ab69b-bd60-40c6-a36b-e1bad47f565f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:10.173412 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ab69b-bd60-40c6-a36b-e1bad47f565f service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:10.184797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1095/2225] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:54:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:54:12.024675 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507f644-23ff-453a-be31-0acc14404b4b service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:12.035716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507f644-23ff-453a-be31-0acc14404b4b service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:12.046439 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fe88b-da9f-4d76-91d4-4d48e1d8b0fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:12.047355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fe88b-da9f-4d76-91d4-4d48e1d8b0fc service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:12.047639 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fe88b-da9f-4d76-91d4-4d48e1d8b0fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:12.047949 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fe88b-da9f-4d76-91d4-4d48e1d8b0fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:12.069681 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fe88b-da9f-4d76-91d4-4d48e1d8b0fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:12.071410 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fe88b-da9f-4d76-91d4-4d48e1d8b0fc service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:12.082537 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1131/2226] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:54:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:54:18.160243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ab69b-bd60-40c6-a36b-e1bad47f565f service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:18.221160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ab69b-bd60-40c6-a36b-e1bad47f565f service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:18.226260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cfc3e-27cd-4b22-93a4-a076f3d1b8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:18.227106 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cfc3e-27cd-4b22-93a4-a076f3d1b8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:18.227378 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cfc3e-27cd-4b22-93a4-a076f3d1b8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:18.227642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cfc3e-27cd-4b22-93a4-a076f3d1b8cd admin admin] PATH_INFO: `/v3/users/29ae2496e46249af9d97af718fcd81c2` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:18.228858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5cfc3e-27cd-4b22-93a4-a076f3d1b8cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=29ae2496e46249af9d97af718fcd81c2)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:18.230764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5cfc3e-27cd-4b22-93a4-a076f3d1b8cd admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:18.424644 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3d5cfc3e-27cd-4b22-93a4-a076f3d1b8cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29ae2496e46249af9d97af718fcd81c2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:18.425303 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3d5cfc3e-27cd-4b22-93a4-a076f3d1b8cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29ae2496e46249af9d97af718fcd81c2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:18.437855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3d5cfc3e-27cd-4b22-93a4-a076f3d1b8cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29ae2496e46249af9d97af718fcd81c2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:18.438592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3d5cfc3e-27cd-4b22-93a4-a076f3d1b8cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29ae2496e46249af9d97af718fcd81c2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:18.445758 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3d5cfc3e-27cd-4b22-93a4-a076f3d1b8cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29ae2496e46249af9d97af718fcd81c2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:18.552594 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1096/2227] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:54:18 2022] DELETE /identity/v3/users/29ae2496e46249af9d97af718fcd81c2 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:54:18.557720 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852125b-804a-4be9-b5f5-c8fd9c7d4e7e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:18.561673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852125b-804a-4be9-b5f5-c8fd9c7d4e7e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:18.561673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852125b-804a-4be9-b5f5-c8fd9c7d4e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:18.582768 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-b852125b-804a-4be9-b5f5-c8fd9c7d4e7e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:54:18.584108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b852125b-804a-4be9-b5f5-c8fd9c7d4e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:18.642456 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1132/2228] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:54:18.652147 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cfc3e-27cd-4b22-93a4-a076f3d1b8cd admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:18.653569 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3d5cfc3e-27cd-4b22-93a4-a076f3d1b8cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:18.711547 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cfc3e-27cd-4b22-93a4-a076f3d1b8cd admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:18.715213 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7168737-325c-4cd6-9ff9-ee96bc33a0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:18.715902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7168737-325c-4cd6-9ff9-ee96bc33a0aa service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:18.716187 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7168737-325c-4cd6-9ff9-ee96bc33a0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:18.716462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7168737-325c-4cd6-9ff9-ee96bc33a0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:18.726478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7168737-325c-4cd6-9ff9-ee96bc33a0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:18.727936 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7168737-325c-4cd6-9ff9-ee96bc33a0aa service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:18.739812 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1097/2229] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:54:19.188207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852125b-804a-4be9-b5f5-c8fd9c7d4e7e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:19.190019 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b852125b-804a-4be9-b5f5-c8fd9c7d4e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:19.202822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852125b-804a-4be9-b5f5-c8fd9c7d4e7e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:19.208420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f19a3-71b2-4c8f-9f84-6fac419890ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:19.210147 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f19a3-71b2-4c8f-9f84-6fac419890ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:19.212026 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f19a3-71b2-4c8f-9f84-6fac419890ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:19.212026 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f19a3-71b2-4c8f-9f84-6fac419890ba admin admin] PATH_INFO: `/v3/projects/135eede75e7f46d7a01194379a490aff` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:19.212339 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f19a3-71b2-4c8f-9f84-6fac419890ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=135eede75e7f46d7a01194379a490aff)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:19.214074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f19a3-71b2-4c8f-9f84-6fac419890ba admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:19.316588 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-870f19a3-71b2-4c8f-9f84-6fac419890ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '135eede75e7f46d7a01194379a490aff', 'request_id': 'req-870f19a3-71b2-4c8f-9f84-6fac419890ba'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:19.387121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-870f19a3-71b2-4c8f-9f84-6fac419890ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '135eede75e7f46d7a01194379a490aff', 'request_id': 'req-870f19a3-71b2-4c8f-9f84-6fac419890ba'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:19.393637 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-870f19a3-71b2-4c8f-9f84-6fac419890ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '135eede75e7f46d7a01194379a490aff', 'request_id': 'req-870f19a3-71b2-4c8f-9f84-6fac419890ba'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:19.405280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-870f19a3-71b2-4c8f-9f84-6fac419890ba admin admin] The token cache is being invalidate because project 135eede75e7f46d7a01194379a490aff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:54:19.405566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-870f19a3-71b2-4c8f-9f84-6fac419890ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:19.406226 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-870f19a3-71b2-4c8f-9f84-6fac419890ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:19.407840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1133/2230] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:54:19 2022] DELETE /identity/v3/projects/135eede75e7f46d7a01194379a490aff => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:54:19.411539 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7168737-325c-4cd6-9ff9-ee96bc33a0aa service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:19.422202 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7168737-325c-4cd6-9ff9-ee96bc33a0aa service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:19.480191 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47628ea4-76e8-48a7-bcf2-6bffe4c13036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:19.481089 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47628ea4-76e8-48a7-bcf2-6bffe4c13036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:19.481403 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47628ea4-76e8-48a7-bcf2-6bffe4c13036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:19.481678 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47628ea4-76e8-48a7-bcf2-6bffe4c13036 admin admin] PATH_INFO: `/v3/users/ebbc08467dfd428ea06c9d9d5331a4da` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:19.482947 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47628ea4-76e8-48a7-bcf2-6bffe4c13036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebbc08467dfd428ea06c9d9d5331a4da)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:19.484894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47628ea4-76e8-48a7-bcf2-6bffe4c13036 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:19.735470 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-47628ea4-76e8-48a7-bcf2-6bffe4c13036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebbc08467dfd428ea06c9d9d5331a4da'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:19.736411 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-47628ea4-76e8-48a7-bcf2-6bffe4c13036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebbc08467dfd428ea06c9d9d5331a4da'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:19.751128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-47628ea4-76e8-48a7-bcf2-6bffe4c13036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebbc08467dfd428ea06c9d9d5331a4da'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:19.752134 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-47628ea4-76e8-48a7-bcf2-6bffe4c13036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebbc08467dfd428ea06c9d9d5331a4da'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:19.760446 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-47628ea4-76e8-48a7-bcf2-6bffe4c13036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebbc08467dfd428ea06c9d9d5331a4da'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:19.877698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1098/2231] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:54:19 2022] DELETE /identity/v3/users/ebbc08467dfd428ea06c9d9d5331a4da => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:54:20.423291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f19a3-71b2-4c8f-9f84-6fac419890ba admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:20.430494 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-870f19a3-71b2-4c8f-9f84-6fac419890ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:20.438918 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f19a3-71b2-4c8f-9f84-6fac419890ba admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:20.496522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35e51a-7fb3-4ce5-b11f-42550065f710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:20.497380 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35e51a-7fb3-4ce5-b11f-42550065f710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:20.497685 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35e51a-7fb3-4ce5-b11f-42550065f710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:20.497941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35e51a-7fb3-4ce5-b11f-42550065f710 admin admin] PATH_INFO: `/v3/projects/60f918c329a24526b30c18c408f354d7` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:20.499123 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35e51a-7fb3-4ce5-b11f-42550065f710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f918c329a24526b30c18c408f354d7)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:20.501129 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35e51a-7fb3-4ce5-b11f-42550065f710 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:20.637372 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ad35e51a-7fb3-4ce5-b11f-42550065f710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f918c329a24526b30c18c408f354d7', 'request_id': 'req-ad35e51a-7fb3-4ce5-b11f-42550065f710'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:20.735166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ad35e51a-7fb3-4ce5-b11f-42550065f710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f918c329a24526b30c18c408f354d7', 'request_id': 'req-ad35e51a-7fb3-4ce5-b11f-42550065f710'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:20.742319 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ad35e51a-7fb3-4ce5-b11f-42550065f710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f918c329a24526b30c18c408f354d7', 'request_id': 'req-ad35e51a-7fb3-4ce5-b11f-42550065f710'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:20.753356 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ad35e51a-7fb3-4ce5-b11f-42550065f710 admin admin] The token cache is being invalidate because project 60f918c329a24526b30c18c408f354d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:54:20.753641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ad35e51a-7fb3-4ce5-b11f-42550065f710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:20.754278 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ad35e51a-7fb3-4ce5-b11f-42550065f710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:20.757051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1134/2232] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:54:20 2022] DELETE /identity/v3/projects/60f918c329a24526b30c18c408f354d7 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:54:20.760315 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47628ea4-76e8-48a7-bcf2-6bffe4c13036 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:20.761717 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-47628ea4-76e8-48a7-bcf2-6bffe4c13036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:20.774439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47628ea4-76e8-48a7-bcf2-6bffe4c13036 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:20.835557 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d74918-ec59-4e7e-82b2-bcbae651b333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:20.836512 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d74918-ec59-4e7e-82b2-bcbae651b333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:20.836794 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d74918-ec59-4e7e-82b2-bcbae651b333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:20.837152 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d74918-ec59-4e7e-82b2-bcbae651b333 admin admin] PATH_INFO: `/v3/users/3fd56778086849cb9a139f64c5b46c9f` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:20.838365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d74918-ec59-4e7e-82b2-bcbae651b333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fd56778086849cb9a139f64c5b46c9f)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:20.840364 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d74918-ec59-4e7e-82b2-bcbae651b333 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:21.040756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c6d74918-ec59-4e7e-82b2-bcbae651b333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd56778086849cb9a139f64c5b46c9f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:21.041418 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c6d74918-ec59-4e7e-82b2-bcbae651b333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd56778086849cb9a139f64c5b46c9f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:21.054147 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c6d74918-ec59-4e7e-82b2-bcbae651b333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd56778086849cb9a139f64c5b46c9f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:21.054839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c6d74918-ec59-4e7e-82b2-bcbae651b333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd56778086849cb9a139f64c5b46c9f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:21.067304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c6d74918-ec59-4e7e-82b2-bcbae651b333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd56778086849cb9a139f64c5b46c9f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:21.146901 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1099/2233] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:54:20 2022] DELETE /identity/v3/users/3fd56778086849cb9a139f64c5b46c9f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:54:21.674469 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35e51a-7fb3-4ce5-b11f-42550065f710 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:21.675957 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ad35e51a-7fb3-4ce5-b11f-42550065f710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:21.689277 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35e51a-7fb3-4ce5-b11f-42550065f710 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:21.744909 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f89440-fa42-45d6-aec3-8d8eba5a75cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:21.745769 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f89440-fa42-45d6-aec3-8d8eba5a75cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:21.746053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f89440-fa42-45d6-aec3-8d8eba5a75cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:21.746331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f89440-fa42-45d6-aec3-8d8eba5a75cf admin admin] PATH_INFO: `/v3/projects/8664d5b0e380496ca2a5933648f1f60c` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:21.747507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f89440-fa42-45d6-aec3-8d8eba5a75cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8664d5b0e380496ca2a5933648f1f60c)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:21.749450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f89440-fa42-45d6-aec3-8d8eba5a75cf admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:21.855885 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-28f89440-fa42-45d6-aec3-8d8eba5a75cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8664d5b0e380496ca2a5933648f1f60c', 'request_id': 'req-28f89440-fa42-45d6-aec3-8d8eba5a75cf'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:21.935351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-28f89440-fa42-45d6-aec3-8d8eba5a75cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8664d5b0e380496ca2a5933648f1f60c', 'request_id': 'req-28f89440-fa42-45d6-aec3-8d8eba5a75cf'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:21.941309 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-28f89440-fa42-45d6-aec3-8d8eba5a75cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8664d5b0e380496ca2a5933648f1f60c', 'request_id': 'req-28f89440-fa42-45d6-aec3-8d8eba5a75cf'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:21.953276 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-28f89440-fa42-45d6-aec3-8d8eba5a75cf admin admin] The token cache is being invalidate because project 8664d5b0e380496ca2a5933648f1f60c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:54:21.953764 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-28f89440-fa42-45d6-aec3-8d8eba5a75cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:21.954810 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-28f89440-fa42-45d6-aec3-8d8eba5a75cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:21.967722 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1135/2234] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:54:21 2022] DELETE /identity/v3/projects/8664d5b0e380496ca2a5933648f1f60c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:54:24.777015 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56508194-24ba-4e28-afeb-b6b058a6475e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:24.777496 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56508194-24ba-4e28-afeb-b6b058a6475e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:24.777670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56508194-24ba-4e28-afeb-b6b058a6475e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:24.807316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-56508194-24ba-4e28-afeb-b6b058a6475e None None] MFA Rules not processed for user `7a25a3f2c9a148a1ae73e519070b190b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:54:24.808557 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-56508194-24ba-4e28-afeb-b6b058a6475e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:24.873730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1100/2235] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 12 06:54:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:54:24.917079 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f89440-fa42-45d6-aec3-8d8eba5a75cf admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:24.918469 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-28f89440-fa42-45d6-aec3-8d8eba5a75cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:24.988987 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f89440-fa42-45d6-aec3-8d8eba5a75cf admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:24.994745 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477a52d-bc43-4d91-ba0b-151e328713c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9882820f88349cb8fa2e3d457b19959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:24.995106 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477a52d-bc43-4d91-ba0b-151e328713c8 service swift] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:24.995462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477a52d-bc43-4d91-ba0b-151e328713c8 service swift] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:24.995663 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477a52d-bc43-4d91-ba0b-151e328713c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:25.004446 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477a52d-bc43-4d91-ba0b-151e328713c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:25.006559 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477a52d-bc43-4d91-ba0b-151e328713c8 service swift] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:25.014927 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1136/2236] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 12 06:54:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 06:54:29.590944 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56508194-24ba-4e28-afeb-b6b058a6475e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:29.592581 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-56508194-24ba-4e28-afeb-b6b058a6475e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:29.676516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56508194-24ba-4e28-afeb-b6b058a6475e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:29.681144 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c78b46-546b-4a0a-ad13-e477271e186d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:29.681659 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c78b46-546b-4a0a-ad13-e477271e186d service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:29.682005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c78b46-546b-4a0a-ad13-e477271e186d service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:29.682237 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c78b46-546b-4a0a-ad13-e477271e186d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:29.684099 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-89c78b46-546b-4a0a-ad13-e477271e186d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:29.765121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c78b46-546b-4a0a-ad13-e477271e186d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:29.766916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c78b46-546b-4a0a-ad13-e477271e186d service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:29.784028 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1101/2237] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:54:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:54:30.646558 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477a52d-bc43-4d91-ba0b-151e328713c8 service swift] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:30.648109 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0477a52d-bc43-4d91-ba0b-151e328713c8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:30.776944 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477a52d-bc43-4d91-ba0b-151e328713c8 service swift] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:30.804105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b197c-abef-4c50-b15d-dfc3e76600d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:30.805246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b197c-abef-4c50-b15d-dfc3e76600d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:30.805615 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b197c-abef-4c50-b15d-dfc3e76600d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:30.806093 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b197c-abef-4c50-b15d-dfc3e76600d0 admin admin] PATH_INFO: `/v3/users/f66af96caf344b7c85ec51c50b9c2489` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:30.807463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b197c-abef-4c50-b15d-dfc3e76600d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f66af96caf344b7c85ec51c50b9c2489)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:30.809810 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b197c-abef-4c50-b15d-dfc3e76600d0 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:31.023958 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a45b197c-abef-4c50-b15d-dfc3e76600d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f66af96caf344b7c85ec51c50b9c2489'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:31.024980 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a45b197c-abef-4c50-b15d-dfc3e76600d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f66af96caf344b7c85ec51c50b9c2489'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:31.025808 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a45b197c-abef-4c50-b15d-dfc3e76600d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f66af96caf344b7c85ec51c50b9c2489'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:31.040031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a45b197c-abef-4c50-b15d-dfc3e76600d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f66af96caf344b7c85ec51c50b9c2489'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:31.047503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a45b197c-abef-4c50-b15d-dfc3e76600d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f66af96caf344b7c85ec51c50b9c2489'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:31.159003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1137/2238] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:54:30 2022] DELETE /identity/v3/users/f66af96caf344b7c85ec51c50b9c2489 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:54:31.159223 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0b08e-57d1-46aa-a316-0fa9d0502b57 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:31.159678 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0b08e-57d1-46aa-a316-0fa9d0502b57 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:31.160065 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0b08e-57d1-46aa-a316-0fa9d0502b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:31.186731 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7cc0b08e-57d1-46aa-a316-0fa9d0502b57 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:54:31.189730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7cc0b08e-57d1-46aa-a316-0fa9d0502b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:31.271287 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1102/2239] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:54:31.295937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b197c-abef-4c50-b15d-dfc3e76600d0 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:31.297477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a45b197c-abef-4c50-b15d-dfc3e76600d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:31.380375 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b197c-abef-4c50-b15d-dfc3e76600d0 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:31.388152 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13583ca-83fa-4c5d-a12f-1ce38e7d8c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:31.390931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13583ca-83fa-4c5d-a12f-1ce38e7d8c6b service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:31.390931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13583ca-83fa-4c5d-a12f-1ce38e7d8c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:31.390931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13583ca-83fa-4c5d-a12f-1ce38e7d8c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:31.403085 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13583ca-83fa-4c5d-a12f-1ce38e7d8c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:31.404778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13583ca-83fa-4c5d-a12f-1ce38e7d8c6b service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:31.416673 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1138/2240] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:54:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:54:32.140354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0b08e-57d1-46aa-a316-0fa9d0502b57 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:32.142446 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7cc0b08e-57d1-46aa-a316-0fa9d0502b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:32.160370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0b08e-57d1-46aa-a316-0fa9d0502b57 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:32.172110 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0796e6-1a22-4ff6-9f47-edcf8e53282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:32.175291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0796e6-1a22-4ff6-9f47-edcf8e53282f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:32.175291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0796e6-1a22-4ff6-9f47-edcf8e53282f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:32.175291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0796e6-1a22-4ff6-9f47-edcf8e53282f admin admin] PATH_INFO: `/v3/projects/992913e9698345b29cb39154f0ec14ae` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:32.177044 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0796e6-1a22-4ff6-9f47-edcf8e53282f admin admin] RBAC: Authorizing `identity:delete_project(project_id=992913e9698345b29cb39154f0ec14ae)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:32.180654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0796e6-1a22-4ff6-9f47-edcf8e53282f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:32.336653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cd0796e6-1a22-4ff6-9f47-edcf8e53282f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '992913e9698345b29cb39154f0ec14ae', 'request_id': 'req-cd0796e6-1a22-4ff6-9f47-edcf8e53282f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:32.405356 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cd0796e6-1a22-4ff6-9f47-edcf8e53282f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '992913e9698345b29cb39154f0ec14ae', 'request_id': 'req-cd0796e6-1a22-4ff6-9f47-edcf8e53282f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:32.415097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cd0796e6-1a22-4ff6-9f47-edcf8e53282f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '992913e9698345b29cb39154f0ec14ae', 'request_id': 'req-cd0796e6-1a22-4ff6-9f47-edcf8e53282f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:32.448422 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cd0796e6-1a22-4ff6-9f47-edcf8e53282f admin admin] The token cache is being invalidate because project 992913e9698345b29cb39154f0ec14ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:54:32.448889 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cd0796e6-1a22-4ff6-9f47-edcf8e53282f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:32.449685 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cd0796e6-1a22-4ff6-9f47-edcf8e53282f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:32.452634 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1103/2241] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:54:32 2022] DELETE /identity/v3/projects/992913e9698345b29cb39154f0ec14ae => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:54:32.457515 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425aea9-ba70-4006-8121-1f58a53943b7 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:32.458058 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425aea9-ba70-4006-8121-1f58a53943b7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:32.458516 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425aea9-ba70-4006-8121-1f58a53943b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:32.511922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-7425aea9-ba70-4006-8121-1f58a53943b7 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:54:32.513434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7425aea9-ba70-4006-8121-1f58a53943b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:32.632764 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1139/2242] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:54:32.634101 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788715b-55a3-4dc2-9846-8960a68bfce8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:32.634609 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788715b-55a3-4dc2-9846-8960a68bfce8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:32.635096 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788715b-55a3-4dc2-9846-8960a68bfce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:32.656510 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8788715b-55a3-4dc2-9846-8960a68bfce8 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:54:32.658451 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8788715b-55a3-4dc2-9846-8960a68bfce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:32.671719 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1104/2243] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:54:32.673804 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425aea9-ba70-4006-8121-1f58a53943b7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:32.687004 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425aea9-ba70-4006-8121-1f58a53943b7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:32.692163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbbe44-80fe-4e7b-9f4e-99e91e3bc92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:32.692963 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbbe44-80fe-4e7b-9f4e-99e91e3bc92d admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:32.693900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbbe44-80fe-4e7b-9f4e-99e91e3bc92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:32.694279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbbe44-80fe-4e7b-9f4e-99e91e3bc92d admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:32.695148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbbe44-80fe-4e7b-9f4e-99e91e3bc92d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:54:32.695572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbbe44-80fe-4e7b-9f4e-99e91e3bc92d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:32.697300 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbbe44-80fe-4e7b-9f4e-99e91e3bc92d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:32.717795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1140/2244] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:54:32.719834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788715b-55a3-4dc2-9846-8960a68bfce8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:32.730106 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788715b-55a3-4dc2-9846-8960a68bfce8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:32.736509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e474c1e-2a4c-4ee2-8e89-877966190035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:32.738408 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e474c1e-2a4c-4ee2-8e89-877966190035 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:32.739213 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e474c1e-2a4c-4ee2-8e89-877966190035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:32.743602 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e474c1e-2a4c-4ee2-8e89-877966190035 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:32.743602 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e474c1e-2a4c-4ee2-8e89-877966190035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:32.745555 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e474c1e-2a4c-4ee2-8e89-877966190035 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:32.858466 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1105/2245] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:54:32 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:54:32.859439 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbbe44-80fe-4e7b-9f4e-99e91e3bc92d admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:32.881969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbbe44-80fe-4e7b-9f4e-99e91e3bc92d admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:32.966970 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6e4ac-51b6-4c94-a7d5-ca1a98687164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:32.967722 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6e4ac-51b6-4c94-a7d5-ca1a98687164 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:32.968023 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6e4ac-51b6-4c94-a7d5-ca1a98687164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:32.968302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6e4ac-51b6-4c94-a7d5-ca1a98687164 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:32.969023 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6e4ac-51b6-4c94-a7d5-ca1a98687164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:32.972243 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6e4ac-51b6-4c94-a7d5-ca1a98687164 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:33.058546 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1141/2246] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:54:32 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:54:33.061996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e474c1e-2a4c-4ee2-8e89-877966190035 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:33.073124 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e474c1e-2a4c-4ee2-8e89-877966190035 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:33.093475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9e5a3-7f49-4ab1-8ad9-a00790395eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:33.094352 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9e5a3-7f49-4ab1-8ad9-a00790395eed admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:33.094642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9e5a3-7f49-4ab1-8ad9-a00790395eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:33.094919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9e5a3-7f49-4ab1-8ad9-a00790395eed admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:33.095669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9e5a3-7f49-4ab1-8ad9-a00790395eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:33.100525 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9e5a3-7f49-4ab1-8ad9-a00790395eed admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:33.130386 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1106/2247] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:54:33.134890 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6e4ac-51b6-4c94-a7d5-ca1a98687164 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:33.150206 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6e4ac-51b6-4c94-a7d5-ca1a98687164 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:33.169885 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc2b4b-d923-457e-bf7e-6bb93a21c11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:33.174643 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc2b4b-d923-457e-bf7e-6bb93a21c11f admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:33.175124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc2b4b-d923-457e-bf7e-6bb93a21c11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:33.176222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc2b4b-d923-457e-bf7e-6bb93a21c11f admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:33.178614 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc2b4b-d923-457e-bf7e-6bb93a21c11f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:33.187328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc2b4b-d923-457e-bf7e-6bb93a21c11f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:33.206832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1142/2248] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:54:33.211130 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9e5a3-7f49-4ab1-8ad9-a00790395eed admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:33.226926 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9e5a3-7f49-4ab1-8ad9-a00790395eed admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:33.234082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8b30b-108b-4b8d-a511-d28d58118d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:33.245721 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8b30b-108b-4b8d-a511-d28d58118d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:33.245721 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8b30b-108b-4b8d-a511-d28d58118d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:33.245721 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8b30b-108b-4b8d-a511-d28d58118d06 admin admin] PATH_INFO: `/v3/projects/ca1d96b76b744f5dbbea4de952496509/users/77b0d7dfa73545bcac0b34df79b620cf/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:33.254508 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8b30b-108b-4b8d-a511-d28d58118d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1d96b76b744f5dbbea4de952496509, user_id=77b0d7dfa73545bcac0b34df79b620cf, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:33.257639 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8b30b-108b-4b8d-a511-d28d58118d06 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:33.423116 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1107/2249] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:54:33 2022] PUT /identity/v3/projects/ca1d96b76b744f5dbbea4de952496509/users/77b0d7dfa73545bcac0b34df79b620cf/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:54:33.433379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c65d6-4bbb-4532-9bd2-863e9528630d None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:33.433707 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c65d6-4bbb-4532-9bd2-863e9528630d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:33.433980 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c65d6-4bbb-4532-9bd2-863e9528630d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:33.479724 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f45c65d6-4bbb-4532-9bd2-863e9528630d None None] MFA Rules not processed for user `77b0d7dfa73545bcac0b34df79b620cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:54:33.481900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f45c65d6-4bbb-4532-9bd2-863e9528630d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:33.604887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1143/2250] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:54:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:54:33.613163 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8b30b-108b-4b8d-a511-d28d58118d06 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:33.614495 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f6a8b30b-108b-4b8d-a511-d28d58118d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:33.740946 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8b30b-108b-4b8d-a511-d28d58118d06 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:33.745860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad1edb-b5c4-4e4f-b674-e557594a530a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:33.746527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad1edb-b5c4-4e4f-b674-e557594a530a service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:33.746812 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad1edb-b5c4-4e4f-b674-e557594a530a service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:33.751673 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad1edb-b5c4-4e4f-b674-e557594a530a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:33.760112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad1edb-b5c4-4e4f-b674-e557594a530a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:33.762292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad1edb-b5c4-4e4f-b674-e557594a530a service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:33.775883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1108/2251] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:54:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:54:33.801837 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c65d6-4bbb-4532-9bd2-863e9528630d None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:33.888449 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c65d6-4bbb-4532-9bd2-863e9528630d None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:33.893933 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47e501-d036-47e3-942e-472b9cceace3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:33.899350 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47e501-d036-47e3-942e-472b9cceace3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:33.900104 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47e501-d036-47e3-942e-472b9cceace3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:33.903888 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47e501-d036-47e3-942e-472b9cceace3 admin admin] PATH_INFO: `/v3/users/77b0d7dfa73545bcac0b34df79b620cf` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:33.903888 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47e501-d036-47e3-942e-472b9cceace3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77b0d7dfa73545bcac0b34df79b620cf)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:33.906785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47e501-d036-47e3-942e-472b9cceace3 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:34.136458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9d47e501-d036-47e3-942e-472b9cceace3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b0d7dfa73545bcac0b34df79b620cf'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:34.137220 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9d47e501-d036-47e3-942e-472b9cceace3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b0d7dfa73545bcac0b34df79b620cf'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:34.138021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9d47e501-d036-47e3-942e-472b9cceace3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b0d7dfa73545bcac0b34df79b620cf'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:34.152823 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9d47e501-d036-47e3-942e-472b9cceace3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b0d7dfa73545bcac0b34df79b620cf'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:34.159781 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9d47e501-d036-47e3-942e-472b9cceace3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b0d7dfa73545bcac0b34df79b620cf'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:34.250874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1144/2252] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:54:33 2022] DELETE /identity/v3/users/77b0d7dfa73545bcac0b34df79b620cf => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:54:34.256070 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12acf90-b54c-4e90-9b8a-e3c132a2b14e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:34.256578 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12acf90-b54c-4e90-9b8a-e3c132a2b14e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:34.256836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12acf90-b54c-4e90-9b8a-e3c132a2b14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:34.280683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b12acf90-b54c-4e90-9b8a-e3c132a2b14e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:54:34.282248 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b12acf90-b54c-4e90-9b8a-e3c132a2b14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:34.364044 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1109/2253] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:54:34.375014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47e501-d036-47e3-942e-472b9cceace3 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:34.376816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9d47e501-d036-47e3-942e-472b9cceace3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:34.448154 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47e501-d036-47e3-942e-472b9cceace3 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:34.452174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a7d52-4521-4b90-a9c2-a6a888a2f3cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:34.452936 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a7d52-4521-4b90-a9c2-a6a888a2f3cf service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:34.453301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a7d52-4521-4b90-a9c2-a6a888a2f3cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:34.453652 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a7d52-4521-4b90-a9c2-a6a888a2f3cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:34.466669 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a7d52-4521-4b90-a9c2-a6a888a2f3cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:34.468719 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a7d52-4521-4b90-a9c2-a6a888a2f3cf service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:34.481794 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1145/2254] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:54:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:54:34.995425 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12acf90-b54c-4e90-9b8a-e3c132a2b14e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:34.997505 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b12acf90-b54c-4e90-9b8a-e3c132a2b14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:35.012302 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12acf90-b54c-4e90-9b8a-e3c132a2b14e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:35.023003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bbcf1-b1f5-4052-bb4e-e3600b9e536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:35.023878 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bbcf1-b1f5-4052-bb4e-e3600b9e536b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:35.024164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bbcf1-b1f5-4052-bb4e-e3600b9e536b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:35.024533 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bbcf1-b1f5-4052-bb4e-e3600b9e536b admin admin] PATH_INFO: `/v3/projects/ca1d96b76b744f5dbbea4de952496509` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:35.027055 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bbcf1-b1f5-4052-bb4e-e3600b9e536b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1d96b76b744f5dbbea4de952496509)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:35.029006 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bbcf1-b1f5-4052-bb4e-e3600b9e536b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:35.174586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b62bbcf1-b1f5-4052-bb4e-e3600b9e536b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1d96b76b744f5dbbea4de952496509', 'request_id': 'req-b62bbcf1-b1f5-4052-bb4e-e3600b9e536b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:35.284696 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b62bbcf1-b1f5-4052-bb4e-e3600b9e536b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1d96b76b744f5dbbea4de952496509', 'request_id': 'req-b62bbcf1-b1f5-4052-bb4e-e3600b9e536b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:35.291143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b62bbcf1-b1f5-4052-bb4e-e3600b9e536b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1d96b76b744f5dbbea4de952496509', 'request_id': 'req-b62bbcf1-b1f5-4052-bb4e-e3600b9e536b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:35.304660 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b62bbcf1-b1f5-4052-bb4e-e3600b9e536b admin admin] The token cache is being invalidate because project ca1d96b76b744f5dbbea4de952496509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:54:35.307177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b62bbcf1-b1f5-4052-bb4e-e3600b9e536b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:35.307177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b62bbcf1-b1f5-4052-bb4e-e3600b9e536b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:35.307383 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1110/2255] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:54:34 2022] DELETE /identity/v3/projects/ca1d96b76b744f5dbbea4de952496509 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:54:35.312481 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32da236-d019-4d20-a631-01890b257073 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:35.312815 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32da236-d019-4d20-a631-01890b257073 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:35.313097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32da236-d019-4d20-a631-01890b257073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:35.332224 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-c32da236-d019-4d20-a631-01890b257073 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:54:35.333503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c32da236-d019-4d20-a631-01890b257073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:35.415266 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1146/2256] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:54:35.423221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60775a3d-8951-428e-b3d8-f357cd9e57ad None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:35.423513 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60775a3d-8951-428e-b3d8-f357cd9e57ad None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:35.423830 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60775a3d-8951-428e-b3d8-f357cd9e57ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:35.442603 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-60775a3d-8951-428e-b3d8-f357cd9e57ad None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:54:35.444712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-60775a3d-8951-428e-b3d8-f357cd9e57ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:35.452554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1111/2257] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 06:54:35.456889 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32da236-d019-4d20-a631-01890b257073 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:35.467289 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32da236-d019-4d20-a631-01890b257073 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:35.472246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a68def-74b7-4450-9848-89eb516cff60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:35.472973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a68def-74b7-4450-9848-89eb516cff60 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:35.473263 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a68def-74b7-4450-9848-89eb516cff60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:35.473542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a68def-74b7-4450-9848-89eb516cff60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:35.474307 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a68def-74b7-4450-9848-89eb516cff60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 06:54:35.474620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a68def-74b7-4450-9848-89eb516cff60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:35.476320 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a68def-74b7-4450-9848-89eb516cff60 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:35.487973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1147/2258] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 06:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 06:54:35.492305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60775a3d-8951-428e-b3d8-f357cd9e57ad None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:35.501536 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60775a3d-8951-428e-b3d8-f357cd9e57ad None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:35.506925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd726f-84a6-45c4-bbc9-ea9a5e3057dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:35.507575 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd726f-84a6-45c4-bbc9-ea9a5e3057dc admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:35.507890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd726f-84a6-45c4-bbc9-ea9a5e3057dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:35.508160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd726f-84a6-45c4-bbc9-ea9a5e3057dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:35.508848 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd726f-84a6-45c4-bbc9-ea9a5e3057dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:35.511086 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd726f-84a6-45c4-bbc9-ea9a5e3057dc admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:35.601281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1112/2259] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 06:54:35 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 06:54:35.604901 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a68def-74b7-4450-9848-89eb516cff60 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:35.616891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a68def-74b7-4450-9848-89eb516cff60 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:35.683468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba4a54-1230-45d0-850d-c1bd5af7334f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:35.684521 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba4a54-1230-45d0-850d-c1bd5af7334f admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:35.684846 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba4a54-1230-45d0-850d-c1bd5af7334f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:35.685074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba4a54-1230-45d0-850d-c1bd5af7334f admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:35.685790 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba4a54-1230-45d0-850d-c1bd5af7334f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:35.687762 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba4a54-1230-45d0-850d-c1bd5af7334f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:35.782089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1148/2260] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 06:54:35 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 06:54:35.786565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd726f-84a6-45c4-bbc9-ea9a5e3057dc admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:35.830511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd726f-84a6-45c4-bbc9-ea9a5e3057dc admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:35.841394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee5f12-7192-4aa6-8e86-c23a2f500769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:35.842598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee5f12-7192-4aa6-8e86-c23a2f500769 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:35.843097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee5f12-7192-4aa6-8e86-c23a2f500769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:35.843527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee5f12-7192-4aa6-8e86-c23a2f500769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:35.844477 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee5f12-7192-4aa6-8e86-c23a2f500769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:35.846446 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee5f12-7192-4aa6-8e86-c23a2f500769 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:35.863978 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1113/2261] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:54:35.864549 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba4a54-1230-45d0-850d-c1bd5af7334f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:35.877756 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba4a54-1230-45d0-850d-c1bd5af7334f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:35.886233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891db40f-ae0f-4714-94d2-98d5066551b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:35.887541 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891db40f-ae0f-4714-94d2-98d5066551b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:35.888039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891db40f-ae0f-4714-94d2-98d5066551b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:35.890890 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891db40f-ae0f-4714-94d2-98d5066551b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:35.891939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891db40f-ae0f-4714-94d2-98d5066551b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:35.894355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891db40f-ae0f-4714-94d2-98d5066551b9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:35.912290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1149/2262] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 06:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 06:54:35.913008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee5f12-7192-4aa6-8e86-c23a2f500769 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:35.926124 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee5f12-7192-4aa6-8e86-c23a2f500769 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:35.939066 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a9037-2de3-4a73-8571-f6a0833cfae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:35.939993 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a9037-2de3-4a73-8571-f6a0833cfae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:35.940466 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a9037-2de3-4a73-8571-f6a0833cfae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:35.940898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a9037-2de3-4a73-8571-f6a0833cfae6 admin admin] PATH_INFO: `/v3/projects/ff1faa1fff1642a0b9c78bc88800cbd4/users/e392ce5fe3514e7996676d8bcd5cceb2/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:35.968442 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a9037-2de3-4a73-8571-f6a0833cfae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1faa1fff1642a0b9c78bc88800cbd4, user_id=e392ce5fe3514e7996676d8bcd5cceb2, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:35.976086 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a9037-2de3-4a73-8571-f6a0833cfae6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:36.074427 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1114/2263] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 06:54:35 2022] PUT /identity/v3/projects/ff1faa1fff1642a0b9c78bc88800cbd4/users/e392ce5fe3514e7996676d8bcd5cceb2/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 06:54:36.079975 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333a31a-b3dc-4368-bbc3-f9bcd06a53e4 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:36.082479 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333a31a-b3dc-4368-bbc3-f9bcd06a53e4 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:36.082891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333a31a-b3dc-4368-bbc3-f9bcd06a53e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:36.103608 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-9333a31a-b3dc-4368-bbc3-f9bcd06a53e4 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:54:36.104850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9333a31a-b3dc-4368-bbc3-f9bcd06a53e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:36.174625 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1150/2264] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:54:36.187584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a9037-2de3-4a73-8571-f6a0833cfae6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:36.190592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b05a9037-2de3-4a73-8571-f6a0833cfae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:36.258446 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a9037-2de3-4a73-8571-f6a0833cfae6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:36.264440 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698a86c-3266-4841-be32-9dbe235b3966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:36.265581 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698a86c-3266-4841-be32-9dbe235b3966 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:36.265916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698a86c-3266-4841-be32-9dbe235b3966 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:36.266331 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698a86c-3266-4841-be32-9dbe235b3966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:36.281322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698a86c-3266-4841-be32-9dbe235b3966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:36.283543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698a86c-3266-4841-be32-9dbe235b3966 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:36.298703 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1115/2265] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:54:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:54:38.093703 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae63b11-e3cb-4548-a3fc-743ff0a6a820 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:38.094454 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae63b11-e3cb-4548-a3fc-743ff0a6a820 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:38.099890 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae63b11-e3cb-4548-a3fc-743ff0a6a820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:38.129379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-2ae63b11-e3cb-4548-a3fc-743ff0a6a820 None None] MFA Rules not processed for user `e392ce5fe3514e7996676d8bcd5cceb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:54:38.131937 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2ae63b11-e3cb-4548-a3fc-743ff0a6a820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:38.234581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1151/2266] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:54:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:54:38.247481 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698a86c-3266-4841-be32-9dbe235b3966 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:38.251499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6698a86c-3266-4841-be32-9dbe235b3966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:38.341633 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698a86c-3266-4841-be32-9dbe235b3966 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:38.345135 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d577dff-09db-42e8-a1f9-1a7dded83cc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:38.345773 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d577dff-09db-42e8-a1f9-1a7dded83cc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:38.346051 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d577dff-09db-42e8-a1f9-1a7dded83cc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:38.346323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d577dff-09db-42e8-a1f9-1a7dded83cc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:38.355036 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d577dff-09db-42e8-a1f9-1a7dded83cc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:38.356485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d577dff-09db-42e8-a1f9-1a7dded83cc8 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:38.365811 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1116/2267] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:54:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:54:40.097588 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a203dd8-dabf-4e02-9a07-6dee3f54fe38 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:40.100107 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a203dd8-dabf-4e02-9a07-6dee3f54fe38 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:40.100641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a203dd8-dabf-4e02-9a07-6dee3f54fe38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:40.119747 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-5a203dd8-dabf-4e02-9a07-6dee3f54fe38 None None] MFA Rules not processed for user `e392ce5fe3514e7996676d8bcd5cceb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:54:40.120962 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5a203dd8-dabf-4e02-9a07-6dee3f54fe38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:40.128776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1152/2268] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:54:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:54:42.596865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d577dff-09db-42e8-a1f9-1a7dded83cc8 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:42.598336 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9d577dff-09db-42e8-a1f9-1a7dded83cc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:42.688159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d577dff-09db-42e8-a1f9-1a7dded83cc8 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:42.693363 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab782423-d6bd-4230-8367-9861f0c46477 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d2edf68b1b440097981097699bb307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:42.694011 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab782423-d6bd-4230-8367-9861f0c46477 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:42.694293 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab782423-d6bd-4230-8367-9861f0c46477 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:42.694566 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab782423-d6bd-4230-8367-9861f0c46477 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:42.696366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ab782423-d6bd-4230-8367-9861f0c46477 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:42.708014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab782423-d6bd-4230-8367-9861f0c46477 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:42.709596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab782423-d6bd-4230-8367-9861f0c46477 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:42.719508 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1117/2269] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:54:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:54:43.736655 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59269e20-f246-4ae7-a4c8-9d8204de8e48 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:43.737147 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59269e20-f246-4ae7-a4c8-9d8204de8e48 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:43.737239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59269e20-f246-4ae7-a4c8-9d8204de8e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:43.785683 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-59269e20-f246-4ae7-a4c8-9d8204de8e48 None None] MFA Rules not processed for user `7a25a3f2c9a148a1ae73e519070b190b`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:54:43.786880 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-59269e20-f246-4ae7-a4c8-9d8204de8e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:43.850507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1153/2270] 10.222.0.25 () {58 vars in 967 bytes} [Thu May 12 06:54:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:54:43.863346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab782423-d6bd-4230-8367-9861f0c46477 service placement] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:43.864745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ab782423-d6bd-4230-8367-9861f0c46477 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:43.954239 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab782423-d6bd-4230-8367-9861f0c46477 service placement] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:43.959357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0389b9-0859-40c4-a132-44195cdb0ec5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9882820f88349cb8fa2e3d457b19959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:43.960042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0389b9-0859-40c4-a132-44195cdb0ec5 service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:43.960875 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0389b9-0859-40c4-a132-44195cdb0ec5 service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:43.961152 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0389b9-0859-40c4-a132-44195cdb0ec5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:43.969851 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0389b9-0859-40c4-a132-44195cdb0ec5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:43.971441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0389b9-0859-40c4-a132-44195cdb0ec5 service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:43.980603 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1118/2271] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 12 06:54:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 06:54:45.796296 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67bdbd-dcc7-4b62-af50-bf197ab35dc8 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:45.797677 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67bdbd-dcc7-4b62-af50-bf197ab35dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:45.797677 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67bdbd-dcc7-4b62-af50-bf197ab35dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:45.816817 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-5e67bdbd-dcc7-4b62-af50-bf197ab35dc8 None None] MFA Rules not processed for user `7a25a3f2c9a148a1ae73e519070b190b`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:54:45.818303 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5e67bdbd-dcc7-4b62-af50-bf197ab35dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:45.831991 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1154/2272] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 12 06:54:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:54:45.840109 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0389b9-0859-40c4-a132-44195cdb0ec5 service swift] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:45.853028 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0389b9-0859-40c4-a132-44195cdb0ec5 service swift] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:45.861630 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e38dbf-d176-44eb-9ca2-31912cc73744 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9882820f88349cb8fa2e3d457b19959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:45.862458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e38dbf-d176-44eb-9ca2-31912cc73744 service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:45.862585 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e38dbf-d176-44eb-9ca2-31912cc73744 service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:45.862791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e38dbf-d176-44eb-9ca2-31912cc73744 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:45.872715 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e38dbf-d176-44eb-9ca2-31912cc73744 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:45.874349 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e38dbf-d176-44eb-9ca2-31912cc73744 service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:45.883567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1119/2273] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 12 06:54:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 06:54:47.436752 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67bdbd-dcc7-4b62-af50-bf197ab35dc8 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:47.439217 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5e67bdbd-dcc7-4b62-af50-bf197ab35dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:54:47.456947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67bdbd-dcc7-4b62-af50-bf197ab35dc8 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:47.461791 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef752ba-5a18-42e3-8564-4ac5d3ebf9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:47.462872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef752ba-5a18-42e3-8564-4ac5d3ebf9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:47.463312 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef752ba-5a18-42e3-8564-4ac5d3ebf9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:47.463785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef752ba-5a18-42e3-8564-4ac5d3ebf9ea admin admin] PATH_INFO: `/v3/users/d16de05b788c42b5979a20ff3b26340c` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:47.465728 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef752ba-5a18-42e3-8564-4ac5d3ebf9ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d16de05b788c42b5979a20ff3b26340c)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:47.467883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef752ba-5a18-42e3-8564-4ac5d3ebf9ea admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:47.695372 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8ef752ba-5a18-42e3-8564-4ac5d3ebf9ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd16de05b788c42b5979a20ff3b26340c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:47.696628 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8ef752ba-5a18-42e3-8564-4ac5d3ebf9ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd16de05b788c42b5979a20ff3b26340c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:47.697953 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8ef752ba-5a18-42e3-8564-4ac5d3ebf9ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd16de05b788c42b5979a20ff3b26340c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:47.713105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8ef752ba-5a18-42e3-8564-4ac5d3ebf9ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd16de05b788c42b5979a20ff3b26340c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:47.721193 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8ef752ba-5a18-42e3-8564-4ac5d3ebf9ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd16de05b788c42b5979a20ff3b26340c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:47.823834 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1155/2274] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 06:54:47 2022] DELETE /identity/v3/users/d16de05b788c42b5979a20ff3b26340c => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:54:48.069216 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e38dbf-d176-44eb-9ca2-31912cc73744 service swift] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:54:48.089062 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e38dbf-d176-44eb-9ca2-31912cc73744 service swift] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:54:48.352241 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f11bc-885f-4013-ab61-471ee5b98651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:54:48.352241 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f11bc-885f-4013-ab61-471ee5b98651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:54:48.352241 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f11bc-885f-4013-ab61-471ee5b98651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:54:48.352241 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f11bc-885f-4013-ab61-471ee5b98651 admin admin] PATH_INFO: `/v3/projects/e59759391f6e4650b3bbd3059dd3f9f7` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:54:48.353418 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f11bc-885f-4013-ab61-471ee5b98651 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e59759391f6e4650b3bbd3059dd3f9f7)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:54:48.353418 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f11bc-885f-4013-ab61-471ee5b98651 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:54:48.570095 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fe2f11bc-885f-4013-ab61-471ee5b98651 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e59759391f6e4650b3bbd3059dd3f9f7', 'request_id': 'req-fe2f11bc-885f-4013-ab61-471ee5b98651'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:48.871475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fe2f11bc-885f-4013-ab61-471ee5b98651 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e59759391f6e4650b3bbd3059dd3f9f7', 'request_id': 'req-fe2f11bc-885f-4013-ab61-471ee5b98651'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:48.877333 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fe2f11bc-885f-4013-ab61-471ee5b98651 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e59759391f6e4650b3bbd3059dd3f9f7', 'request_id': 'req-fe2f11bc-885f-4013-ab61-471ee5b98651'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:48.888972 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fe2f11bc-885f-4013-ab61-471ee5b98651 admin admin] The token cache is being invalidate because project e59759391f6e4650b3bbd3059dd3f9f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 06:54:48.889292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fe2f11bc-885f-4013-ab61-471ee5b98651 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:48.890013 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fe2f11bc-885f-4013-ab61-471ee5b98651 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 06:54:48.891596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1120/2275] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 06:54:48 2022] DELETE /identity/v3/projects/e59759391f6e4650b3bbd3059dd3f9f7 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 06:55:02.921852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b9179-0451-457a-b0d7-0883735d8271 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:55:02.922382 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b9179-0451-457a-b0d7-0883735d8271 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:55:02.922382 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b9179-0451-457a-b0d7-0883735d8271 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:55:02.923890 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1156/2276] 10.222.0.25 () {54 vars in 921 bytes} [Thu May 12 06:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:55:02.929707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf128a-44cd-4e57-938c-1a58912ce664 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:55:02.930764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf128a-44cd-4e57-938c-1a58912ce664 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:55:02.930900 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf128a-44cd-4e57-938c-1a58912ce664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:55:02.988686 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-20cf128a-44cd-4e57-938c-1a58912ce664 None None] MFA Rules not processed for user `bbcd54a927bf46f183b50fbda677868d`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:55:02.990012 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-20cf128a-44cd-4e57-938c-1a58912ce664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:55:03.065429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1121/2277] 10.222.0.25 () {58 vars in 1018 bytes} [Thu May 12 06:55:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:55:03.079579 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b9179-0451-457a-b0d7-0883735d8271 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:55:03.079579 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-957b9179-0451-457a-b0d7-0883735d8271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:55:03.157437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b9179-0451-457a-b0d7-0883735d8271 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:55:03.160947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c177d3a-9683-4360-a677-ddac67251dcf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a08d8e39f6f42bc9b93dd6d2311bcbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:55:03.161637 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c177d3a-9683-4360-a677-ddac67251dcf service glance] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:55:03.161919 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c177d3a-9683-4360-a677-ddac67251dcf service glance] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:55:03.162192 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c177d3a-9683-4360-a677-ddac67251dcf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:55:03.173335 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c177d3a-9683-4360-a677-ddac67251dcf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:55:03.174848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c177d3a-9683-4360-a677-ddac67251dcf service glance] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:55:03.186336 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1157/2278] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:55:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:55:03.418062 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ac971-a192-44b9-8413-22bd5a683d67 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:55:03.419615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ac971-a192-44b9-8413-22bd5a683d67 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:55:03.419615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ac971-a192-44b9-8413-22bd5a683d67 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:55:03.420052 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1122/2279] 10.222.0.25 () {54 vars in 921 bytes} [Thu May 12 06:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:55:03.424978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76111db-9b5c-4b1f-87e8-a441dc63ed89 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:55:03.425262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76111db-9b5c-4b1f-87e8-a441dc63ed89 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:55:03.425567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76111db-9b5c-4b1f-87e8-a441dc63ed89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:55:03.446433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f76111db-9b5c-4b1f-87e8-a441dc63ed89 None None] MFA Rules not processed for user `5a9cbec1af6545fcb34425dce87d0ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:55:03.448152 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f76111db-9b5c-4b1f-87e8-a441dc63ed89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:55:03.500320 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1158/2280] 10.222.0.25 () {58 vars in 1018 bytes} [Thu May 12 06:55:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:55:03.512232 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ac971-a192-44b9-8413-22bd5a683d67 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:55:03.514031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b97ac971-a192-44b9-8413-22bd5a683d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:55:03.528802 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ac971-a192-44b9-8413-22bd5a683d67 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:55:03.532695 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9dae1d-3160-4831-8073-592eb6971922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:55:03.533336 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dae1d-3160-4831-8073-592eb6971922 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:55:03.533617 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dae1d-3160-4831-8073-592eb6971922 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:55:03.533891 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dae1d-3160-4831-8073-592eb6971922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:55:03.541967 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9dae1d-3160-4831-8073-592eb6971922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:55:03.543878 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9dae1d-3160-4831-8073-592eb6971922 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:55:03.554445 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1123/2281] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:55:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:55:03.649162 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbf21a-678e-416f-b9d8-08a13a9abdda None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:55:03.649832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbf21a-678e-416f-b9d8-08a13a9abdda None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:55:03.650268 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbf21a-678e-416f-b9d8-08a13a9abdda None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:55:03.652284 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1159/2282] 10.222.0.25 () {54 vars in 921 bytes} [Thu May 12 06:55:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 06:55:03.658886 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978c610-c311-4c2c-b95c-dbd1f1efe358 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:55:03.659229 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978c610-c311-4c2c-b95c-dbd1f1efe358 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:55:03.659605 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978c610-c311-4c2c-b95c-dbd1f1efe358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:55:03.681998 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9978c610-c311-4c2c-b95c-dbd1f1efe358 None None] MFA Rules not processed for user `bbcd54a927bf46f183b50fbda677868d`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:55:03.683160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9978c610-c311-4c2c-b95c-dbd1f1efe358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:55:03.699056 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1124/2283] 10.222.0.25 () {58 vars in 1018 bytes} [Thu May 12 06:55:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:55:03.710051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbf21a-678e-416f-b9d8-08a13a9abdda None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:55:03.723869 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbf21a-678e-416f-b9d8-08a13a9abdda None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:55:03.727770 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf467e-fb1b-4b1e-845e-2e5ee3926f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:55:03.728411 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf467e-fb1b-4b1e-845e-2e5ee3926f56 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:55:03.728690 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf467e-fb1b-4b1e-845e-2e5ee3926f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:55:03.728962 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf467e-fb1b-4b1e-845e-2e5ee3926f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:55:03.740207 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf467e-fb1b-4b1e-845e-2e5ee3926f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:55:03.744898 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf467e-fb1b-4b1e-845e-2e5ee3926f56 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:55:03.754110 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1160/2284] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:55:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:55:09.148300 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ecddb-3fd0-4647-b849-19b9a5673312 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:55:09.148762 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ecddb-3fd0-4647-b849-19b9a5673312 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:55:09.149025 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ecddb-3fd0-4647-b849-19b9a5673312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:55:09.167405 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0d9ecddb-3fd0-4647-b849-19b9a5673312 None None] MFA Rules not processed for user `7a25a3f2c9a148a1ae73e519070b190b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:55:09.168862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0d9ecddb-3fd0-4647-b849-19b9a5673312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:55:09.224064 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1125/2285] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 12 06:55:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:55:09.235503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf467e-fb1b-4b1e-845e-2e5ee3926f56 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:55:09.237615 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fedf467e-fb1b-4b1e-845e-2e5ee3926f56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:55:09.308375 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf467e-fb1b-4b1e-845e-2e5ee3926f56 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:55:09.313267 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb52c8-00b6-4e74-9d5c-1a2e03afbbb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9882820f88349cb8fa2e3d457b19959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:55:09.313911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb52c8-00b6-4e74-9d5c-1a2e03afbbb2 service swift] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:55:09.314191 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb52c8-00b6-4e74-9d5c-1a2e03afbbb2 service swift] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:55:09.314465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb52c8-00b6-4e74-9d5c-1a2e03afbbb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:55:09.323216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb52c8-00b6-4e74-9d5c-1a2e03afbbb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:55:09.325199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb52c8-00b6-4e74-9d5c-1a2e03afbbb2 service swift] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:55:09.333975 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1161/2286] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 12 06:55:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 06:56:23.311553 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41979a-da49-4171-92c6-3f455bd37dd5 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:56:23.315865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41979a-da49-4171-92c6-3f455bd37dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:56:23.315865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41979a-da49-4171-92c6-3f455bd37dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:56:23.335383 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8a41979a-da49-4171-92c6-3f455bd37dd5 None None] MFA Rules not processed for user `7a25a3f2c9a148a1ae73e519070b190b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:56:23.338169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8a41979a-da49-4171-92c6-3f455bd37dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:56:23.353160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1126/2287] 10.222.0.25 () {58 vars in 967 bytes} [Thu May 12 06:56:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:56:23.416949 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb52c8-00b6-4e74-9d5c-1a2e03afbbb2 service swift] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:56:23.438883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb52c8-00b6-4e74-9d5c-1a2e03afbbb2 service swift] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:56:23.444633 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a73748-1d2b-4d76-b35e-fa820a1eaa1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9882820f88349cb8fa2e3d457b19959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:56:23.445299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a73748-1d2b-4d76-b35e-fa820a1eaa1a service swift] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:56:23.445621 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a73748-1d2b-4d76-b35e-fa820a1eaa1a service swift] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:56:23.445901 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a73748-1d2b-4d76-b35e-fa820a1eaa1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:56:23.456279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a73748-1d2b-4d76-b35e-fa820a1eaa1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:56:23.457890 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a73748-1d2b-4d76-b35e-fa820a1eaa1a service swift] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:56:23.467395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1162/2288] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 12 06:56:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 06:56:24.567859 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322c723-4153-45dc-9bef-16d1c0fe27a1 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:56:24.568337 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322c723-4153-45dc-9bef-16d1c0fe27a1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:56:24.568501 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322c723-4153-45dc-9bef-16d1c0fe27a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:56:24.586057 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3322c723-4153-45dc-9bef-16d1c0fe27a1 None None] MFA Rules not processed for user `13ef78da38e941b3a09f1de838581d54`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:56:24.587262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3322c723-4153-45dc-9bef-16d1c0fe27a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:56:24.644019 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1127/2289] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:56:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:56:29.085050 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2115fba-34b5-4c19-b65a-c8b2eed0fcb0 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:56:29.085605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2115fba-34b5-4c19-b65a-c8b2eed0fcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:56:29.085710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2115fba-34b5-4c19-b65a-c8b2eed0fcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:56:29.103678 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f2115fba-34b5-4c19-b65a-c8b2eed0fcb0 None None] MFA Rules not processed for user `d77bf80654c24c8c8336ce395f789ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:56:29.105025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f2115fba-34b5-4c19-b65a-c8b2eed0fcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:56:29.159663 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1163/2290] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:56:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:56:39.427942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322c723-4153-45dc-9bef-16d1c0fe27a1 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:56:39.429328 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3322c723-4153-45dc-9bef-16d1c0fe27a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:56:39.441657 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322c723-4153-45dc-9bef-16d1c0fe27a1 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:56:39.445212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1e56a-0944-42bc-9bdf-cf4db8b7f5a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:56:39.445844 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1e56a-0944-42bc-9bdf-cf4db8b7f5a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:56:39.446127 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1e56a-0944-42bc-9bdf-cf4db8b7f5a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:56:39.446400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1e56a-0944-42bc-9bdf-cf4db8b7f5a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:56:39.448775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d2f1e56a-0944-42bc-9bdf-cf4db8b7f5a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:56:39.461816 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1e56a-0944-42bc-9bdf-cf4db8b7f5a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:56:39.463232 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1e56a-0944-42bc-9bdf-cf4db8b7f5a8 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:56:39.474129 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1128/2291] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:56:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:56:41.801350 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2115fba-34b5-4c19-b65a-c8b2eed0fcb0 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:56:41.811260 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2115fba-34b5-4c19-b65a-c8b2eed0fcb0 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:56:41.814802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad21f90-82b3-4677-af61-0fd691fe57cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:56:41.815438 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad21f90-82b3-4677-af61-0fd691fe57cb service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:56:41.815741 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad21f90-82b3-4677-af61-0fd691fe57cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:56:41.816016 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad21f90-82b3-4677-af61-0fd691fe57cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:56:41.817776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9ad21f90-82b3-4677-af61-0fd691fe57cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:56:41.830820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad21f90-82b3-4677-af61-0fd691fe57cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:56:41.832276 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad21f90-82b3-4677-af61-0fd691fe57cb service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:56:41.842788 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1164/2292] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:56:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:56:53.447109 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1e56a-0944-42bc-9bdf-cf4db8b7f5a8 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:56:53.448564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d2f1e56a-0944-42bc-9bdf-cf4db8b7f5a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:56:53.502123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1e56a-0944-42bc-9bdf-cf4db8b7f5a8 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:56:53.505662 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6017f-1c99-47a0-824a-e1c9075a2fd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:56:53.506299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6017f-1c99-47a0-824a-e1c9075a2fd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:56:53.506578 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6017f-1c99-47a0-824a-e1c9075a2fd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:56:53.506848 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6017f-1c99-47a0-824a-e1c9075a2fd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:56:53.508658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9fa6017f-1c99-47a0-824a-e1c9075a2fd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:56:53.563859 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6017f-1c99-47a0-824a-e1c9075a2fd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:56:53.565286 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6017f-1c99-47a0-824a-e1c9075a2fd1 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:56:53.574013 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1129/2293] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:56:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:57:00.449468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad21f90-82b3-4677-af61-0fd691fe57cb service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:57:00.458631 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad21f90-82b3-4677-af61-0fd691fe57cb service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:57:00.462760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb54372-c3e1-4bc5-9917-67d5db6ad7dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:57:00.463413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb54372-c3e1-4bc5-9917-67d5db6ad7dd service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:57:00.463710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb54372-c3e1-4bc5-9917-67d5db6ad7dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:57:00.463992 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb54372-c3e1-4bc5-9917-67d5db6ad7dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:57:00.465737 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2bb54372-c3e1-4bc5-9917-67d5db6ad7dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:57:00.474901 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb54372-c3e1-4bc5-9917-67d5db6ad7dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:57:00.476342 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb54372-c3e1-4bc5-9917-67d5db6ad7dd service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:57:00.484790 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1165/2294] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:57:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:57:20.229075 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6017f-1c99-47a0-824a-e1c9075a2fd1 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:57:20.230563 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9fa6017f-1c99-47a0-824a-e1c9075a2fd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:57:20.246600 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6017f-1c99-47a0-824a-e1c9075a2fd1 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:57:20.251929 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a8ebb-5426-4d4d-a9e4-902a0b9b7a21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:57:20.252558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a8ebb-5426-4d4d-a9e4-902a0b9b7a21 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:57:20.252852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a8ebb-5426-4d4d-a9e4-902a0b9b7a21 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:57:20.253104 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a8ebb-5426-4d4d-a9e4-902a0b9b7a21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:57:20.254845 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9c2a8ebb-5426-4d4d-a9e4-902a0b9b7a21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:57:20.264960 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a8ebb-5426-4d4d-a9e4-902a0b9b7a21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:57:20.266509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a8ebb-5426-4d4d-a9e4-902a0b9b7a21 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:57:20.275143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1130/2295] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:57:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:58:03.779296 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb54372-c3e1-4bc5-9917-67d5db6ad7dd service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:58:03.792018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb54372-c3e1-4bc5-9917-67d5db6ad7dd service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:58:03.798199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a6ce5-642d-48fb-9b0e-93b0958b0257 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:58:03.798772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a6ce5-642d-48fb-9b0e-93b0958b0257 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:58:03.799052 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a6ce5-642d-48fb-9b0e-93b0958b0257 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:58:03.799327 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a6ce5-642d-48fb-9b0e-93b0958b0257 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:58:03.801100 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1f0a6ce5-642d-48fb-9b0e-93b0958b0257 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:58:03.856915 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a6ce5-642d-48fb-9b0e-93b0958b0257 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:58:03.858481 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a6ce5-642d-48fb-9b0e-93b0958b0257 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:58:03.867160 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1166/2296] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:58:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:58:20.777615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a8ebb-5426-4d4d-a9e4-902a0b9b7a21 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:58:20.779078 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9c2a8ebb-5426-4d4d-a9e4-902a0b9b7a21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:58:20.790681 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a8ebb-5426-4d4d-a9e4-902a0b9b7a21 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:58:20.794306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80670ddb-6aaf-47f2-bb57-5f54432ddd0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:58:20.794952 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80670ddb-6aaf-47f2-bb57-5f54432ddd0b service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:58:20.795235 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80670ddb-6aaf-47f2-bb57-5f54432ddd0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:58:20.795516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80670ddb-6aaf-47f2-bb57-5f54432ddd0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:58:20.797632 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-80670ddb-6aaf-47f2-bb57-5f54432ddd0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:58:20.808833 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80670ddb-6aaf-47f2-bb57-5f54432ddd0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:58:20.810258 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80670ddb-6aaf-47f2-bb57-5f54432ddd0b service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:58:20.820553 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1131/2297] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:58:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:58:22.978041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a6ce5-642d-48fb-9b0e-93b0958b0257 service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:58:22.979463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1f0a6ce5-642d-48fb-9b0e-93b0958b0257 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:58:22.996926 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a6ce5-642d-48fb-9b0e-93b0958b0257 service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:58:23.003379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb2180-b034-472e-a1c0-1c64da88c247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:58:23.004192 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb2180-b034-472e-a1c0-1c64da88c247 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:58:23.004499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb2180-b034-472e-a1c0-1c64da88c247 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:58:23.004778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb2180-b034-472e-a1c0-1c64da88c247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:58:23.006627 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-babb2180-b034-472e-a1c0-1c64da88c247 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:58:23.024621 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb2180-b034-472e-a1c0-1c64da88c247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:58:23.026329 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb2180-b034-472e-a1c0-1c64da88c247 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:58:23.038169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1167/2298] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:58:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:58:27.549457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a3dbe-7e85-46b0-b937-3896ca1f34fe None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:58:27.549943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a3dbe-7e85-46b0-b937-3896ca1f34fe None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:58:27.551150 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a3dbe-7e85-46b0-b937-3896ca1f34fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:58:27.566895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-409a3dbe-7e85-46b0-b937-3896ca1f34fe None None] MFA Rules not processed for user `d77bf80654c24c8c8336ce395f789ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 06:58:27.568128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-409a3dbe-7e85-46b0-b937-3896ca1f34fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:58:27.575021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1132/2299] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 06:58:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 06:58:27.869986 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb2180-b034-472e-a1c0-1c64da88c247 service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:58:27.879149 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb2180-b034-472e-a1c0-1c64da88c247 service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:58:27.882667 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecead5-6c62-46ed-b04a-fc42e48e70c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:58:27.883293 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecead5-6c62-46ed-b04a-fc42e48e70c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:58:27.883575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecead5-6c62-46ed-b04a-fc42e48e70c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:58:27.883887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecead5-6c62-46ed-b04a-fc42e48e70c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:58:27.885751 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-62ecead5-6c62-46ed-b04a-fc42e48e70c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:58:27.895669 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecead5-6c62-46ed-b04a-fc42e48e70c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:58:27.897098 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecead5-6c62-46ed-b04a-fc42e48e70c3 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:58:27.909304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1168/2300] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:58:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:58:28.307498 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a3dbe-7e85-46b0-b937-3896ca1f34fe None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:58:28.308911 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-409a3dbe-7e85-46b0-b937-3896ca1f34fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:58:28.385288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a3dbe-7e85-46b0-b937-3896ca1f34fe None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:58:28.391765 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb3b72-f8d8-442b-87e8-89fb15de95bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d2edf68b1b440097981097699bb307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:58:28.392684 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb3b72-f8d8-442b-87e8-89fb15de95bd service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:58:28.393131 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb3b72-f8d8-442b-87e8-89fb15de95bd service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:58:28.393553 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb3b72-f8d8-442b-87e8-89fb15de95bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:58:28.395635 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-61cb3b72-f8d8-442b-87e8-89fb15de95bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:58:28.413523 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb3b72-f8d8-442b-87e8-89fb15de95bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:58:28.415419 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb3b72-f8d8-442b-87e8-89fb15de95bd service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:58:28.429125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1133/2301] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:58:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:58:32.952468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecead5-6c62-46ed-b04a-fc42e48e70c3 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:58:32.965473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecead5-6c62-46ed-b04a-fc42e48e70c3 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:58:32.971412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b249868-6159-4da3-abd6-389fad0bbb47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:58:32.972081 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b249868-6159-4da3-abd6-389fad0bbb47 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:58:32.972363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b249868-6159-4da3-abd6-389fad0bbb47 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:58:32.972632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b249868-6159-4da3-abd6-389fad0bbb47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:58:32.974385 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1b249868-6159-4da3-abd6-389fad0bbb47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:58:33.030659 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b249868-6159-4da3-abd6-389fad0bbb47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:58:33.032274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b249868-6159-4da3-abd6-389fad0bbb47 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:58:33.041038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1169/2302] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:58:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:58:36.792484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb3b72-f8d8-442b-87e8-89fb15de95bd service placement] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:58:36.804960 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb3b72-f8d8-442b-87e8-89fb15de95bd service placement] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:58:36.810305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60c0ab-c8bc-4db8-a0ff-d6d80b479735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:58:36.811572 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60c0ab-c8bc-4db8-a0ff-d6d80b479735 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:58:36.811881 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60c0ab-c8bc-4db8-a0ff-d6d80b479735 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:58:36.812155 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60c0ab-c8bc-4db8-a0ff-d6d80b479735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:58:36.813938 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3f60c0ab-c8bc-4db8-a0ff-d6d80b479735 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:58:36.826724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60c0ab-c8bc-4db8-a0ff-d6d80b479735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:58:36.828467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60c0ab-c8bc-4db8-a0ff-d6d80b479735 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:58:36.839052 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1134/2303] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:58:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:58:40.783671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b249868-6159-4da3-abd6-389fad0bbb47 service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:58:40.794637 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b249868-6159-4da3-abd6-389fad0bbb47 service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:58:40.800894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883f935-1d32-49c7-bc03-d31a4e883765 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:58:40.801520 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883f935-1d32-49c7-bc03-d31a4e883765 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:58:40.801800 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883f935-1d32-49c7-bc03-d31a4e883765 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:58:40.802070 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883f935-1d32-49c7-bc03-d31a4e883765 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:58:40.803857 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4883f935-1d32-49c7-bc03-d31a4e883765 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:58:40.816594 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883f935-1d32-49c7-bc03-d31a4e883765 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:58:40.818200 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883f935-1d32-49c7-bc03-d31a4e883765 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:58:40.828965 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1170/2304] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:58:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 06:59:50.727158 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60c0ab-c8bc-4db8-a0ff-d6d80b479735 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 06:59:50.728818 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3f60c0ab-c8bc-4db8-a0ff-d6d80b479735 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:59:50.743124 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60c0ab-c8bc-4db8-a0ff-d6d80b479735 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 06:59:50.748129 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac871b7d-1f68-4a6e-839a-02f4cc4e55b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d2edf68b1b440097981097699bb307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 06:59:50.748766 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac871b7d-1f68-4a6e-839a-02f4cc4e55b0 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 06:59:50.749046 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac871b7d-1f68-4a6e-839a-02f4cc4e55b0 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 06:59:50.749316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac871b7d-1f68-4a6e-839a-02f4cc4e55b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 06:59:50.751045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ac871b7d-1f68-4a6e-839a-02f4cc4e55b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 06:59:50.762005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac871b7d-1f68-4a6e-839a-02f4cc4e55b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 06:59:50.763564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac871b7d-1f68-4a6e-839a-02f4cc4e55b0 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 06:59:50.773213 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1135/2305] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 06:59:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:00:21.757581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883f935-1d32-49c7-bc03-d31a4e883765 service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:00:21.767228 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883f935-1d32-49c7-bc03-d31a4e883765 service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:00:21.770802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94154ff9-f752-4c20-a6b3-c89f3a8a70d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:00:21.771502 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94154ff9-f752-4c20-a6b3-c89f3a8a70d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:00:21.771804 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94154ff9-f752-4c20-a6b3-c89f3a8a70d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:00:21.772080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94154ff9-f752-4c20-a6b3-c89f3a8a70d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:00:21.773794 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-94154ff9-f752-4c20-a6b3-c89f3a8a70d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:00:21.833577 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94154ff9-f752-4c20-a6b3-c89f3a8a70d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:00:21.835121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94154ff9-f752-4c20-a6b3-c89f3a8a70d1 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:00:21.844661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1171/2306] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:00:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:02:22.481299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac871b7d-1f68-4a6e-839a-02f4cc4e55b0 service placement] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:22.491268 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac871b7d-1f68-4a6e-839a-02f4cc4e55b0 service placement] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:22.495008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd748fa6-f080-4715-906b-8c5f30e01a42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:22.495644 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd748fa6-f080-4715-906b-8c5f30e01a42 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:22.495967 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd748fa6-f080-4715-906b-8c5f30e01a42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:22.496247 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd748fa6-f080-4715-906b-8c5f30e01a42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:22.506434 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd748fa6-f080-4715-906b-8c5f30e01a42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:22.507888 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd748fa6-f080-4715-906b-8c5f30e01a42 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:22.518522 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1136/2307] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:02:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:02:22.558530 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94154ff9-f752-4c20-a6b3-c89f3a8a70d1 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:22.569668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94154ff9-f752-4c20-a6b3-c89f3a8a70d1 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:22.571344 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09bec1-fd5f-4253-a2ed-a91e00cead4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:22.572029 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09bec1-fd5f-4253-a2ed-a91e00cead4b service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:22.572317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09bec1-fd5f-4253-a2ed-a91e00cead4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:22.572693 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09bec1-fd5f-4253-a2ed-a91e00cead4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:22.581477 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09bec1-fd5f-4253-a2ed-a91e00cead4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:22.582881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09bec1-fd5f-4253-a2ed-a91e00cead4b service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:22.610613 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1172/2308] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:02:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:02:22.677132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd748fa6-f080-4715-906b-8c5f30e01a42 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:22.685736 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd748fa6-f080-4715-906b-8c5f30e01a42 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:22.689538 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d746cb-f010-43c3-87fb-5cc2a51af77f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:22.690174 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d746cb-f010-43c3-87fb-5cc2a51af77f service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:22.690453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d746cb-f010-43c3-87fb-5cc2a51af77f service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:22.690724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d746cb-f010-43c3-87fb-5cc2a51af77f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:22.699584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d746cb-f010-43c3-87fb-5cc2a51af77f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:22.701061 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d746cb-f010-43c3-87fb-5cc2a51af77f service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:22.729006 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1137/2309] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:02:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:02:23.030335 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09bec1-fd5f-4253-a2ed-a91e00cead4b service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:23.039286 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09bec1-fd5f-4253-a2ed-a91e00cead4b service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:23.043218 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ae5b5-b493-4bff-82e0-00f41a02c76e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:23.044789 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ae5b5-b493-4bff-82e0-00f41a02c76e service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:23.044789 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ae5b5-b493-4bff-82e0-00f41a02c76e service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:23.044789 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ae5b5-b493-4bff-82e0-00f41a02c76e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:23.055822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ae5b5-b493-4bff-82e0-00f41a02c76e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:23.057297 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ae5b5-b493-4bff-82e0-00f41a02c76e service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:23.067802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1173/2310] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:02:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:02:50.434268 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d746cb-f010-43c3-87fb-5cc2a51af77f service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:02:50.444095 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d746cb-f010-43c3-87fb-5cc2a51af77f service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:02:50.447661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9fef2-fba0-4070-ba7f-7f527fc37c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:02:50.448322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9fef2-fba0-4070-ba7f-7f527fc37c83 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:02:50.448603 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9fef2-fba0-4070-ba7f-7f527fc37c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:02:50.448878 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9fef2-fba0-4070-ba7f-7f527fc37c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:02:50.455891 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9fef2-fba0-4070-ba7f-7f527fc37c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:02:50.457305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9fef2-fba0-4070-ba7f-7f527fc37c83 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:02:50.464992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1138/2311] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:02:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:04:23.232434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ae5b5-b493-4bff-82e0-00f41a02c76e service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:04:23.250177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ae5b5-b493-4bff-82e0-00f41a02c76e service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:04:23.254244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b46bde-1a92-4112-81d7-43d061639f23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:04:23.254872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b46bde-1a92-4112-81d7-43d061639f23 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:04:23.255152 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b46bde-1a92-4112-81d7-43d061639f23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:04:23.255420 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b46bde-1a92-4112-81d7-43d061639f23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:04:23.276761 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b46bde-1a92-4112-81d7-43d061639f23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:04:23.278166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b46bde-1a92-4112-81d7-43d061639f23 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:04:23.303996 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1174/2312] 10.222.0.25 () {60 vars in 1396 bytes} [Thu May 12 07:04:23 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3260 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:04:23.396651 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9fef2-fba0-4070-ba7f-7f527fc37c83 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:04:23.427507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9fef2-fba0-4070-ba7f-7f527fc37c83 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:04:23.433256 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c2c8f-48fa-45f7-b89e-a3064e9d2962 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:04:23.433902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c2c8f-48fa-45f7-b89e-a3064e9d2962 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:04:23.434179 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c2c8f-48fa-45f7-b89e-a3064e9d2962 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:04:23.434464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c2c8f-48fa-45f7-b89e-a3064e9d2962 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:04:23.442936 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c2c8f-48fa-45f7-b89e-a3064e9d2962 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:04:23.444552 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c2c8f-48fa-45f7-b89e-a3064e9d2962 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:04:23.458265 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b46bde-1a92-4112-81d7-43d061639f23 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:04:23.467079 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b46bde-1a92-4112-81d7-43d061639f23 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:04:23.470765 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614394a2-c618-4126-9924-2fd74e5802a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:04:23.471402 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614394a2-c618-4126-9924-2fd74e5802a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:04:23.471677 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614394a2-c618-4126-9924-2fd74e5802a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:04:23.471984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614394a2-c618-4126-9924-2fd74e5802a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:04:23.477162 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1139/2313] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:04:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:04:23.481856 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614394a2-c618-4126-9924-2fd74e5802a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:04:23.483479 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614394a2-c618-4126-9924-2fd74e5802a8 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:04:23.512116 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1175/2314] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:04:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:04:23.831226 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c2c8f-48fa-45f7-b89e-a3064e9d2962 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:04:23.842155 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c2c8f-48fa-45f7-b89e-a3064e9d2962 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:04:23.851611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568409a-ca59-43de-9f3b-d51f7d421ec2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:04:23.855597 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568409a-ca59-43de-9f3b-d51f7d421ec2 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:04:23.855597 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568409a-ca59-43de-9f3b-d51f7d421ec2 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:04:23.855597 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568409a-ca59-43de-9f3b-d51f7d421ec2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:04:23.861643 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568409a-ca59-43de-9f3b-d51f7d421ec2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:04:23.863994 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568409a-ca59-43de-9f3b-d51f7d421ec2 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:04:23.874738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1140/2315] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:04:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:04:54.729681 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614394a2-c618-4126-9924-2fd74e5802a8 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:04:54.758713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614394a2-c618-4126-9924-2fd74e5802a8 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:04:54.763708 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ccec9-14f7-4a07-a2d8-8c8140939355 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d2edf68b1b440097981097699bb307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:04:54.764366 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ccec9-14f7-4a07-a2d8-8c8140939355 service placement] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:04:54.764701 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ccec9-14f7-4a07-a2d8-8c8140939355 service placement] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:04:54.765613 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ccec9-14f7-4a07-a2d8-8c8140939355 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:04:54.773975 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ccec9-14f7-4a07-a2d8-8c8140939355 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:04:54.775587 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ccec9-14f7-4a07-a2d8-8c8140939355 service placement] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:04:54.785232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1176/2316] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:04:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:06:23.624149 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568409a-ca59-43de-9f3b-d51f7d421ec2 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:06:23.639222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568409a-ca59-43de-9f3b-d51f7d421ec2 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:06:23.642973 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccebc6-8313-456d-a315-4dea306d48eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:06:23.643620 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccebc6-8313-456d-a315-4dea306d48eb service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:06:23.643922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccebc6-8313-456d-a315-4dea306d48eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:06:23.644193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccebc6-8313-456d-a315-4dea306d48eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:06:23.653049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccebc6-8313-456d-a315-4dea306d48eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:06:23.654484 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccebc6-8313-456d-a315-4dea306d48eb service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:06:23.682067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1141/2317] 10.222.0.25 () {60 vars in 1396 bytes} [Thu May 12 07:06:23 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:07:04.547729 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ccec9-14f7-4a07-a2d8-8c8140939355 service placement] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:04.645108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ccec9-14f7-4a07-a2d8-8c8140939355 service placement] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:04.650793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566322c6-364a-4fd0-bd9d-673e9d771128 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:04.651449 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566322c6-364a-4fd0-bd9d-673e9d771128 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:04.651761 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566322c6-364a-4fd0-bd9d-673e9d771128 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:04.652036 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566322c6-364a-4fd0-bd9d-673e9d771128 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:04.661328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566322c6-364a-4fd0-bd9d-673e9d771128 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:04.662912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566322c6-364a-4fd0-bd9d-673e9d771128 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:04.674601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1177/2318] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:07:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:07:22.817111 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccebc6-8313-456d-a315-4dea306d48eb service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:22.818709 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b1ccebc6-8313-456d-a315-4dea306d48eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:22.902676 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccebc6-8313-456d-a315-4dea306d48eb service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:22.906398 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0acb9c-be78-495a-a48d-18593f0123c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:22.907038 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0acb9c-be78-495a-a48d-18593f0123c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:22.907327 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0acb9c-be78-495a-a48d-18593f0123c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:22.907602 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0acb9c-be78-495a-a48d-18593f0123c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:22.909503 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1d0acb9c-be78-495a-a48d-18593f0123c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:22.935606 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0acb9c-be78-495a-a48d-18593f0123c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:22.935864 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566322c6-364a-4fd0-bd9d-673e9d771128 service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:22.937075 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0acb9c-be78-495a-a48d-18593f0123c9 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:22.947334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566322c6-364a-4fd0-bd9d-673e9d771128 service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:22.949004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1142/2319] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:07:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:07:22.953099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9abb6e-ead0-4774-8dac-5ac6f4e9c10b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:22.953747 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9abb6e-ead0-4774-8dac-5ac6f4e9c10b service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:22.954031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9abb6e-ead0-4774-8dac-5ac6f4e9c10b service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:22.954308 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9abb6e-ead0-4774-8dac-5ac6f4e9c10b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:22.956246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0f9abb6e-ead0-4774-8dac-5ac6f4e9c10b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:23.030221 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9abb6e-ead0-4774-8dac-5ac6f4e9c10b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:23.031746 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9abb6e-ead0-4774-8dac-5ac6f4e9c10b service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:23.040514 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1178/2320] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:07:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:07:24.051539 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0acb9c-be78-495a-a48d-18593f0123c9 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:24.060495 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0acb9c-be78-495a-a48d-18593f0123c9 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:24.064080 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18953fff-0a27-4102-978e-9abb3dbf93be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:24.064708 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18953fff-0a27-4102-978e-9abb3dbf93be service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:24.064986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18953fff-0a27-4102-978e-9abb3dbf93be service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:24.065255 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18953fff-0a27-4102-978e-9abb3dbf93be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:24.067170 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-18953fff-0a27-4102-978e-9abb3dbf93be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:24.080616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18953fff-0a27-4102-978e-9abb3dbf93be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:24.082017 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18953fff-0a27-4102-978e-9abb3dbf93be service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:24.092857 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1143/2321] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:07:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:07:57.403026 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9abb6e-ead0-4774-8dac-5ac6f4e9c10b service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:07:57.404759 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0f9abb6e-ead0-4774-8dac-5ac6f4e9c10b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:57.416211 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9abb6e-ead0-4774-8dac-5ac6f4e9c10b service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:07:57.419876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59db933-78b7-4e7e-b650-14981499d988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:07:57.420523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59db933-78b7-4e7e-b650-14981499d988 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:07:57.420804 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59db933-78b7-4e7e-b650-14981499d988 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:07:57.421075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59db933-78b7-4e7e-b650-14981499d988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:07:57.422932 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c59db933-78b7-4e7e-b650-14981499d988 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:07:57.432919 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59db933-78b7-4e7e-b650-14981499d988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:07:57.434314 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59db933-78b7-4e7e-b650-14981499d988 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:07:57.442222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1179/2322] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:07:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:24.302956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18953fff-0a27-4102-978e-9abb3dbf93be service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:24.304529 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-18953fff-0a27-4102-978e-9abb3dbf93be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:24.372370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18953fff-0a27-4102-978e-9abb3dbf93be service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:24.375950 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361f510-5b1e-4b39-880b-5d5aa3699af4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:24.376584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361f510-5b1e-4b39-880b-5d5aa3699af4 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:24.376860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361f510-5b1e-4b39-880b-5d5aa3699af4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:24.377128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361f510-5b1e-4b39-880b-5d5aa3699af4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:24.378952 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b361f510-5b1e-4b39-880b-5d5aa3699af4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:24.447408 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361f510-5b1e-4b39-880b-5d5aa3699af4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:24.448828 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361f510-5b1e-4b39-880b-5d5aa3699af4 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:24.457848 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1144/2323] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:08:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:08:24.691449 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59db933-78b7-4e7e-b650-14981499d988 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:24.700952 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59db933-78b7-4e7e-b650-14981499d988 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:24.704762 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396620a-1f6b-45ab-93cf-06830f202e44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:24.708609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396620a-1f6b-45ab-93cf-06830f202e44 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:24.708609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396620a-1f6b-45ab-93cf-06830f202e44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:24.708609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396620a-1f6b-45ab-93cf-06830f202e44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:24.708609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6396620a-1f6b-45ab-93cf-06830f202e44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:24.789545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396620a-1f6b-45ab-93cf-06830f202e44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:24.791481 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396620a-1f6b-45ab-93cf-06830f202e44 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:24.810646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1180/2324] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:08:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:08:28.610894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361f510-5b1e-4b39-880b-5d5aa3699af4 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:28.612351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b361f510-5b1e-4b39-880b-5d5aa3699af4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:28.626106 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361f510-5b1e-4b39-880b-5d5aa3699af4 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:28.630768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24909383-36ef-4800-ad4e-4ec9809b178e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:28.631627 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24909383-36ef-4800-ad4e-4ec9809b178e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:28.631951 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24909383-36ef-4800-ad4e-4ec9809b178e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:28.632226 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24909383-36ef-4800-ad4e-4ec9809b178e admin admin] PATH_INFO: `/v3/users/d77bf80654c24c8c8336ce395f789ccb` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:28.633449 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24909383-36ef-4800-ad4e-4ec9809b178e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d77bf80654c24c8c8336ce395f789ccb)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:28.636012 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24909383-36ef-4800-ad4e-4ec9809b178e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:28.794989 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-24909383-36ef-4800-ad4e-4ec9809b178e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd77bf80654c24c8c8336ce395f789ccb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:08:28.795633 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-24909383-36ef-4800-ad4e-4ec9809b178e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd77bf80654c24c8c8336ce395f789ccb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:08:28.808227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-24909383-36ef-4800-ad4e-4ec9809b178e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd77bf80654c24c8c8336ce395f789ccb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:08:28.808889 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-24909383-36ef-4800-ad4e-4ec9809b178e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd77bf80654c24c8c8336ce395f789ccb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:08:28.815898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-24909383-36ef-4800-ad4e-4ec9809b178e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd77bf80654c24c8c8336ce395f789ccb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:08:28.894846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1145/2325] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:08:28 2022] DELETE /identity/v3/users/d77bf80654c24c8c8336ce395f789ccb => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:08:29.142636 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396620a-1f6b-45ab-93cf-06830f202e44 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:29.153039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396620a-1f6b-45ab-93cf-06830f202e44 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:29.208879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d0d67-0810-4992-853c-a01833d2a1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:29.209661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d0d67-0810-4992-853c-a01833d2a1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:29.209942 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d0d67-0810-4992-853c-a01833d2a1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:29.210213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d0d67-0810-4992-853c-a01833d2a1f4 admin admin] PATH_INFO: `/v3/projects/6ef9efe106ae4485a4d137377f1890e3` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:29.211429 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d0d67-0810-4992-853c-a01833d2a1f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef9efe106ae4485a4d137377f1890e3)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:29.214296 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d0d67-0810-4992-853c-a01833d2a1f4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:29.324189 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-dc2d0d67-0810-4992-853c-a01833d2a1f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef9efe106ae4485a4d137377f1890e3', 'request_id': 'req-dc2d0d67-0810-4992-853c-a01833d2a1f4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:08:29.386781 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-dc2d0d67-0810-4992-853c-a01833d2a1f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef9efe106ae4485a4d137377f1890e3', 'request_id': 'req-dc2d0d67-0810-4992-853c-a01833d2a1f4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:08:29.393007 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-dc2d0d67-0810-4992-853c-a01833d2a1f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef9efe106ae4485a4d137377f1890e3', 'request_id': 'req-dc2d0d67-0810-4992-853c-a01833d2a1f4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:08:29.404510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-dc2d0d67-0810-4992-853c-a01833d2a1f4 admin admin] The token cache is being invalidate because project 6ef9efe106ae4485a4d137377f1890e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:08:29.404796 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-dc2d0d67-0810-4992-853c-a01833d2a1f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:08:29.405448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-dc2d0d67-0810-4992-853c-a01833d2a1f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:08:29.407008 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1181/2326] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:08:29 2022] DELETE /identity/v3/projects/6ef9efe106ae4485a4d137377f1890e3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:08:29.413010 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc4e7e-54bc-4812-a13e-e847bb1d21d0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:29.413300 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc4e7e-54bc-4812-a13e-e847bb1d21d0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:29.413574 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc4e7e-54bc-4812-a13e-e847bb1d21d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:29.470481 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-bbfc4e7e-54bc-4812-a13e-e847bb1d21d0 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:29.471593 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bbfc4e7e-54bc-4812-a13e-e847bb1d21d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:29.526790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1146/2327] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:29.534523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf3ed3-697f-456a-92fb-be878469829b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:29.534818 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf3ed3-697f-456a-92fb-be878469829b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:29.535099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf3ed3-697f-456a-92fb-be878469829b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:29.553281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-7cbf3ed3-697f-456a-92fb-be878469829b None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:29.554508 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7cbf3ed3-697f-456a-92fb-be878469829b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:29.562368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1182/2328] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:29.566274 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc4e7e-54bc-4812-a13e-e847bb1d21d0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:29.576119 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc4e7e-54bc-4812-a13e-e847bb1d21d0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:29.580855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca4452-7823-4480-93e3-a63fca8e5e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:29.581512 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca4452-7823-4480-93e3-a63fca8e5e8d admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:29.581797 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca4452-7823-4480-93e3-a63fca8e5e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:29.582073 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca4452-7823-4480-93e3-a63fca8e5e8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:29.582826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca4452-7823-4480-93e3-a63fca8e5e8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:08:29.583136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca4452-7823-4480-93e3-a63fca8e5e8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:29.584761 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca4452-7823-4480-93e3-a63fca8e5e8d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:29.596641 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1147/2329] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:08:29.600681 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf3ed3-697f-456a-92fb-be878469829b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:29.609689 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf3ed3-697f-456a-92fb-be878469829b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:29.614337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ae86f-9c18-4945-ad8a-63fbace258b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:29.614973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ae86f-9c18-4945-ad8a-63fbace258b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:29.615256 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ae86f-9c18-4945-ad8a-63fbace258b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:29.615531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ae86f-9c18-4945-ad8a-63fbace258b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:29.616263 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ae86f-9c18-4945-ad8a-63fbace258b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:29.618183 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ae86f-9c18-4945-ad8a-63fbace258b5 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:29.766774 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1183/2330] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:08:29 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:08:29.770775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca4452-7823-4480-93e3-a63fca8e5e8d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:29.780933 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca4452-7823-4480-93e3-a63fca8e5e8d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:29.836056 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7784d-3043-48ad-8dc7-98e357b634d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:29.836744 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7784d-3043-48ad-8dc7-98e357b634d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:29.837031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7784d-3043-48ad-8dc7-98e357b634d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:29.837306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7784d-3043-48ad-8dc7-98e357b634d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:29.837997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7784d-3043-48ad-8dc7-98e357b634d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:29.839937 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7784d-3043-48ad-8dc7-98e357b634d2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:29.935900 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1148/2331] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:08:29 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:08:29.940050 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ae86f-9c18-4945-ad8a-63fbace258b5 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:29.950940 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ae86f-9c18-4945-ad8a-63fbace258b5 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:29.955551 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79af2c-f527-446e-b0d9-6c80efe2a15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:29.956233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79af2c-f527-446e-b0d9-6c80efe2a15c admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:29.956518 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79af2c-f527-446e-b0d9-6c80efe2a15c admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:29.956789 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79af2c-f527-446e-b0d9-6c80efe2a15c admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:29.957516 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79af2c-f527-446e-b0d9-6c80efe2a15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:29.959090 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79af2c-f527-446e-b0d9-6c80efe2a15c admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:29.969063 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1184/2332] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:08:29.973070 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7784d-3043-48ad-8dc7-98e357b634d2 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:29.983041 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7784d-3043-48ad-8dc7-98e357b634d2 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:29.991902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289f084-6c29-4646-98fc-202669f4e353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:29.992585 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289f084-6c29-4646-98fc-202669f4e353 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:29.992871 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289f084-6c29-4646-98fc-202669f4e353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:29.993652 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289f084-6c29-4646-98fc-202669f4e353 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:29.994513 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289f084-6c29-4646-98fc-202669f4e353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:29.996017 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289f084-6c29-4646-98fc-202669f4e353 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:30.006292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1149/2333] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:08:30.011291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79af2c-f527-446e-b0d9-6c80efe2a15c admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:30.020887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79af2c-f527-446e-b0d9-6c80efe2a15c admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:30.025441 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5288ccf-6b4b-48e5-9927-80d346d5dd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:30.026302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5288ccf-6b4b-48e5-9927-80d346d5dd48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:30.026580 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5288ccf-6b4b-48e5-9927-80d346d5dd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:30.026849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5288ccf-6b4b-48e5-9927-80d346d5dd48 admin admin] PATH_INFO: `/v3/projects/f9476936375340cc83196d007bb93572/users/ed40b444219a4e028f28b2cf36ba28ee/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:30.042599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5288ccf-6b4b-48e5-9927-80d346d5dd48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9476936375340cc83196d007bb93572, user_id=ed40b444219a4e028f28b2cf36ba28ee, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:30.044123 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5288ccf-6b4b-48e5-9927-80d346d5dd48 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:30.129353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1185/2334] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:08:30 2022] PUT /identity/v3/projects/f9476936375340cc83196d007bb93572/users/ed40b444219a4e028f28b2cf36ba28ee/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:08:30.140045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d034f61-f957-487c-b332-3e0c197e68db None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:30.140339 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d034f61-f957-487c-b332-3e0c197e68db None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:30.140618 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d034f61-f957-487c-b332-3e0c197e68db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:30.166870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7d034f61-f957-487c-b332-3e0c197e68db None None] MFA Rules not processed for user `ed40b444219a4e028f28b2cf36ba28ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:08:30.168107 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7d034f61-f957-487c-b332-3e0c197e68db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:30.232606 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1150/2335] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:08:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:08:30.244279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5288ccf-6b4b-48e5-9927-80d346d5dd48 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:08:30.246000 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b5288ccf-6b4b-48e5-9927-80d346d5dd48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:08:30.316316 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5288ccf-6b4b-48e5-9927-80d346d5dd48 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:08:30.326241 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b4e56-6291-4190-ba16-123c3bd02eda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:08:30.326879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b4e56-6291-4190-ba16-123c3bd02eda service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:08:30.327155 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b4e56-6291-4190-ba16-123c3bd02eda service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:08:30.327423 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b4e56-6291-4190-ba16-123c3bd02eda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:08:30.334862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b4e56-6291-4190-ba16-123c3bd02eda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:08:30.336459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b4e56-6291-4190-ba16-123c3bd02eda service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:08:30.345585 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1186/2336] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:08:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:09:23.394590 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d034f61-f957-487c-b332-3e0c197e68db None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:23.396175 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7d034f61-f957-487c-b332-3e0c197e68db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:09:23.411349 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d034f61-f957-487c-b332-3e0c197e68db None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:23.416691 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd2bb1-d2eb-43ea-a612-9eef22785349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:23.417321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd2bb1-d2eb-43ea-a612-9eef22785349 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:23.417600 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd2bb1-d2eb-43ea-a612-9eef22785349 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:23.417868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd2bb1-d2eb-43ea-a612-9eef22785349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:23.420125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-98cd2bb1-d2eb-43ea-a612-9eef22785349 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:09:23.486435 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd2bb1-d2eb-43ea-a612-9eef22785349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:23.488039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd2bb1-d2eb-43ea-a612-9eef22785349 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:23.496773 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1151/2337] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:09:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:09:24.407008 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b4e56-6291-4190-ba16-123c3bd02eda service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:24.417805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b4e56-6291-4190-ba16-123c3bd02eda service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:24.424113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcb4b8-869b-4b13-9dd4-4f8bfd21647b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:24.424741 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcb4b8-869b-4b13-9dd4-4f8bfd21647b service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:24.425021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcb4b8-869b-4b13-9dd4-4f8bfd21647b service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:24.425292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcb4b8-869b-4b13-9dd4-4f8bfd21647b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:24.427038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-52fcb4b8-869b-4b13-9dd4-4f8bfd21647b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:09:24.493565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcb4b8-869b-4b13-9dd4-4f8bfd21647b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:24.495123 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcb4b8-869b-4b13-9dd4-4f8bfd21647b service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:24.504166 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1187/2338] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:09:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:09:30.307200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd2bb1-d2eb-43ea-a612-9eef22785349 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:30.367119 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd2bb1-d2eb-43ea-a612-9eef22785349 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:30.371560 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d69b3-6784-4343-a6e7-45067eaa9cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:30.372940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d69b3-6784-4343-a6e7-45067eaa9cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:30.373221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d69b3-6784-4343-a6e7-45067eaa9cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:30.373490 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d69b3-6784-4343-a6e7-45067eaa9cb1 admin admin] PATH_INFO: `/v3/users/ed40b444219a4e028f28b2cf36ba28ee` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:30.374670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d69b3-6784-4343-a6e7-45067eaa9cb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed40b444219a4e028f28b2cf36ba28ee)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:30.376625 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d69b3-6784-4343-a6e7-45067eaa9cb1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:30.592196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-595d69b3-6784-4343-a6e7-45067eaa9cb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed40b444219a4e028f28b2cf36ba28ee'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:09:30.592772 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-595d69b3-6784-4343-a6e7-45067eaa9cb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed40b444219a4e028f28b2cf36ba28ee'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:09:30.604177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-595d69b3-6784-4343-a6e7-45067eaa9cb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed40b444219a4e028f28b2cf36ba28ee'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:09:30.604793 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-595d69b3-6784-4343-a6e7-45067eaa9cb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed40b444219a4e028f28b2cf36ba28ee'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:09:30.611820 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-595d69b3-6784-4343-a6e7-45067eaa9cb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed40b444219a4e028f28b2cf36ba28ee'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:09:30.687767 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1152/2339] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:09:30 2022] DELETE /identity/v3/users/ed40b444219a4e028f28b2cf36ba28ee => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:09:30.692439 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69997a4-3416-4f33-a5b1-8fd2bfed57e8 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:30.693338 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69997a4-3416-4f33-a5b1-8fd2bfed57e8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:30.693338 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69997a4-3416-4f33-a5b1-8fd2bfed57e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:30.709232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f69997a4-3416-4f33-a5b1-8fd2bfed57e8 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:09:30.710442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f69997a4-3416-4f33-a5b1-8fd2bfed57e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:09:30.766698 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1188/2340] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:09:30.776284 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d69b3-6784-4343-a6e7-45067eaa9cb1 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:30.777688 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-595d69b3-6784-4343-a6e7-45067eaa9cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:09:30.833931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d69b3-6784-4343-a6e7-45067eaa9cb1 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:30.837517 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b135bb-d74e-435c-8ece-e9677ecd9cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:30.838187 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b135bb-d74e-435c-8ece-e9677ecd9cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:30.838471 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b135bb-d74e-435c-8ece-e9677ecd9cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:30.838746 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b135bb-d74e-435c-8ece-e9677ecd9cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:30.848110 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b135bb-d74e-435c-8ece-e9677ecd9cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:30.849479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b135bb-d74e-435c-8ece-e9677ecd9cb1 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:30.859347 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1153/2341] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:09:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:09:31.323793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69997a4-3416-4f33-a5b1-8fd2bfed57e8 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:31.326411 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f69997a4-3416-4f33-a5b1-8fd2bfed57e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:09:31.337142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69997a4-3416-4f33-a5b1-8fd2bfed57e8 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:31.342632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76329d33-81f6-4d1c-b5e6-a757851e70c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:31.343986 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76329d33-81f6-4d1c-b5e6-a757851e70c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:31.344400 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76329d33-81f6-4d1c-b5e6-a757851e70c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:31.344816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76329d33-81f6-4d1c-b5e6-a757851e70c9 admin admin] PATH_INFO: `/v3/projects/f9476936375340cc83196d007bb93572` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:31.346504 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76329d33-81f6-4d1c-b5e6-a757851e70c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9476936375340cc83196d007bb93572)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:31.348780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76329d33-81f6-4d1c-b5e6-a757851e70c9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:31.464724 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-76329d33-81f6-4d1c-b5e6-a757851e70c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9476936375340cc83196d007bb93572', 'request_id': 'req-76329d33-81f6-4d1c-b5e6-a757851e70c9'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:09:31.539111 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-76329d33-81f6-4d1c-b5e6-a757851e70c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9476936375340cc83196d007bb93572', 'request_id': 'req-76329d33-81f6-4d1c-b5e6-a757851e70c9'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:09:31.544680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-76329d33-81f6-4d1c-b5e6-a757851e70c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9476936375340cc83196d007bb93572', 'request_id': 'req-76329d33-81f6-4d1c-b5e6-a757851e70c9'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:09:31.555540 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-76329d33-81f6-4d1c-b5e6-a757851e70c9 admin admin] The token cache is being invalidate because project f9476936375340cc83196d007bb93572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:09:31.555860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-76329d33-81f6-4d1c-b5e6-a757851e70c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:09:31.556611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-76329d33-81f6-4d1c-b5e6-a757851e70c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:09:31.558370 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1189/2342] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:09:31 2022] DELETE /identity/v3/projects/f9476936375340cc83196d007bb93572 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:09:31.563446 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a7b77-ff43-429a-9468-c751424c2032 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:31.563958 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a7b77-ff43-429a-9468-c751424c2032 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:31.564072 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a7b77-ff43-429a-9468-c751424c2032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:31.581463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0b0a7b77-ff43-429a-9468-c751424c2032 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:09:31.582650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0b0a7b77-ff43-429a-9468-c751424c2032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:09:31.638801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1154/2343] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:09:31.647773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2e22c-77a4-48f0-94b9-05bd9ecacb88 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:31.648127 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2e22c-77a4-48f0-94b9-05bd9ecacb88 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:31.648408 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2e22c-77a4-48f0-94b9-05bd9ecacb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:31.668295 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-23b2e22c-77a4-48f0-94b9-05bd9ecacb88 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:09:31.669517 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-23b2e22c-77a4-48f0-94b9-05bd9ecacb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:09:31.677569 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1190/2344] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:09:31.681608 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a7b77-ff43-429a-9468-c751424c2032 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:31.691343 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a7b77-ff43-429a-9468-c751424c2032 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:31.695968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed70a5-afee-49fa-a516-ea25e6251f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:31.696621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed70a5-afee-49fa-a516-ea25e6251f26 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:31.696904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed70a5-afee-49fa-a516-ea25e6251f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:31.697179 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed70a5-afee-49fa-a516-ea25e6251f26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:31.697906 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed70a5-afee-49fa-a516-ea25e6251f26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:09:31.698212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed70a5-afee-49fa-a516-ea25e6251f26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:31.699837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed70a5-afee-49fa-a516-ea25e6251f26 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:31.711644 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1155/2345] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:09:31.715590 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2e22c-77a4-48f0-94b9-05bd9ecacb88 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:31.725381 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2e22c-77a4-48f0-94b9-05bd9ecacb88 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:31.730021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c143844-118a-4eae-9064-51f496bbc84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:31.730661 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c143844-118a-4eae-9064-51f496bbc84a admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:31.730938 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c143844-118a-4eae-9064-51f496bbc84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:31.731204 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c143844-118a-4eae-9064-51f496bbc84a admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:31.732011 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c143844-118a-4eae-9064-51f496bbc84a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:31.733876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c143844-118a-4eae-9064-51f496bbc84a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:31.827333 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1191/2346] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:09:31 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:09:31.835145 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed70a5-afee-49fa-a516-ea25e6251f26 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:31.845230 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed70a5-afee-49fa-a516-ea25e6251f26 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:31.898847 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d538f9-89bf-4434-b541-1e0914b12e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:31.899432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d538f9-89bf-4434-b541-1e0914b12e48 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:31.899736 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d538f9-89bf-4434-b541-1e0914b12e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:31.900012 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d538f9-89bf-4434-b541-1e0914b12e48 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:31.900690 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d538f9-89bf-4434-b541-1e0914b12e48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:31.902582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d538f9-89bf-4434-b541-1e0914b12e48 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:32.008791 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1156/2347] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:09:31 2022] POST /identity/v3/users => generated 294 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:09:32.012759 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c143844-118a-4eae-9064-51f496bbc84a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:32.023419 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c143844-118a-4eae-9064-51f496bbc84a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:32.028107 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab60f07-efbe-46c6-8b4b-d0b050509b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:32.028777 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab60f07-efbe-46c6-8b4b-d0b050509b0c admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:32.029061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab60f07-efbe-46c6-8b4b-d0b050509b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:32.029338 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab60f07-efbe-46c6-8b4b-d0b050509b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:32.030076 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab60f07-efbe-46c6-8b4b-d0b050509b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:32.031657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab60f07-efbe-46c6-8b4b-d0b050509b0c admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:32.042018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1192/2348] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:09:32.046017 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d538f9-89bf-4434-b541-1e0914b12e48 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:32.056173 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d538f9-89bf-4434-b541-1e0914b12e48 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:32.061302 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28695a-b14b-4ca6-99d9-349812e43edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:32.061950 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28695a-b14b-4ca6-99d9-349812e43edb admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:32.062237 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28695a-b14b-4ca6-99d9-349812e43edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:32.062515 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28695a-b14b-4ca6-99d9-349812e43edb admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:32.063245 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28695a-b14b-4ca6-99d9-349812e43edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:32.064910 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28695a-b14b-4ca6-99d9-349812e43edb admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:32.074781 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1157/2349] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:09:32.079508 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab60f07-efbe-46c6-8b4b-d0b050509b0c admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:32.089412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab60f07-efbe-46c6-8b4b-d0b050509b0c admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:32.094033 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7946769-4f01-4efb-a864-78510fc0386b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:32.094896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7946769-4f01-4efb-a864-78510fc0386b admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:32.095173 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7946769-4f01-4efb-a864-78510fc0386b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:32.095441 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7946769-4f01-4efb-a864-78510fc0386b admin admin] PATH_INFO: `/v3/projects/0147bd7cfdb2488982179147ec255510/users/0e730006cc86486a9233d5c1fbd491f3/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:32.109733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7946769-4f01-4efb-a864-78510fc0386b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0147bd7cfdb2488982179147ec255510, user_id=0e730006cc86486a9233d5c1fbd491f3, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:32.112424 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7946769-4f01-4efb-a864-78510fc0386b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:32.202155 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1193/2350] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:09:32 2022] PUT /identity/v3/projects/0147bd7cfdb2488982179147ec255510/users/0e730006cc86486a9233d5c1fbd491f3/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:09:32.212743 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5042d-d33e-403e-875c-bd74614d7d87 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:32.213034 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5042d-d33e-403e-875c-bd74614d7d87 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:32.213327 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5042d-d33e-403e-875c-bd74614d7d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:32.240103 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f1c5042d-d33e-403e-875c-bd74614d7d87 None None] MFA Rules not processed for user `0e730006cc86486a9233d5c1fbd491f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:09:32.241263 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f1c5042d-d33e-403e-875c-bd74614d7d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:09:32.307384 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1158/2351] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:09:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:09:32.312695 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7946769-4f01-4efb-a864-78510fc0386b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:32.370996 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7946769-4f01-4efb-a864-78510fc0386b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:32.376400 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09933600-dcaa-4ee3-b216-26529a1c8a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:32.377045 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09933600-dcaa-4ee3-b216-26529a1c8a3a admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:32.377323 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09933600-dcaa-4ee3-b216-26529a1c8a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:32.377626 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09933600-dcaa-4ee3-b216-26529a1c8a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:32.378319 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09933600-dcaa-4ee3-b216-26529a1c8a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:32.380230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09933600-dcaa-4ee3-b216-26529a1c8a3a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:32.488760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1194/2352] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:09:32 2022] POST /identity/v3/projects => generated 389 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:09:32.492663 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5042d-d33e-403e-875c-bd74614d7d87 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:32.503515 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5042d-d33e-403e-875c-bd74614d7d87 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:32.556330 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc57d9f-eb70-4be2-a35e-aec4245b4f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:32.557023 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc57d9f-eb70-4be2-a35e-aec4245b4f0d admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:32.557308 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc57d9f-eb70-4be2-a35e-aec4245b4f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:32.557580 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc57d9f-eb70-4be2-a35e-aec4245b4f0d admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:32.558263 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc57d9f-eb70-4be2-a35e-aec4245b4f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:32.560772 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc57d9f-eb70-4be2-a35e-aec4245b4f0d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:32.625691 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1159/2353] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:09:32 2022] POST /identity/v3/users => generated 301 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:09:32.629777 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09933600-dcaa-4ee3-b216-26529a1c8a3a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:32.640576 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09933600-dcaa-4ee3-b216-26529a1c8a3a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:32.645200 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f32f2-7c2b-4506-b930-482557e7adf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:32.645856 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f32f2-7c2b-4506-b930-482557e7adf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:32.646138 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f32f2-7c2b-4506-b930-482557e7adf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:32.646414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f32f2-7c2b-4506-b930-482557e7adf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:32.647139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f32f2-7c2b-4506-b930-482557e7adf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:32.648798 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f32f2-7c2b-4506-b930-482557e7adf3 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:32.659546 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1195/2354] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:09:32.663491 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc57d9f-eb70-4be2-a35e-aec4245b4f0d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:32.673161 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc57d9f-eb70-4be2-a35e-aec4245b4f0d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:32.677941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc821d6-4e46-4872-9964-ea144fc30814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:32.678799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc821d6-4e46-4872-9964-ea144fc30814 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:32.679077 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc821d6-4e46-4872-9964-ea144fc30814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:32.679348 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc821d6-4e46-4872-9964-ea144fc30814 admin admin] PATH_INFO: `/v3/projects/9fe9f33cf6e34152b48341f51a91682d/users/21cf1a2627a34b6b8061c95be8feae90/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:32.693871 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc821d6-4e46-4872-9964-ea144fc30814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fe9f33cf6e34152b48341f51a91682d, user_id=21cf1a2627a34b6b8061c95be8feae90, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:32.696647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc821d6-4e46-4872-9964-ea144fc30814 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:32.773689 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1160/2355] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:09:32 2022] PUT /identity/v3/projects/9fe9f33cf6e34152b48341f51a91682d/users/21cf1a2627a34b6b8061c95be8feae90/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:09:32.777600 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f32f2-7c2b-4506-b930-482557e7adf3 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:32.787356 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f32f2-7c2b-4506-b930-482557e7adf3 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:32.841345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e8623-0d30-456b-bf47-f75fa9a8d76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:32.842010 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e8623-0d30-456b-bf47-f75fa9a8d76b admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:32.842291 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e8623-0d30-456b-bf47-f75fa9a8d76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:32.842563 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e8623-0d30-456b-bf47-f75fa9a8d76b admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:32.843290 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e8623-0d30-456b-bf47-f75fa9a8d76b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:32.844898 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e8623-0d30-456b-bf47-f75fa9a8d76b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:32.854180 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1196/2356] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:09:32.858696 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc821d6-4e46-4872-9964-ea144fc30814 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:32.868704 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc821d6-4e46-4872-9964-ea144fc30814 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:32.873880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4dbd7-4daf-49f0-85f9-c7797eb3da6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:32.874736 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4dbd7-4daf-49f0-85f9-c7797eb3da6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:32.875015 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4dbd7-4daf-49f0-85f9-c7797eb3da6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:32.875285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4dbd7-4daf-49f0-85f9-c7797eb3da6c admin admin] PATH_INFO: `/v3/projects/9fe9f33cf6e34152b48341f51a91682d/users/21cf1a2627a34b6b8061c95be8feae90/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:32.877281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4dbd7-4daf-49f0-85f9-c7797eb3da6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fe9f33cf6e34152b48341f51a91682d, user_id=21cf1a2627a34b6b8061c95be8feae90, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:32.879935 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4dbd7-4daf-49f0-85f9-c7797eb3da6c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:32.889570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1161/2357] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:09:32 2022] PUT /identity/v3/projects/9fe9f33cf6e34152b48341f51a91682d/users/21cf1a2627a34b6b8061c95be8feae90/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:09:32.899390 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3d198-47a4-401a-b283-071f020420b0 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:32.899676 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3d198-47a4-401a-b283-071f020420b0 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:32.899968 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3d198-47a4-401a-b283-071f020420b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:32.925885 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-8db3d198-47a4-401a-b283-071f020420b0 None None] MFA Rules not processed for user `21cf1a2627a34b6b8061c95be8feae90`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:09:32.927076 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8db3d198-47a4-401a-b283-071f020420b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:09:32.992210 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1197/2358] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:09:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:09:55.683831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4dbd7-4daf-49f0-85f9-c7797eb3da6c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:09:55.685507 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-72d4dbd7-4daf-49f0-85f9-c7797eb3da6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:09:55.767535 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4dbd7-4daf-49f0-85f9-c7797eb3da6c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:09:55.772809 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdfd89-1e1a-4306-a9d4-116ec3a22ecd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d2edf68b1b440097981097699bb307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:09:55.773457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdfd89-1e1a-4306-a9d4-116ec3a22ecd service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:09:55.773735 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdfd89-1e1a-4306-a9d4-116ec3a22ecd service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:09:55.774005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdfd89-1e1a-4306-a9d4-116ec3a22ecd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:09:55.777122 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7bbdfd89-1e1a-4306-a9d4-116ec3a22ecd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:09:55.788375 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbdfd89-1e1a-4306-a9d4-116ec3a22ecd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:09:55.789940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbdfd89-1e1a-4306-a9d4-116ec3a22ecd service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:09:55.799795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1162/2359] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:09:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:10:24.764868 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3d198-47a4-401a-b283-071f020420b0 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:10:24.766244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8db3d198-47a4-401a-b283-071f020420b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:10:24.820574 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3d198-47a4-401a-b283-071f020420b0 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:10:24.824128 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da9ebe-57db-4e9d-970e-3d7c8e45ae3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:10:24.824766 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da9ebe-57db-4e9d-970e-3d7c8e45ae3d service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:10:24.825076 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da9ebe-57db-4e9d-970e-3d7c8e45ae3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:10:24.825351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da9ebe-57db-4e9d-970e-3d7c8e45ae3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:10:24.827126 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a8da9ebe-57db-4e9d-970e-3d7c8e45ae3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:10:24.894949 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da9ebe-57db-4e9d-970e-3d7c8e45ae3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:10:24.896447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da9ebe-57db-4e9d-970e-3d7c8e45ae3d service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:10:24.905126 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1198/2360] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:10:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:10:25.039340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdfd89-1e1a-4306-a9d4-116ec3a22ecd service placement] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:10:25.048856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdfd89-1e1a-4306-a9d4-116ec3a22ecd service placement] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:10:25.053369 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874fe3b-560a-420c-a351-27ffef288959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:10:25.054003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874fe3b-560a-420c-a351-27ffef288959 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:10:25.054282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874fe3b-560a-420c-a351-27ffef288959 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:10:25.054553 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874fe3b-560a-420c-a351-27ffef288959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:10:25.063591 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874fe3b-560a-420c-a351-27ffef288959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:10:25.065035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874fe3b-560a-420c-a351-27ffef288959 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:10:25.074253 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1163/2361] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:10:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:12:21.260553 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da9ebe-57db-4e9d-970e-3d7c8e45ae3d service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:12:21.261905 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a8da9ebe-57db-4e9d-970e-3d7c8e45ae3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:12:21.315976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da9ebe-57db-4e9d-970e-3d7c8e45ae3d service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:12:21.320079 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01509fcc-67c0-44c1-bbdc-2b25506fe3c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:12:21.320716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01509fcc-67c0-44c1-bbdc-2b25506fe3c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:12:21.320994 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01509fcc-67c0-44c1-bbdc-2b25506fe3c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:12:21.321265 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01509fcc-67c0-44c1-bbdc-2b25506fe3c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:12:21.322985 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-01509fcc-67c0-44c1-bbdc-2b25506fe3c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:12:21.390760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01509fcc-67c0-44c1-bbdc-2b25506fe3c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:12:21.392248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01509fcc-67c0-44c1-bbdc-2b25506fe3c0 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:12:21.403327 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1199/2362] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:12:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:12:24.409696 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874fe3b-560a-420c-a351-27ffef288959 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:12:24.418841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874fe3b-560a-420c-a351-27ffef288959 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:12:24.422324 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17d396-948a-422e-865b-38dd67c632f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:12:24.422946 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17d396-948a-422e-865b-38dd67c632f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:12:24.423477 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17d396-948a-422e-865b-38dd67c632f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:12:24.423779 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17d396-948a-422e-865b-38dd67c632f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:12:24.425505 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4c17d396-948a-422e-865b-38dd67c632f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:12:24.438097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17d396-948a-422e-865b-38dd67c632f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:12:24.439501 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17d396-948a-422e-865b-38dd67c632f0 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:12:24.450722 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1164/2363] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:12:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:12:25.256120 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01509fcc-67c0-44c1-bbdc-2b25506fe3c0 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:12:25.264968 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01509fcc-67c0-44c1-bbdc-2b25506fe3c0 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:12:25.268474 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbd657-bdba-4290-9f14-e2be01b17b63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:12:25.269103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbd657-bdba-4290-9f14-e2be01b17b63 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:12:25.269384 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbd657-bdba-4290-9f14-e2be01b17b63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:12:25.269651 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbd657-bdba-4290-9f14-e2be01b17b63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:12:25.271382 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4dbbd657-bdba-4290-9f14-e2be01b17b63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:12:25.337129 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbd657-bdba-4290-9f14-e2be01b17b63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:12:25.338536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbd657-bdba-4290-9f14-e2be01b17b63 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:12:25.347074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1200/2364] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:12:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:12:25.394267 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17d396-948a-422e-865b-38dd67c632f0 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:12:25.403624 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17d396-948a-422e-865b-38dd67c632f0 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:12:25.407176 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265741f1-9a30-465b-b6e6-f4986919fcf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:12:25.407843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265741f1-9a30-465b-b6e6-f4986919fcf6 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:12:25.408126 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265741f1-9a30-465b-b6e6-f4986919fcf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:12:25.408400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265741f1-9a30-465b-b6e6-f4986919fcf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:12:25.410132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-265741f1-9a30-465b-b6e6-f4986919fcf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:12:25.475813 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265741f1-9a30-465b-b6e6-f4986919fcf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:12:25.477239 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265741f1-9a30-465b-b6e6-f4986919fcf6 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:12:25.494719 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1165/2365] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:12:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:13:02.409941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbd657-bdba-4290-9f14-e2be01b17b63 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:02.411319 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4dbbd657-bdba-4290-9f14-e2be01b17b63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:02.423020 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbd657-bdba-4290-9f14-e2be01b17b63 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:02.426789 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc2261-c75f-402c-8bfa-493f2c0d32f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:02.427424 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc2261-c75f-402c-8bfa-493f2c0d32f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:02.427725 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc2261-c75f-402c-8bfa-493f2c0d32f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:02.428004 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc2261-c75f-402c-8bfa-493f2c0d32f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:02.430430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fcdc2261-c75f-402c-8bfa-493f2c0d32f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:02.441193 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc2261-c75f-402c-8bfa-493f2c0d32f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:02.442891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc2261-c75f-402c-8bfa-493f2c0d32f0 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:02.451309 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1201/2366] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:13:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:13:05.431593 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265741f1-9a30-465b-b6e6-f4986919fcf6 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:05.440847 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265741f1-9a30-465b-b6e6-f4986919fcf6 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:05.444428 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad41476-2995-46fe-a871-522aa8d84d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:05.445560 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad41476-2995-46fe-a871-522aa8d84d9f service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:05.445834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad41476-2995-46fe-a871-522aa8d84d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:05.446100 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad41476-2995-46fe-a871-522aa8d84d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:05.447896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5ad41476-2995-46fe-a871-522aa8d84d9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:05.506665 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad41476-2995-46fe-a871-522aa8d84d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:05.508766 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad41476-2995-46fe-a871-522aa8d84d9f service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:05.518025 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1166/2367] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:13:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:13:13.089105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc2261-c75f-402c-8bfa-493f2c0d32f0 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:13.090556 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fcdc2261-c75f-402c-8bfa-493f2c0d32f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:13.105585 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc2261-c75f-402c-8bfa-493f2c0d32f0 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:13.110360 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ab4bd-7eb2-42d6-a5a3-e99fd5eeb6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:13.111308 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ab4bd-7eb2-42d6-a5a3-e99fd5eeb6b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:13.111585 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ab4bd-7eb2-42d6-a5a3-e99fd5eeb6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:13.111889 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ab4bd-7eb2-42d6-a5a3-e99fd5eeb6b0 admin admin] PATH_INFO: `/v3/users/4edf41df1d4940028966ad901d3f5847` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:13.113090 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ab4bd-7eb2-42d6-a5a3-e99fd5eeb6b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4edf41df1d4940028966ad901d3f5847)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:13.115356 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ab4bd-7eb2-42d6-a5a3-e99fd5eeb6b0 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:13.335984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-924ab4bd-7eb2-42d6-a5a3-e99fd5eeb6b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4edf41df1d4940028966ad901d3f5847'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:13:13.336643 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-924ab4bd-7eb2-42d6-a5a3-e99fd5eeb6b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4edf41df1d4940028966ad901d3f5847'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:13:13.337249 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-924ab4bd-7eb2-42d6-a5a3-e99fd5eeb6b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4edf41df1d4940028966ad901d3f5847'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:13:13.349049 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-924ab4bd-7eb2-42d6-a5a3-e99fd5eeb6b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4edf41df1d4940028966ad901d3f5847'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:13:13.357785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-924ab4bd-7eb2-42d6-a5a3-e99fd5eeb6b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4edf41df1d4940028966ad901d3f5847'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:13:13.450795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1202/2368] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:13:13 2022] DELETE /identity/v3/users/4edf41df1d4940028966ad901d3f5847 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:13:13.695991 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad41476-2995-46fe-a871-522aa8d84d9f service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:13.705896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad41476-2995-46fe-a871-522aa8d84d9f service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:13.762056 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a4509-89ff-48b8-9414-31ac940a4de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:13.762912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a4509-89ff-48b8-9414-31ac940a4de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:13.763192 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a4509-89ff-48b8-9414-31ac940a4de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:13.763464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a4509-89ff-48b8-9414-31ac940a4de9 admin admin] PATH_INFO: `/v3/projects/9623ac5b3c664e44bf4e0bacb398a8a3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:13.764746 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a4509-89ff-48b8-9414-31ac940a4de9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9623ac5b3c664e44bf4e0bacb398a8a3)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:13.766674 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a4509-89ff-48b8-9414-31ac940a4de9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:13.860955 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a95a4509-89ff-48b8-9414-31ac940a4de9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9623ac5b3c664e44bf4e0bacb398a8a3', 'request_id': 'req-a95a4509-89ff-48b8-9414-31ac940a4de9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:13:13.922365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a95a4509-89ff-48b8-9414-31ac940a4de9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9623ac5b3c664e44bf4e0bacb398a8a3', 'request_id': 'req-a95a4509-89ff-48b8-9414-31ac940a4de9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:13:13.928866 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a95a4509-89ff-48b8-9414-31ac940a4de9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9623ac5b3c664e44bf4e0bacb398a8a3', 'request_id': 'req-a95a4509-89ff-48b8-9414-31ac940a4de9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:13:13.940002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a95a4509-89ff-48b8-9414-31ac940a4de9 admin admin] The token cache is being invalidate because project 9623ac5b3c664e44bf4e0bacb398a8a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:13:13.940290 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a95a4509-89ff-48b8-9414-31ac940a4de9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:13:13.940913 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a95a4509-89ff-48b8-9414-31ac940a4de9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:13:13.942538 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1167/2369] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:13:13 2022] DELETE /identity/v3/projects/9623ac5b3c664e44bf4e0bacb398a8a3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:13:13.947136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ab4bd-7eb2-42d6-a5a3-e99fd5eeb6b0 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:13.948571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-924ab4bd-7eb2-42d6-a5a3-e99fd5eeb6b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:13.961515 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ab4bd-7eb2-42d6-a5a3-e99fd5eeb6b0 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:14.016805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008cac2a-ff2e-4461-bcc5-6dcc430ebbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:14.017671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cac2a-ff2e-4461-bcc5-6dcc430ebbea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:14.017948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cac2a-ff2e-4461-bcc5-6dcc430ebbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:14.018215 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cac2a-ff2e-4461-bcc5-6dcc430ebbea admin admin] PATH_INFO: `/v3/users/ede00a65c4ed46249ece7de1a67af841` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:14.031759 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008cac2a-ff2e-4461-bcc5-6dcc430ebbea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ede00a65c4ed46249ece7de1a67af841)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:14.033739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008cac2a-ff2e-4461-bcc5-6dcc430ebbea admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:14.197454 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-008cac2a-ff2e-4461-bcc5-6dcc430ebbea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ede00a65c4ed46249ece7de1a67af841'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:13:14.198124 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-008cac2a-ff2e-4461-bcc5-6dcc430ebbea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ede00a65c4ed46249ece7de1a67af841'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:13:14.198621 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-008cac2a-ff2e-4461-bcc5-6dcc430ebbea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ede00a65c4ed46249ece7de1a67af841'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:13:14.210121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-008cac2a-ff2e-4461-bcc5-6dcc430ebbea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ede00a65c4ed46249ece7de1a67af841'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:13:14.216749 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-008cac2a-ff2e-4461-bcc5-6dcc430ebbea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ede00a65c4ed46249ece7de1a67af841'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:13:14.292026 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1203/2370] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:13:13 2022] DELETE /identity/v3/users/ede00a65c4ed46249ece7de1a67af841 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:13:14.542018 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a4509-89ff-48b8-9414-31ac940a4de9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:14.542018 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a95a4509-89ff-48b8-9414-31ac940a4de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:14.560727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a4509-89ff-48b8-9414-31ac940a4de9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:14.622406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf04ad6-f723-4c3f-aab7-82836688d70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:14.623278 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf04ad6-f723-4c3f-aab7-82836688d70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:14.623587 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf04ad6-f723-4c3f-aab7-82836688d70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:14.623901 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf04ad6-f723-4c3f-aab7-82836688d70c admin admin] PATH_INFO: `/v3/projects/2384ab7018db4ce7bb45e1a778874d06` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:14.637292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf04ad6-f723-4c3f-aab7-82836688d70c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2384ab7018db4ce7bb45e1a778874d06)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:14.639243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf04ad6-f723-4c3f-aab7-82836688d70c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:14.757390 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-9bf04ad6-f723-4c3f-aab7-82836688d70c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2384ab7018db4ce7bb45e1a778874d06', 'request_id': 'req-9bf04ad6-f723-4c3f-aab7-82836688d70c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:13:14.859482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-9bf04ad6-f723-4c3f-aab7-82836688d70c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2384ab7018db4ce7bb45e1a778874d06', 'request_id': 'req-9bf04ad6-f723-4c3f-aab7-82836688d70c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:13:14.865196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-9bf04ad6-f723-4c3f-aab7-82836688d70c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2384ab7018db4ce7bb45e1a778874d06', 'request_id': 'req-9bf04ad6-f723-4c3f-aab7-82836688d70c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:13:14.876397 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-9bf04ad6-f723-4c3f-aab7-82836688d70c admin admin] The token cache is being invalidate because project 2384ab7018db4ce7bb45e1a778874d06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:13:14.876681 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-9bf04ad6-f723-4c3f-aab7-82836688d70c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:13:14.877306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-9bf04ad6-f723-4c3f-aab7-82836688d70c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:13:14.878858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1168/2371] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:13:14 2022] DELETE /identity/v3/projects/2384ab7018db4ce7bb45e1a778874d06 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:13:14.883816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56d4ef-117b-4bee-acef-291ac085b2d6 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:14.884180 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56d4ef-117b-4bee-acef-291ac085b2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:14.884520 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56d4ef-117b-4bee-acef-291ac085b2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:14.903119 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-5a56d4ef-117b-4bee-acef-291ac085b2d6 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:13:14.904326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5a56d4ef-117b-4bee-acef-291ac085b2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:14.960390 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1204/2372] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:13:14.968684 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79929be9-8952-4f95-9f91-7972c4870b98 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:14.968969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79929be9-8952-4f95-9f91-7972c4870b98 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:14.969239 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79929be9-8952-4f95-9f91-7972c4870b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:14.987056 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-79929be9-8952-4f95-9f91-7972c4870b98 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:13:14.988288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-79929be9-8952-4f95-9f91-7972c4870b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:14.996236 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1169/2373] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:13:15.000447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56d4ef-117b-4bee-acef-291ac085b2d6 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:15.010005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56d4ef-117b-4bee-acef-291ac085b2d6 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:15.014419 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4ac71-248f-4e3f-810a-3bb11e265a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:15.015066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4ac71-248f-4e3f-810a-3bb11e265a5f admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:15.015342 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4ac71-248f-4e3f-810a-3bb11e265a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:15.015608 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4ac71-248f-4e3f-810a-3bb11e265a5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:15.016363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4ac71-248f-4e3f-810a-3bb11e265a5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:13:15.016668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4ac71-248f-4e3f-810a-3bb11e265a5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:15.018222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4ac71-248f-4e3f-810a-3bb11e265a5f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:15.029708 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1205/2374] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:13:15.033689 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79929be9-8952-4f95-9f91-7972c4870b98 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:15.043582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79929be9-8952-4f95-9f91-7972c4870b98 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:15.048509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf4abe-a69a-462c-b622-6ddb88b24dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:15.049148 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf4abe-a69a-462c-b622-6ddb88b24dad admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:15.049431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf4abe-a69a-462c-b622-6ddb88b24dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:15.049704 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf4abe-a69a-462c-b622-6ddb88b24dad admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:15.050428 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf4abe-a69a-462c-b622-6ddb88b24dad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:15.052351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf4abe-a69a-462c-b622-6ddb88b24dad admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:15.163992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1170/2375] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:13:15 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:13:15.168568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4ac71-248f-4e3f-810a-3bb11e265a5f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:15.178835 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4ac71-248f-4e3f-810a-3bb11e265a5f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:15.233007 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c1c8b-3b4a-4655-a96a-e1f44f673438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:15.233706 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c1c8b-3b4a-4655-a96a-e1f44f673438 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:15.233990 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c1c8b-3b4a-4655-a96a-e1f44f673438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:15.234264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c1c8b-3b4a-4655-a96a-e1f44f673438 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:15.234966 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c1c8b-3b4a-4655-a96a-e1f44f673438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:15.237050 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c1c8b-3b4a-4655-a96a-e1f44f673438 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:15.305200 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1206/2376] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:13:15 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:13:15.309768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf4abe-a69a-462c-b622-6ddb88b24dad admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:15.320071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf4abe-a69a-462c-b622-6ddb88b24dad admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:15.324750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf373fd8-2ccb-436e-81dd-665718dc02dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:15.325398 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf373fd8-2ccb-436e-81dd-665718dc02dd admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:15.325678 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf373fd8-2ccb-436e-81dd-665718dc02dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:15.325948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf373fd8-2ccb-436e-81dd-665718dc02dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:15.326707 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf373fd8-2ccb-436e-81dd-665718dc02dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:15.328329 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf373fd8-2ccb-436e-81dd-665718dc02dd admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:15.338033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1171/2377] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:13:15.341784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c1c8b-3b4a-4655-a96a-e1f44f673438 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:15.351638 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c1c8b-3b4a-4655-a96a-e1f44f673438 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:15.356863 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb876c42-85ac-4828-acd2-48636f61314c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:15.357509 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb876c42-85ac-4828-acd2-48636f61314c admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:15.357791 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb876c42-85ac-4828-acd2-48636f61314c admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:15.358067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb876c42-85ac-4828-acd2-48636f61314c admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:15.358790 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb876c42-85ac-4828-acd2-48636f61314c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:15.360406 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb876c42-85ac-4828-acd2-48636f61314c admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:15.370527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1207/2378] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:13:15.374370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf373fd8-2ccb-436e-81dd-665718dc02dd admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:15.384032 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf373fd8-2ccb-436e-81dd-665718dc02dd admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:15.388770 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdaed3-238a-42bc-803e-cd11b4b2f3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:15.389627 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdaed3-238a-42bc-803e-cd11b4b2f3da admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:15.389907 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdaed3-238a-42bc-803e-cd11b4b2f3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:15.390184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdaed3-238a-42bc-803e-cd11b4b2f3da admin admin] PATH_INFO: `/v3/projects/c8f49f13fc76471cab47c7270da89297/users/9caf2e62387840e5ab72b3abe34f5008/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:15.404323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdaed3-238a-42bc-803e-cd11b4b2f3da admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f49f13fc76471cab47c7270da89297, user_id=9caf2e62387840e5ab72b3abe34f5008, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:15.406952 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdaed3-238a-42bc-803e-cd11b4b2f3da admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:15.492643 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1172/2379] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:13:15 2022] PUT /identity/v3/projects/c8f49f13fc76471cab47c7270da89297/users/9caf2e62387840e5ab72b3abe34f5008/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:13:15.498195 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c962a2-a5ff-4d28-911e-01a8e5d0f389 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:15.498486 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c962a2-a5ff-4d28-911e-01a8e5d0f389 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:15.498768 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c962a2-a5ff-4d28-911e-01a8e5d0f389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:15.516285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-a6c962a2-a5ff-4d28-911e-01a8e5d0f389 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:13:15.517472 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a6c962a2-a5ff-4d28-911e-01a8e5d0f389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:15.574837 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1208/2380] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:13:15.584157 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdaed3-238a-42bc-803e-cd11b4b2f3da admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:15.586441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f7fdaed3-238a-42bc-803e-cd11b4b2f3da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:15.640759 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdaed3-238a-42bc-803e-cd11b4b2f3da admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:15.644479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a49f6-d0d0-46b3-bc40-7540881dc484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:15.645114 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a49f6-d0d0-46b3-bc40-7540881dc484 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:15.645393 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a49f6-d0d0-46b3-bc40-7540881dc484 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:15.645661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a49f6-d0d0-46b3-bc40-7540881dc484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:15.655294 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a49f6-d0d0-46b3-bc40-7540881dc484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:15.657035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a49f6-d0d0-46b3-bc40-7540881dc484 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:15.666870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1173/2381] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:13:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:13:21.390353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fa2f5-d341-4ad5-b6f2-f5788af2882f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:21.390852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fa2f5-d341-4ad5-b6f2-f5788af2882f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:21.390944 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fa2f5-d341-4ad5-b6f2-f5788af2882f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:21.420981 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-118fa2f5-d341-4ad5-b6f2-f5788af2882f None None] MFA Rules not processed for user `9caf2e62387840e5ab72b3abe34f5008`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:13:21.422488 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-118fa2f5-d341-4ad5-b6f2-f5788af2882f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:21.496527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1209/2382] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:13:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:13:21.500935 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a49f6-d0d0-46b3-bc40-7540881dc484 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:21.514790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a49f6-d0d0-46b3-bc40-7540881dc484 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:21.519928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06424d38-e02c-4278-be25-b9ffd3e7c15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:21.520589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06424d38-e02c-4278-be25-b9ffd3e7c15b admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:21.520872 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06424d38-e02c-4278-be25-b9ffd3e7c15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:21.521314 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06424d38-e02c-4278-be25-b9ffd3e7c15b admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:21.522028 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06424d38-e02c-4278-be25-b9ffd3e7c15b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:21.524034 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06424d38-e02c-4278-be25-b9ffd3e7c15b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:21.628492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1174/2383] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:13:21 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:13:21.630651 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fa2f5-d341-4ad5-b6f2-f5788af2882f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:21.642008 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fa2f5-d341-4ad5-b6f2-f5788af2882f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:21.696411 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03fbc7-bc4f-41d2-92de-131417dc6b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:21.697116 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03fbc7-bc4f-41d2-92de-131417dc6b21 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:21.697396 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03fbc7-bc4f-41d2-92de-131417dc6b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:21.697670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03fbc7-bc4f-41d2-92de-131417dc6b21 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:21.698385 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03fbc7-bc4f-41d2-92de-131417dc6b21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:21.700409 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03fbc7-bc4f-41d2-92de-131417dc6b21 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:21.801949 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1210/2384] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:13:21 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:13:21.806593 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06424d38-e02c-4278-be25-b9ffd3e7c15b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:21.816934 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06424d38-e02c-4278-be25-b9ffd3e7c15b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:21.822278 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3a658-1e4d-484e-ad78-66ba904795e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:21.822936 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3a658-1e4d-484e-ad78-66ba904795e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:21.823217 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3a658-1e4d-484e-ad78-66ba904795e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:21.823514 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3a658-1e4d-484e-ad78-66ba904795e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:21.824279 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3a658-1e4d-484e-ad78-66ba904795e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:21.826040 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3a658-1e4d-484e-ad78-66ba904795e7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:21.836404 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1175/2385] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:13:21.840734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03fbc7-bc4f-41d2-92de-131417dc6b21 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:21.850588 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03fbc7-bc4f-41d2-92de-131417dc6b21 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:21.855208 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f6c9d-81e9-41a9-8c7c-d34c7003b2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:21.856121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f6c9d-81e9-41a9-8c7c-d34c7003b2c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:21.856406 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f6c9d-81e9-41a9-8c7c-d34c7003b2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:21.856681 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f6c9d-81e9-41a9-8c7c-d34c7003b2c3 admin admin] PATH_INFO: `/v3/projects/6e86417338df454dbc8bf6bb82904c1d/users/18db665a314846c194abc858697fc964/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:21.871412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f6c9d-81e9-41a9-8c7c-d34c7003b2c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e86417338df454dbc8bf6bb82904c1d, user_id=18db665a314846c194abc858697fc964, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:21.874108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f6c9d-81e9-41a9-8c7c-d34c7003b2c3 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:21.934920 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1211/2386] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:13:21 2022] PUT /identity/v3/projects/6e86417338df454dbc8bf6bb82904c1d/users/18db665a314846c194abc858697fc964/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:13:21.938997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3a658-1e4d-484e-ad78-66ba904795e7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:21.949737 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3a658-1e4d-484e-ad78-66ba904795e7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:22.006141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811f182-9075-4d3e-886a-fbde37b7c840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:22.006817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811f182-9075-4d3e-886a-fbde37b7c840 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:22.007101 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811f182-9075-4d3e-886a-fbde37b7c840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:22.007377 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811f182-9075-4d3e-886a-fbde37b7c840 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:22.008149 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811f182-9075-4d3e-886a-fbde37b7c840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:22.009775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811f182-9075-4d3e-886a-fbde37b7c840 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:22.019891 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1176/2387] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:13:22.024159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f6c9d-81e9-41a9-8c7c-d34c7003b2c3 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:22.034457 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f6c9d-81e9-41a9-8c7c-d34c7003b2c3 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:22.039102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36f70c-1652-407f-b495-740d1d97e106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:22.040519 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36f70c-1652-407f-b495-740d1d97e106 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:22.040799 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36f70c-1652-407f-b495-740d1d97e106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:22.041069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36f70c-1652-407f-b495-740d1d97e106 admin admin] PATH_INFO: `/v3/projects/6e86417338df454dbc8bf6bb82904c1d/users/18db665a314846c194abc858697fc964/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:22.043153 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36f70c-1652-407f-b495-740d1d97e106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e86417338df454dbc8bf6bb82904c1d, user_id=18db665a314846c194abc858697fc964, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:22.045835 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36f70c-1652-407f-b495-740d1d97e106 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:22.057559 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1212/2388] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:13:22 2022] PUT /identity/v3/projects/6e86417338df454dbc8bf6bb82904c1d/users/18db665a314846c194abc858697fc964/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:13:27.735981 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b97dfe-e766-4df6-92ac-84984428e9ca None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:27.736472 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b97dfe-e766-4df6-92ac-84984428e9ca None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:27.736684 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b97dfe-e766-4df6-92ac-84984428e9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:27.763658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c0b97dfe-e766-4df6-92ac-84984428e9ca None None] MFA Rules not processed for user `18db665a314846c194abc858697fc964`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:13:27.764846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c0b97dfe-e766-4df6-92ac-84984428e9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:27.833055 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1177/2389] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:13:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:13:27.846972 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36f70c-1652-407f-b495-740d1d97e106 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:13:27.848774 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5f36f70c-1652-407f-b495-740d1d97e106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:13:27.919964 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36f70c-1652-407f-b495-740d1d97e106 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:13:27.925779 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4cc84-baf0-4c31-8f05-3c7a2205cae6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:13:27.926424 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4cc84-baf0-4c31-8f05-3c7a2205cae6 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:13:27.926708 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4cc84-baf0-4c31-8f05-3c7a2205cae6 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:13:27.927017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4cc84-baf0-4c31-8f05-3c7a2205cae6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:13:27.982294 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4cc84-baf0-4c31-8f05-3c7a2205cae6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:13:27.983914 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4cc84-baf0-4c31-8f05-3c7a2205cae6 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:13:27.993172 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1213/2390] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:13:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:14:25.722654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b97dfe-e766-4df6-92ac-84984428e9ca None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:14:25.724120 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c0b97dfe-e766-4df6-92ac-84984428e9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:14:25.786916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b97dfe-e766-4df6-92ac-84984428e9ca None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:14:25.790494 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526c98a-5d40-4c0e-8f51-c286035c2a15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:14:25.791125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526c98a-5d40-4c0e-8f51-c286035c2a15 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:14:25.791452 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526c98a-5d40-4c0e-8f51-c286035c2a15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:14:25.791673 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526c98a-5d40-4c0e-8f51-c286035c2a15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:14:25.793418 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3526c98a-5d40-4c0e-8f51-c286035c2a15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:14:25.871078 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526c98a-5d40-4c0e-8f51-c286035c2a15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:14:25.872521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526c98a-5d40-4c0e-8f51-c286035c2a15 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:14:25.890460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1178/2391] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:14:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:15:00.684416 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4cc84-baf0-4c31-8f05-3c7a2205cae6 service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:00.685798 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-78e4cc84-baf0-4c31-8f05-3c7a2205cae6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:00.831759 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4cc84-baf0-4c31-8f05-3c7a2205cae6 service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:00.837210 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1221e5-976f-418b-b485-ace7c34428dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d2edf68b1b440097981097699bb307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:00.837957 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1221e5-976f-418b-b485-ace7c34428dc service placement] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:00.838275 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1221e5-976f-418b-b485-ace7c34428dc service placement] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:00.838553 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1221e5-976f-418b-b485-ace7c34428dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:00.840364 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-cc1221e5-976f-418b-b485-ace7c34428dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:00.852169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1221e5-976f-418b-b485-ace7c34428dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:00.853784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1221e5-976f-418b-b485-ace7c34428dc service placement] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:00.863531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1214/2392] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:15:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:15:05.915033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526c98a-5d40-4c0e-8f51-c286035c2a15 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:05.917107 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3526c98a-5d40-4c0e-8f51-c286035c2a15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:05.985014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526c98a-5d40-4c0e-8f51-c286035c2a15 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:05.990011 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c673b-d0d7-42bf-b701-f536609eee90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:05.991155 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c673b-d0d7-42bf-b701-f536609eee90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:05.991540 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c673b-d0d7-42bf-b701-f536609eee90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:05.992067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c673b-d0d7-42bf-b701-f536609eee90 admin admin] PATH_INFO: `/v3/users/0e730006cc86486a9233d5c1fbd491f3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:05.993357 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c673b-d0d7-42bf-b701-f536609eee90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e730006cc86486a9233d5c1fbd491f3)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:05.995365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c673b-d0d7-42bf-b701-f536609eee90 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:06.008647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1221e5-976f-418b-b485-ace7c34428dc service placement] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:06.013134 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-cc1221e5-976f-418b-b485-ace7c34428dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:06.022812 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1221e5-976f-418b-b485-ace7c34428dc service placement] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:06.027222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadca08b-0b83-4e15-b706-a8ee6290c209 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:06.028139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadca08b-0b83-4e15-b706-a8ee6290c209 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:06.028490 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadca08b-0b83-4e15-b706-a8ee6290c209 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:06.028830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadca08b-0b83-4e15-b706-a8ee6290c209 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:06.031379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fadca08b-0b83-4e15-b706-a8ee6290c209 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:06.046912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-fadca08b-0b83-4e15-b706-a8ee6290c209 service cinder] Could not find project: 9623ac5b3c664e44bf4e0bacb398a8a3.: keystone.exception.ProjectNotFound: Could not find project: 9623ac5b3c664e44bf4e0bacb398a8a3. May 12 07:15:06.046912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 07:15:06.046912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 07:15:06.046912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 07:15:06.046912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 07:15:06.046912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 07:15:06.046912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 07:15:06.046912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 07:15:06.046912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 07:15:06.046912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 07:15:06.046912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 07:15:06.046912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 07:15:06.046912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get May 12 07:15:06.046912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') May 12 07:15:06.046912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 12 07:15:06.048873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 12 07:15:06.048873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 12 07:15:06.048873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 12 07:15:06.048873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:15:06.048873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:15:06.048873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token May 12 07:15:06.048873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application token = self._validate_token(token_id) May 12 07:15:06.048873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:15:06.048873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:15:06.048873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:15:06.048873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:15:06.048873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:15:06.048873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 07:15:06.048873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:15:06.048873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 07:15:06.048873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:15:06.048873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:15:06.050199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:15:06.050199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 07:15:06.050199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:15:06.050199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 07:15:06.050199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token May 12 07:15:06.050199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) May 12 07:15:06.050199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint May 12 07:15:06.050199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._validate_token_resources() May 12 07:15:06.050199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources May 12 07:15:06.050199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): May 12 07:15:06.050199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project May 12 07:15:06.050199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( May 12 07:15:06.050199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 07:15:06.050199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 07:15:06.050199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 07:15:06.050199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 07:15:06.050199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 07:15:06.051567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( May 12 07:15:06.051567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 07:15:06.051567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( May 12 07:15:06.051567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 07:15:06.051567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() May 12 07:15:06.051567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 07:15:06.051567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 07:15:06.051567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 07:15:06.051567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() May 12 07:15:06.051567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 07:15:06.051567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( May 12 07:15:06.051567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 07:15:06.051567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 07:15:06.051567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 07:15:06.051567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 07:15:06.051567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 07:15:06.051567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 07:15:06.055805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9623ac5b3c664e44bf4e0bacb398a8a3. May 12 07:15:06.055805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application May 12 07:15:06.055805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1215/2393] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:15:06 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 12 07:15:06.189599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0e3c673b-d0d7-42bf-b701-f536609eee90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e730006cc86486a9233d5c1fbd491f3'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:15:06.190247 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0e3c673b-d0d7-42bf-b701-f536609eee90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e730006cc86486a9233d5c1fbd491f3'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:15:06.201648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0e3c673b-d0d7-42bf-b701-f536609eee90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e730006cc86486a9233d5c1fbd491f3'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:15:06.202283 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0e3c673b-d0d7-42bf-b701-f536609eee90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e730006cc86486a9233d5c1fbd491f3'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:15:06.208865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0e3c673b-d0d7-42bf-b701-f536609eee90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e730006cc86486a9233d5c1fbd491f3'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:15:06.319429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1179/2394] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:15:05 2022] DELETE /identity/v3/users/0e730006cc86486a9233d5c1fbd491f3 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:15:06.324617 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b577cf-1038-49a9-88ab-7a58721011a8 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:06.324906 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b577cf-1038-49a9-88ab-7a58721011a8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:06.325182 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b577cf-1038-49a9-88ab-7a58721011a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:06.343206 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-53b577cf-1038-49a9-88ab-7a58721011a8 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:15:06.344442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-53b577cf-1038-49a9-88ab-7a58721011a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:06.402259 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1216/2395] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:15:06.431868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c673b-d0d7-42bf-b701-f536609eee90 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:06.433473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0e3c673b-d0d7-42bf-b701-f536609eee90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:06.495284 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c673b-d0d7-42bf-b701-f536609eee90 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:06.498956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b41b2-fee9-4a8d-8d87-3033068057e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:06.499609 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b41b2-fee9-4a8d-8d87-3033068057e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:06.499964 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b41b2-fee9-4a8d-8d87-3033068057e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:06.500234 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b41b2-fee9-4a8d-8d87-3033068057e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:06.509720 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b41b2-fee9-4a8d-8d87-3033068057e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:06.511907 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b41b2-fee9-4a8d-8d87-3033068057e9 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:06.526897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1180/2396] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:15:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:15:07.009389 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b577cf-1038-49a9-88ab-7a58721011a8 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:07.009389 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-53b577cf-1038-49a9-88ab-7a58721011a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:07.022623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b577cf-1038-49a9-88ab-7a58721011a8 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:07.029405 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a74190-bb48-423e-9d68-918d36fb2ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:07.030285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a74190-bb48-423e-9d68-918d36fb2ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:07.030551 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a74190-bb48-423e-9d68-918d36fb2ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:07.030887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a74190-bb48-423e-9d68-918d36fb2ba5 admin admin] PATH_INFO: `/v3/projects/0147bd7cfdb2488982179147ec255510` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:07.032144 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a74190-bb48-423e-9d68-918d36fb2ba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0147bd7cfdb2488982179147ec255510)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:07.035840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a74190-bb48-423e-9d68-918d36fb2ba5 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:07.153605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b5a74190-bb48-423e-9d68-918d36fb2ba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0147bd7cfdb2488982179147ec255510', 'request_id': 'req-b5a74190-bb48-423e-9d68-918d36fb2ba5'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:15:07.244186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b5a74190-bb48-423e-9d68-918d36fb2ba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0147bd7cfdb2488982179147ec255510', 'request_id': 'req-b5a74190-bb48-423e-9d68-918d36fb2ba5'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:15:07.253200 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b5a74190-bb48-423e-9d68-918d36fb2ba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0147bd7cfdb2488982179147ec255510', 'request_id': 'req-b5a74190-bb48-423e-9d68-918d36fb2ba5'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:15:07.264918 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b5a74190-bb48-423e-9d68-918d36fb2ba5 admin admin] The token cache is being invalidate because project 0147bd7cfdb2488982179147ec255510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:15:07.265269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b5a74190-bb48-423e-9d68-918d36fb2ba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:15:07.265995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b5a74190-bb48-423e-9d68-918d36fb2ba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:15:07.267716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1217/2397] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:15:07 2022] DELETE /identity/v3/projects/0147bd7cfdb2488982179147ec255510 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:15:07.271511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b41b2-fee9-4a8d-8d87-3033068057e9 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:07.281333 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b41b2-fee9-4a8d-8d87-3033068057e9 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:07.337786 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714916-2446-4526-8003-3be935840a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:07.338659 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714916-2446-4526-8003-3be935840a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:07.338942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714916-2446-4526-8003-3be935840a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:07.339215 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714916-2446-4526-8003-3be935840a36 admin admin] PATH_INFO: `/v3/users/21cf1a2627a34b6b8061c95be8feae90` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:07.340460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c714916-2446-4526-8003-3be935840a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21cf1a2627a34b6b8061c95be8feae90)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:07.342420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c714916-2446-4526-8003-3be935840a36 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:07.493451 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0c714916-2446-4526-8003-3be935840a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21cf1a2627a34b6b8061c95be8feae90'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:15:07.494116 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0c714916-2446-4526-8003-3be935840a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21cf1a2627a34b6b8061c95be8feae90'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:15:07.506165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0c714916-2446-4526-8003-3be935840a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21cf1a2627a34b6b8061c95be8feae90'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:15:07.506917 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0c714916-2446-4526-8003-3be935840a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21cf1a2627a34b6b8061c95be8feae90'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:15:07.513647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0c714916-2446-4526-8003-3be935840a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21cf1a2627a34b6b8061c95be8feae90'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:15:07.570373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1181/2398] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:15:07 2022] DELETE /identity/v3/users/21cf1a2627a34b6b8061c95be8feae90 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:15:08.047176 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a74190-bb48-423e-9d68-918d36fb2ba5 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:08.049795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b5a74190-bb48-423e-9d68-918d36fb2ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:08.141465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714916-2446-4526-8003-3be935840a36 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:08.143102 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0c714916-2446-4526-8003-3be935840a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:08.201117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a74190-bb48-423e-9d68-918d36fb2ba5 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:08.251845 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714916-2446-4526-8003-3be935840a36 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:08.256668 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fe33b-0cff-42a4-8cef-9fd168e52592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:08.257605 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fe33b-0cff-42a4-8cef-9fd168e52592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:08.257960 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fe33b-0cff-42a4-8cef-9fd168e52592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:08.258305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fe33b-0cff-42a4-8cef-9fd168e52592 admin admin] PATH_INFO: `/v3/projects/9fe9f33cf6e34152b48341f51a91682d` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:08.259908 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fe33b-0cff-42a4-8cef-9fd168e52592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fe9f33cf6e34152b48341f51a91682d)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:08.262513 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fe33b-0cff-42a4-8cef-9fd168e52592 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:08.327117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06e7c0-b6cc-4616-b71c-0566a0d5b52d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:08.327804 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06e7c0-b6cc-4616-b71c-0566a0d5b52d service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:08.329889 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06e7c0-b6cc-4616-b71c-0566a0d5b52d service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:08.329889 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06e7c0-b6cc-4616-b71c-0566a0d5b52d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:08.330134 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3f06e7c0-b6cc-4616-b71c-0566a0d5b52d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:08.342968 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06e7c0-b6cc-4616-b71c-0566a0d5b52d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:08.344581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06e7c0-b6cc-4616-b71c-0566a0d5b52d service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:08.355438 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1218/2399] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:15:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:15:08.377470 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-794fe33b-0cff-42a4-8cef-9fd168e52592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fe9f33cf6e34152b48341f51a91682d', 'request_id': 'req-794fe33b-0cff-42a4-8cef-9fd168e52592'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:15:08.456727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-794fe33b-0cff-42a4-8cef-9fd168e52592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fe9f33cf6e34152b48341f51a91682d', 'request_id': 'req-794fe33b-0cff-42a4-8cef-9fd168e52592'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:15:08.462997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-794fe33b-0cff-42a4-8cef-9fd168e52592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fe9f33cf6e34152b48341f51a91682d', 'request_id': 'req-794fe33b-0cff-42a4-8cef-9fd168e52592'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:15:08.474659 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-794fe33b-0cff-42a4-8cef-9fd168e52592 admin admin] The token cache is being invalidate because project 9fe9f33cf6e34152b48341f51a91682d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:15:08.474952 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-794fe33b-0cff-42a4-8cef-9fd168e52592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:15:08.475669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-794fe33b-0cff-42a4-8cef-9fd168e52592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:15:08.477260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1182/2400] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:15:08 2022] DELETE /identity/v3/projects/9fe9f33cf6e34152b48341f51a91682d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:15:08.482572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d96e5-7c0e-473b-8d3a-b970c64e61fb None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:08.482858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d96e5-7c0e-473b-8d3a-b970c64e61fb None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:08.483134 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d96e5-7c0e-473b-8d3a-b970c64e61fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:08.502980 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f67d96e5-7c0e-473b-8d3a-b970c64e61fb None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:15:08.504213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f67d96e5-7c0e-473b-8d3a-b970c64e61fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:08.563265 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1219/2401] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:15:08.572481 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df103c-919b-48d1-bfd8-d1f28fe98863 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:08.572875 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df103c-919b-48d1-bfd8-d1f28fe98863 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:08.573618 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df103c-919b-48d1-bfd8-d1f28fe98863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:08.591612 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-35df103c-919b-48d1-bfd8-d1f28fe98863 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:15:08.592862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-35df103c-919b-48d1-bfd8-d1f28fe98863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:08.601078 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1183/2402] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:15:08.605881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d96e5-7c0e-473b-8d3a-b970c64e61fb None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:08.615570 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d96e5-7c0e-473b-8d3a-b970c64e61fb None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:08.620913 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aca521-e4f6-46e0-9f61-e6d6db9de801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:08.621568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aca521-e4f6-46e0-9f61-e6d6db9de801 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:08.621855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aca521-e4f6-46e0-9f61-e6d6db9de801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:08.622132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aca521-e4f6-46e0-9f61-e6d6db9de801 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:08.622864 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aca521-e4f6-46e0-9f61-e6d6db9de801 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:15:08.623171 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aca521-e4f6-46e0-9f61-e6d6db9de801 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:08.624819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aca521-e4f6-46e0-9f61-e6d6db9de801 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:08.636335 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1220/2403] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:15:08.640993 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df103c-919b-48d1-bfd8-d1f28fe98863 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:08.650757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df103c-919b-48d1-bfd8-d1f28fe98863 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:08.655498 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cc108-5534-4e82-885c-94612211ed67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:08.656301 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cc108-5534-4e82-885c-94612211ed67 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:08.656594 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cc108-5534-4e82-885c-94612211ed67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:08.656873 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cc108-5534-4e82-885c-94612211ed67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:08.657616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cc108-5534-4e82-885c-94612211ed67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:08.659529 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cc108-5534-4e82-885c-94612211ed67 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:08.784596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1184/2404] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:15:08 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:15:08.789325 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aca521-e4f6-46e0-9f61-e6d6db9de801 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:08.801542 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aca521-e4f6-46e0-9f61-e6d6db9de801 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:08.876210 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2374c-07f2-4986-a799-da9e9f988aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:08.877008 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2374c-07f2-4986-a799-da9e9f988aeb admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:08.877398 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2374c-07f2-4986-a799-da9e9f988aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:08.877778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2374c-07f2-4986-a799-da9e9f988aeb admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:08.878597 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2374c-07f2-4986-a799-da9e9f988aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:08.880853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2374c-07f2-4986-a799-da9e9f988aeb admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:08.971559 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1221/2405] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:15:08 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:15:08.975858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cc108-5534-4e82-885c-94612211ed67 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:08.993455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cc108-5534-4e82-885c-94612211ed67 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:08.999170 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e81dbe-0d36-4e1e-b7fb-50f072d71d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:09.000051 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e81dbe-0d36-4e1e-b7fb-50f072d71d9e admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:09.000772 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e81dbe-0d36-4e1e-b7fb-50f072d71d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:09.000772 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e81dbe-0d36-4e1e-b7fb-50f072d71d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:09.001842 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e81dbe-0d36-4e1e-b7fb-50f072d71d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:09.003514 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e81dbe-0d36-4e1e-b7fb-50f072d71d9e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:09.018682 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1185/2406] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:15:09.028446 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2374c-07f2-4986-a799-da9e9f988aeb admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:09.038926 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2374c-07f2-4986-a799-da9e9f988aeb admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:09.044374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b253b8e-8900-40b6-9d56-01567b2d6e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:09.045044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b253b8e-8900-40b6-9d56-01567b2d6e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:09.045329 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b253b8e-8900-40b6-9d56-01567b2d6e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:09.045608 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b253b8e-8900-40b6-9d56-01567b2d6e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:09.046352 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b253b8e-8900-40b6-9d56-01567b2d6e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:09.048293 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b253b8e-8900-40b6-9d56-01567b2d6e84 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:09.063289 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1222/2407] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:15:09.064602 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e81dbe-0d36-4e1e-b7fb-50f072d71d9e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:09.074549 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e81dbe-0d36-4e1e-b7fb-50f072d71d9e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:09.079205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a82e05-c144-4d3e-9a16-ac3a08785d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:09.080108 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a82e05-c144-4d3e-9a16-ac3a08785d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:09.080391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a82e05-c144-4d3e-9a16-ac3a08785d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:09.080670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a82e05-c144-4d3e-9a16-ac3a08785d42 admin admin] PATH_INFO: `/v3/projects/a88ac006d21c49c99c5fefabce9bc149/users/5c5441d2e6a34ebca9ef5c17408b95e9/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:09.095927 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a82e05-c144-4d3e-9a16-ac3a08785d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a88ac006d21c49c99c5fefabce9bc149, user_id=5c5441d2e6a34ebca9ef5c17408b95e9, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:09.098711 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a82e05-c144-4d3e-9a16-ac3a08785d42 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:09.211775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1186/2408] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:15:09 2022] PUT /identity/v3/projects/a88ac006d21c49c99c5fefabce9bc149/users/5c5441d2e6a34ebca9ef5c17408b95e9/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:15:09.223123 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936a144-e770-4797-858f-3c3d1430884c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:09.223418 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936a144-e770-4797-858f-3c3d1430884c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:09.223731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936a144-e770-4797-858f-3c3d1430884c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:09.252987 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-0936a144-e770-4797-858f-3c3d1430884c None None] MFA Rules not processed for user `5c5441d2e6a34ebca9ef5c17408b95e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:15:09.254334 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0936a144-e770-4797-858f-3c3d1430884c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:09.347836 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1223/2409] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:15:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:15:09.352439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a82e05-c144-4d3e-9a16-ac3a08785d42 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:09.416073 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a82e05-c144-4d3e-9a16-ac3a08785d42 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:09.420705 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642487e6-0ecd-463f-b213-e313b12029aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:09.421355 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642487e6-0ecd-463f-b213-e313b12029aa admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:09.421633 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642487e6-0ecd-463f-b213-e313b12029aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:09.421906 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642487e6-0ecd-463f-b213-e313b12029aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:09.422840 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642487e6-0ecd-463f-b213-e313b12029aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:09.424783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642487e6-0ecd-463f-b213-e313b12029aa admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:09.497012 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1187/2410] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:15:09 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:15:09.501028 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936a144-e770-4797-858f-3c3d1430884c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:09.512193 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936a144-e770-4797-858f-3c3d1430884c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:09.568248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa576a81-bd6a-49fb-8376-95fc119346a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:09.568846 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa576a81-bd6a-49fb-8376-95fc119346a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:09.569122 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa576a81-bd6a-49fb-8376-95fc119346a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:09.569390 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa576a81-bd6a-49fb-8376-95fc119346a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:09.570075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa576a81-bd6a-49fb-8376-95fc119346a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:09.572040 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa576a81-bd6a-49fb-8376-95fc119346a9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:09.626941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1224/2411] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:15:09 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:15:09.630958 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642487e6-0ecd-463f-b213-e313b12029aa admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:09.641695 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642487e6-0ecd-463f-b213-e313b12029aa admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:09.646471 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e4865-d5e9-4536-a9cb-ab1d6d85000e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:09.658282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e4865-d5e9-4536-a9cb-ab1d6d85000e admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:09.658282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e4865-d5e9-4536-a9cb-ab1d6d85000e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:09.658282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e4865-d5e9-4536-a9cb-ab1d6d85000e admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:09.658282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e4865-d5e9-4536-a9cb-ab1d6d85000e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:09.658282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e4865-d5e9-4536-a9cb-ab1d6d85000e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:09.661005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1188/2412] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:15:09.664997 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa576a81-bd6a-49fb-8376-95fc119346a9 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:09.674833 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa576a81-bd6a-49fb-8376-95fc119346a9 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:09.679409 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d560b-824c-440d-93a4-3771034ab644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:09.680303 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d560b-824c-440d-93a4-3771034ab644 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:09.680581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d560b-824c-440d-93a4-3771034ab644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:09.680849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d560b-824c-440d-93a4-3771034ab644 admin admin] PATH_INFO: `/v3/projects/fb91910cf43245e1a86eec498c921775/users/45bd55318ab54a72b6f2af850ac0787d/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:09.694725 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d560b-824c-440d-93a4-3771034ab644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb91910cf43245e1a86eec498c921775, user_id=45bd55318ab54a72b6f2af850ac0787d, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:09.697421 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d560b-824c-440d-93a4-3771034ab644 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:09.814980 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1225/2413] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:15:09 2022] PUT /identity/v3/projects/fb91910cf43245e1a86eec498c921775/users/45bd55318ab54a72b6f2af850ac0787d/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:15:09.819818 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e4865-d5e9-4536-a9cb-ab1d6d85000e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:09.829729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e4865-d5e9-4536-a9cb-ab1d6d85000e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:09.886844 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03315988-8443-4d86-9c0c-4af54a73c8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:09.887540 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03315988-8443-4d86-9c0c-4af54a73c8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:09.887852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03315988-8443-4d86-9c0c-4af54a73c8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:09.888125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03315988-8443-4d86-9c0c-4af54a73c8d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:09.888852 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03315988-8443-4d86-9c0c-4af54a73c8d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:09.890463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03315988-8443-4d86-9c0c-4af54a73c8d6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:09.900640 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1189/2414] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:15:09.904904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d560b-824c-440d-93a4-3771034ab644 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:09.915807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d560b-824c-440d-93a4-3771034ab644 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:09.923578 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8058a41-aab4-4961-b696-f07b839ad817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:09.923578 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8058a41-aab4-4961-b696-f07b839ad817 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:09.923578 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8058a41-aab4-4961-b696-f07b839ad817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:09.923578 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8058a41-aab4-4961-b696-f07b839ad817 admin admin] PATH_INFO: `/v3/projects/fb91910cf43245e1a86eec498c921775/users/45bd55318ab54a72b6f2af850ac0787d/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:09.925035 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8058a41-aab4-4961-b696-f07b839ad817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb91910cf43245e1a86eec498c921775, user_id=45bd55318ab54a72b6f2af850ac0787d, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:09.926907 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8058a41-aab4-4961-b696-f07b839ad817 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:09.938934 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1226/2415] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:15:09 2022] PUT /identity/v3/projects/fb91910cf43245e1a86eec498c921775/users/45bd55318ab54a72b6f2af850ac0787d/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:15:09.950547 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8ff19-4ab6-4491-b8fd-f1aa55fe3e86 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:09.950830 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8ff19-4ab6-4491-b8fd-f1aa55fe3e86 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:09.951107 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8ff19-4ab6-4491-b8fd-f1aa55fe3e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:09.976988 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-89a8ff19-4ab6-4491-b8fd-f1aa55fe3e86 None None] MFA Rules not processed for user `45bd55318ab54a72b6f2af850ac0787d`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:15:09.978180 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-89a8ff19-4ab6-4491-b8fd-f1aa55fe3e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:10.044078 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1190/2416] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:15:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:15:25.593919 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8058a41-aab4-4961-b696-f07b839ad817 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:15:25.595510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d8058a41-aab4-4961-b696-f07b839ad817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:25.667014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8058a41-aab4-4961-b696-f07b839ad817 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:15:25.673343 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51668e32-8fb7-4479-bc3c-68f97bbecc36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:15:25.673977 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51668e32-8fb7-4479-bc3c-68f97bbecc36 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:15:25.674258 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51668e32-8fb7-4479-bc3c-68f97bbecc36 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:15:25.674536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51668e32-8fb7-4479-bc3c-68f97bbecc36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:15:25.676297 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-51668e32-8fb7-4479-bc3c-68f97bbecc36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:15:25.741432 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51668e32-8fb7-4479-bc3c-68f97bbecc36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:15:25.742984 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51668e32-8fb7-4479-bc3c-68f97bbecc36 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:15:25.760368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1227/2417] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:15:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:16:26.855995 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8ff19-4ab6-4491-b8fd-f1aa55fe3e86 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:16:26.857494 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-89a8ff19-4ab6-4491-b8fd-f1aa55fe3e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:16:26.926033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8ff19-4ab6-4491-b8fd-f1aa55fe3e86 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:16:26.929728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad5d74-2217-434b-a008-e60bcca67b23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:16:26.930563 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad5d74-2217-434b-a008-e60bcca67b23 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:16:26.930670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad5d74-2217-434b-a008-e60bcca67b23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:16:26.930896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad5d74-2217-434b-a008-e60bcca67b23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:16:26.941882 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad5d74-2217-434b-a008-e60bcca67b23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:16:26.942622 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad5d74-2217-434b-a008-e60bcca67b23 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:16:26.954323 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1191/2418] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:16:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:16:27.222697 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51668e32-8fb7-4479-bc3c-68f97bbecc36 service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:16:27.235724 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51668e32-8fb7-4479-bc3c-68f97bbecc36 service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:16:27.239638 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f1964-b70d-4fee-97d3-c0eebea3bb80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:16:27.240952 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f1964-b70d-4fee-97d3-c0eebea3bb80 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:16:27.247789 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f1964-b70d-4fee-97d3-c0eebea3bb80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:16:27.248451 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f1964-b70d-4fee-97d3-c0eebea3bb80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:16:27.320834 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f1964-b70d-4fee-97d3-c0eebea3bb80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:16:27.322626 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f1964-b70d-4fee-97d3-c0eebea3bb80 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:16:27.333391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1228/2419] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:16:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:16:29.387263 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a6b3a-4366-49f3-b699-1f39ac9aeec4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:16:29.391836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a6b3a-4366-49f3-b699-1f39ac9aeec4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:16:29.391836 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a6b3a-4366-49f3-b699-1f39ac9aeec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:16:29.414136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e90a6b3a-4366-49f3-b699-1f39ac9aeec4 None None] MFA Rules not processed for user `4097ea09148b4093914d1c4796e05df8`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:16:29.415331 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e90a6b3a-4366-49f3-b699-1f39ac9aeec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:16:29.423091 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1192/2420] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:16:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:16:29.711000 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f1964-b70d-4fee-97d3-c0eebea3bb80 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:16:29.712423 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3c1f1964-b70d-4fee-97d3-c0eebea3bb80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:16:29.768235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f1964-b70d-4fee-97d3-c0eebea3bb80 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:16:29.772099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f965e-e4a7-40ff-9b8c-f40d44b27bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:16:29.772747 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f965e-e4a7-40ff-9b8c-f40d44b27bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:16:29.773028 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f965e-e4a7-40ff-9b8c-f40d44b27bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:16:29.773359 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f965e-e4a7-40ff-9b8c-f40d44b27bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:16:29.775260 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ce7f965e-e4a7-40ff-9b8c-f40d44b27bd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:16:29.784930 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f965e-e4a7-40ff-9b8c-f40d44b27bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:16:29.786347 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f965e-e4a7-40ff-9b8c-f40d44b27bd0 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:16:29.794777 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1229/2421] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:16:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:16:30.309775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a6b3a-4366-49f3-b699-1f39ac9aeec4 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:16:30.311592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e90a6b3a-4366-49f3-b699-1f39ac9aeec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:16:30.381070 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a6b3a-4366-49f3-b699-1f39ac9aeec4 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:16:30.385953 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7709e-0391-43a0-aeb8-f3116f975527 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d2edf68b1b440097981097699bb307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:16:30.386591 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7709e-0391-43a0-aeb8-f3116f975527 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:16:30.386868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7709e-0391-43a0-aeb8-f3116f975527 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:16:30.387137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7709e-0391-43a0-aeb8-f3116f975527 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:16:30.389397 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-48e7709e-0391-43a0-aeb8-f3116f975527 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:16:30.400264 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7709e-0391-43a0-aeb8-f3116f975527 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:16:30.401808 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7709e-0391-43a0-aeb8-f3116f975527 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:16:30.411962 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1193/2422] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:16:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:16:37.906768 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f965e-e4a7-40ff-9b8c-f40d44b27bd0 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:16:37.919484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f965e-e4a7-40ff-9b8c-f40d44b27bd0 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:16:37.925830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c0f63-5cb2-412e-9f91-35b2129c93c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:16:37.926464 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c0f63-5cb2-412e-9f91-35b2129c93c9 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:16:37.926742 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c0f63-5cb2-412e-9f91-35b2129c93c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:16:37.927011 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c0f63-5cb2-412e-9f91-35b2129c93c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:16:37.928775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-189c0f63-5cb2-412e-9f91-35b2129c93c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:16:37.941099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c0f63-5cb2-412e-9f91-35b2129c93c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:16:37.942687 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c0f63-5cb2-412e-9f91-35b2129c93c9 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:16:37.953053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1230/2423] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:16:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:16:42.005717 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7709e-0391-43a0-aeb8-f3116f975527 service placement] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:16:42.007116 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-48e7709e-0391-43a0-aeb8-f3116f975527 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:16:42.022395 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7709e-0391-43a0-aeb8-f3116f975527 service placement] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:16:42.027922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c4ca3-bfc3-407c-883d-a5f31035a677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:16:42.028560 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c4ca3-bfc3-407c-883d-a5f31035a677 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:16:42.028841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c4ca3-bfc3-407c-883d-a5f31035a677 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:16:42.029113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c4ca3-bfc3-407c-883d-a5f31035a677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:16:42.031047 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-037c4ca3-bfc3-407c-883d-a5f31035a677 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:16:42.043097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c4ca3-bfc3-407c-883d-a5f31035a677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:16:42.044721 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c4ca3-bfc3-407c-883d-a5f31035a677 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:16:42.055591 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1194/2424] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:16:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:17:21.409231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c0f63-5cb2-412e-9f91-35b2129c93c9 service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:17:21.418349 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c0f63-5cb2-412e-9f91-35b2129c93c9 service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:17:21.422414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a07512-26c9-4e5c-875b-679bfc9a9bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:17:21.423526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a07512-26c9-4e5c-875b-679bfc9a9bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:17:21.423843 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a07512-26c9-4e5c-875b-679bfc9a9bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:17:21.424114 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a07512-26c9-4e5c-875b-679bfc9a9bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:17:21.425873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-10a07512-26c9-4e5c-875b-679bfc9a9bb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:17:21.446047 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a07512-26c9-4e5c-875b-679bfc9a9bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:17:21.447447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a07512-26c9-4e5c-875b-679bfc9a9bb6 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:17:21.467071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1231/2425] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:17:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:17:25.058250 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c4ca3-bfc3-407c-883d-a5f31035a677 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:17:25.075971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c4ca3-bfc3-407c-883d-a5f31035a677 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:17:25.080088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520948f7-9a86-4ca3-ad53-f23ba72ac7ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:17:25.080731 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520948f7-9a86-4ca3-ad53-f23ba72ac7ec service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:17:25.080990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520948f7-9a86-4ca3-ad53-f23ba72ac7ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:17:25.081265 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520948f7-9a86-4ca3-ad53-f23ba72ac7ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:17:25.083020 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-520948f7-9a86-4ca3-ad53-f23ba72ac7ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:17:25.116950 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520948f7-9a86-4ca3-ad53-f23ba72ac7ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:17:25.118356 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520948f7-9a86-4ca3-ad53-f23ba72ac7ec service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:17:25.128837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1195/2426] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:17:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:17:25.807226 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a07512-26c9-4e5c-875b-679bfc9a9bb6 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:17:25.818771 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a07512-26c9-4e5c-875b-679bfc9a9bb6 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:17:25.824165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339416b3-036e-4e9c-809a-6b16efeacb10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:17:25.824797 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339416b3-036e-4e9c-809a-6b16efeacb10 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:17:25.825074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339416b3-036e-4e9c-809a-6b16efeacb10 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:17:25.825407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339416b3-036e-4e9c-809a-6b16efeacb10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:17:25.827130 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-339416b3-036e-4e9c-809a-6b16efeacb10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:17:25.893118 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339416b3-036e-4e9c-809a-6b16efeacb10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:17:25.894700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339416b3-036e-4e9c-809a-6b16efeacb10 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:17:25.903505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1232/2427] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:17:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:17:26.254920 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520948f7-9a86-4ca3-ad53-f23ba72ac7ec service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:17:26.266027 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520948f7-9a86-4ca3-ad53-f23ba72ac7ec service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:17:26.271487 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e3813-24ab-4c32-8555-122962f81212 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:17:26.272169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e3813-24ab-4c32-8555-122962f81212 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:17:26.272459 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e3813-24ab-4c32-8555-122962f81212 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:17:26.272733 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e3813-24ab-4c32-8555-122962f81212 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:17:26.274490 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e96e3813-24ab-4c32-8555-122962f81212 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:17:26.338960 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e3813-24ab-4c32-8555-122962f81212 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:17:26.340653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e3813-24ab-4c32-8555-122962f81212 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:17:26.358498 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1196/2428] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:17:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:18:08.373201 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339416b3-036e-4e9c-809a-6b16efeacb10 service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:18:08.374708 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-339416b3-036e-4e9c-809a-6b16efeacb10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:18:08.398274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339416b3-036e-4e9c-809a-6b16efeacb10 service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:18:08.401831 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3929a-6fcc-4ac9-8107-9b8f6a98cd28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:18:08.402458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3929a-6fcc-4ac9-8107-9b8f6a98cd28 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:18:08.402738 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3929a-6fcc-4ac9-8107-9b8f6a98cd28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:18:08.403009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3929a-6fcc-4ac9-8107-9b8f6a98cd28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:18:08.404769 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-49d3929a-6fcc-4ac9-8107-9b8f6a98cd28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:18:08.414453 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3929a-6fcc-4ac9-8107-9b8f6a98cd28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:18:08.415892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3929a-6fcc-4ac9-8107-9b8f6a98cd28 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:18:08.423840 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1233/2429] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:18:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:19:08.406190 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e3813-24ab-4c32-8555-122962f81212 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:19:08.407647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e96e3813-24ab-4c32-8555-122962f81212 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:19:08.432721 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e3813-24ab-4c32-8555-122962f81212 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:19:08.436300 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fd52b-8d6b-46c1-aad3-1a398e016cf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:19:08.437432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fd52b-8d6b-46c1-aad3-1a398e016cf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:19:08.437710 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fd52b-8d6b-46c1-aad3-1a398e016cf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:19:08.437982 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fd52b-8d6b-46c1-aad3-1a398e016cf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:19:08.439755 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6b9fd52b-8d6b-46c1-aad3-1a398e016cf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:19:08.500747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fd52b-8d6b-46c1-aad3-1a398e016cf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:19:08.502207 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fd52b-8d6b-46c1-aad3-1a398e016cf7 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:19:08.512501 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1197/2430] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:19:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:19:25.926084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3929a-6fcc-4ac9-8107-9b8f6a98cd28 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:19:25.934463 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3929a-6fcc-4ac9-8107-9b8f6a98cd28 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:19:25.938796 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74083f31-1bf2-4a30-a2fa-a7cefc4336e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:19:25.939435 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74083f31-1bf2-4a30-a2fa-a7cefc4336e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:19:25.939742 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74083f31-1bf2-4a30-a2fa-a7cefc4336e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:19:25.940024 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74083f31-1bf2-4a30-a2fa-a7cefc4336e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:19:25.941830 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-74083f31-1bf2-4a30-a2fa-a7cefc4336e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:19:26.010479 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74083f31-1bf2-4a30-a2fa-a7cefc4336e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:19:26.011939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74083f31-1bf2-4a30-a2fa-a7cefc4336e5 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:19:26.020918 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1234/2431] 10.222.0.25 () {60 vars in 1396 bytes} [Thu May 12 07:19:25 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:20:04.654054 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fd52b-8d6b-46c1-aad3-1a398e016cf7 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:20:04.666364 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fd52b-8d6b-46c1-aad3-1a398e016cf7 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:20:04.672609 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bca8d-b5ed-499c-b9a0-626cabab5401 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d2edf68b1b440097981097699bb307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:20:04.674897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bca8d-b5ed-499c-b9a0-626cabab5401 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:20:04.674897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bca8d-b5ed-499c-b9a0-626cabab5401 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:20:04.674897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bca8d-b5ed-499c-b9a0-626cabab5401 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:20:04.675589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b53bca8d-b5ed-499c-b9a0-626cabab5401 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:20:04.701368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bca8d-b5ed-499c-b9a0-626cabab5401 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:20:04.702967 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bca8d-b5ed-499c-b9a0-626cabab5401 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:20:04.713209 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1198/2432] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:20:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:20:27.863255 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74083f31-1bf2-4a30-a2fa-a7cefc4336e5 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:20:27.873104 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74083f31-1bf2-4a30-a2fa-a7cefc4336e5 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:20:27.876790 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288249d2-42cf-48ff-90cc-778a10246266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:20:27.877482 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288249d2-42cf-48ff-90cc-778a10246266 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:20:27.877762 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288249d2-42cf-48ff-90cc-778a10246266 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:20:27.878036 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288249d2-42cf-48ff-90cc-778a10246266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:20:27.886506 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288249d2-42cf-48ff-90cc-778a10246266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:20:27.888588 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288249d2-42cf-48ff-90cc-778a10246266 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:20:27.897383 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1235/2433] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:20:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:21:10.012898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd07449-0ca1-42eb-a50f-d3367fef666a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:21:10.014034 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd07449-0ca1-42eb-a50f-d3367fef666a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:21:10.014374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd07449-0ca1-42eb-a50f-d3367fef666a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:21:10.044695 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-fbd07449-0ca1-42eb-a50f-d3367fef666a None None] MFA Rules not processed for user `9f11c63feb0740aeb5283907c8b61680`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:21:10.046282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fbd07449-0ca1-42eb-a50f-d3367fef666a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:21:10.054023 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1199/2434] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:21:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:21:10.397950 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288249d2-42cf-48ff-90cc-778a10246266 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:21:10.407466 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288249d2-42cf-48ff-90cc-778a10246266 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:21:10.411224 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ef3f2-01d8-491d-ba47-a145b7001f5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:21:10.411900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ef3f2-01d8-491d-ba47-a145b7001f5d service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:21:10.412188 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ef3f2-01d8-491d-ba47-a145b7001f5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:21:10.412465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ef3f2-01d8-491d-ba47-a145b7001f5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:21:10.414275 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a90ef3f2-01d8-491d-ba47-a145b7001f5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:21:10.424619 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ef3f2-01d8-491d-ba47-a145b7001f5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:21:10.426085 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ef3f2-01d8-491d-ba47-a145b7001f5d service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:21:10.434497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1236/2435] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:21:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:21:14.296428 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd07449-0ca1-42eb-a50f-d3367fef666a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:21:14.315084 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd07449-0ca1-42eb-a50f-d3367fef666a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:21:14.321036 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948e6eb-cb8a-43aa-ae07-14baf3c21f56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:21:14.321702 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948e6eb-cb8a-43aa-ae07-14baf3c21f56 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:21:14.321989 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948e6eb-cb8a-43aa-ae07-14baf3c21f56 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:21:14.322292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948e6eb-cb8a-43aa-ae07-14baf3c21f56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:21:14.324792 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3948e6eb-cb8a-43aa-ae07-14baf3c21f56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:21:14.337683 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948e6eb-cb8a-43aa-ae07-14baf3c21f56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:21:14.339317 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948e6eb-cb8a-43aa-ae07-14baf3c21f56 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:21:14.351004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1200/2436] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:21:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:22:23.517096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ef3f2-01d8-491d-ba47-a145b7001f5d service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:22:23.525393 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ef3f2-01d8-491d-ba47-a145b7001f5d service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:22:23.528896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf65e6-febc-4e35-8638-00202fb1fc72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:22:23.529523 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf65e6-febc-4e35-8638-00202fb1fc72 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:22:23.529799 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf65e6-febc-4e35-8638-00202fb1fc72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:22:23.530068 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf65e6-febc-4e35-8638-00202fb1fc72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:22:23.539925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf65e6-febc-4e35-8638-00202fb1fc72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:22:23.541324 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf65e6-febc-4e35-8638-00202fb1fc72 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:22:23.552499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1237/2437] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:22:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:22:24.717529 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948e6eb-cb8a-43aa-ae07-14baf3c21f56 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:22:24.726680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948e6eb-cb8a-43aa-ae07-14baf3c21f56 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:22:24.730228 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e05e64-c53c-46ba-b529-ab2afdab9ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:22:24.730856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e05e64-c53c-46ba-b529-ab2afdab9ddc service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:22:24.731134 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e05e64-c53c-46ba-b529-ab2afdab9ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:22:24.731403 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e05e64-c53c-46ba-b529-ab2afdab9ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:22:24.741383 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e05e64-c53c-46ba-b529-ab2afdab9ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:22:24.742787 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e05e64-c53c-46ba-b529-ab2afdab9ddc service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:22:24.753957 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1201/2438] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:22:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:22:27.931525 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf65e6-febc-4e35-8638-00202fb1fc72 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:22:27.941003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf65e6-febc-4e35-8638-00202fb1fc72 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:22:27.944664 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81555fc-6f91-432f-9471-0214fa32dafb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:22:27.945301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81555fc-6f91-432f-9471-0214fa32dafb service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:22:27.945586 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81555fc-6f91-432f-9471-0214fa32dafb service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:22:27.945862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81555fc-6f91-432f-9471-0214fa32dafb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:22:27.954491 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81555fc-6f91-432f-9471-0214fa32dafb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:22:27.955947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81555fc-6f91-432f-9471-0214fa32dafb service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:22:27.965798 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1238/2439] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:22:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:22:28.447885 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e05e64-c53c-46ba-b529-ab2afdab9ddc service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:22:28.457106 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e05e64-c53c-46ba-b529-ab2afdab9ddc service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:22:28.460737 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0df1b-3e38-41a5-826e-69853a381f35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:22:28.461399 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0df1b-3e38-41a5-826e-69853a381f35 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:22:28.461676 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0df1b-3e38-41a5-826e-69853a381f35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:22:28.461945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0df1b-3e38-41a5-826e-69853a381f35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:22:28.471256 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0df1b-3e38-41a5-826e-69853a381f35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:22:28.472712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0df1b-3e38-41a5-826e-69853a381f35 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:22:28.483115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1202/2440] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:22:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:22:57.289607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81555fc-6f91-432f-9471-0214fa32dafb service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:22:57.302510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81555fc-6f91-432f-9471-0214fa32dafb service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:22:57.307907 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81a4a8-c35c-40b5-afbc-cd2c9e586e8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:22:57.308546 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81a4a8-c35c-40b5-afbc-cd2c9e586e8a service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:22:57.308827 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81a4a8-c35c-40b5-afbc-cd2c9e586e8a service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:22:57.309099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81a4a8-c35c-40b5-afbc-cd2c9e586e8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:22:57.317357 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81a4a8-c35c-40b5-afbc-cd2c9e586e8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:22:57.318936 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81a4a8-c35c-40b5-afbc-cd2c9e586e8a service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:22:57.347489 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1239/2441] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:22:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:23:12.377858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0df1b-3e38-41a5-826e-69853a381f35 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:23:12.387615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0df1b-3e38-41a5-826e-69853a381f35 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:23:12.391207 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f2a60-3d5b-4d07-9569-25a046eed2c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:23:12.391941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f2a60-3d5b-4d07-9569-25a046eed2c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:23:12.392221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f2a60-3d5b-4d07-9569-25a046eed2c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:23:12.392490 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f2a60-3d5b-4d07-9569-25a046eed2c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:23:12.400473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f2a60-3d5b-4d07-9569-25a046eed2c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:23:12.401883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f2a60-3d5b-4d07-9569-25a046eed2c1 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:23:12.409976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1203/2442] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:23:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:24:26.971766 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81a4a8-c35c-40b5-afbc-cd2c9e586e8a service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:24:26.982889 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81a4a8-c35c-40b5-afbc-cd2c9e586e8a service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:24:26.988418 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c57514-2a08-4530-9aca-ba4812e18964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:24:26.989062 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c57514-2a08-4530-9aca-ba4812e18964 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:24:26.989347 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c57514-2a08-4530-9aca-ba4812e18964 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:24:26.989620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c57514-2a08-4530-9aca-ba4812e18964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:24:26.998135 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c57514-2a08-4530-9aca-ba4812e18964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:24:26.999710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c57514-2a08-4530-9aca-ba4812e18964 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:24:27.026051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1240/2443] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:24:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:25:06.656842 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f2a60-3d5b-4d07-9569-25a046eed2c1 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:25:06.714932 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f2a60-3d5b-4d07-9569-25a046eed2c1 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:25:06.720010 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760881f4-8e3a-47cf-ba4e-9cf58b5a88f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d2edf68b1b440097981097699bb307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:25:06.720647 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760881f4-8e3a-47cf-ba4e-9cf58b5a88f8 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:25:06.720926 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760881f4-8e3a-47cf-ba4e-9cf58b5a88f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:25:06.721195 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760881f4-8e3a-47cf-ba4e-9cf58b5a88f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:25:06.730042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760881f4-8e3a-47cf-ba4e-9cf58b5a88f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:25:06.731645 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760881f4-8e3a-47cf-ba4e-9cf58b5a88f8 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:25:06.741176 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1204/2444] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:25:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:25:11.017883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c57514-2a08-4530-9aca-ba4812e18964 service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:25:11.037801 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c57514-2a08-4530-9aca-ba4812e18964 service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:25:11.042159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be5af3-a121-4acf-a8d0-1a906c6ae861 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:25:11.042796 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be5af3-a121-4acf-a8d0-1a906c6ae861 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:25:11.043075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be5af3-a121-4acf-a8d0-1a906c6ae861 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:25:11.043346 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be5af3-a121-4acf-a8d0-1a906c6ae861 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:25:11.052186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be5af3-a121-4acf-a8d0-1a906c6ae861 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:25:11.054165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be5af3-a121-4acf-a8d0-1a906c6ae861 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:25:11.080604 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1241/2445] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:25:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:25:11.167455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760881f4-8e3a-47cf-ba4e-9cf58b5a88f8 service placement] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:25:11.182052 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760881f4-8e3a-47cf-ba4e-9cf58b5a88f8 service placement] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:25:11.188972 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a360583-6e04-4518-9b04-8e8c60a9d00c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:25:11.189663 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a360583-6e04-4518-9b04-8e8c60a9d00c service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:25:11.190143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a360583-6e04-4518-9b04-8e8c60a9d00c service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:25:11.190665 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a360583-6e04-4518-9b04-8e8c60a9d00c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:25:11.200635 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a360583-6e04-4518-9b04-8e8c60a9d00c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:25:11.202953 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a360583-6e04-4518-9b04-8e8c60a9d00c service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:25:11.215384 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1205/2446] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:25:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:26:27.087261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be5af3-a121-4acf-a8d0-1a906c6ae861 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:27.089061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-16be5af3-a121-4acf-a8d0-1a906c6ae861 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:27.152272 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be5af3-a121-4acf-a8d0-1a906c6ae861 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:27.155911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1eed6-c870-4867-8794-5fef97e68956 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:27.156575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1eed6-c870-4867-8794-5fef97e68956 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:27.156910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1eed6-c870-4867-8794-5fef97e68956 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:27.157177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1eed6-c870-4867-8794-5fef97e68956 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:27.159031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c7f1eed6-c870-4867-8794-5fef97e68956 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:27.204071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a360583-6e04-4518-9b04-8e8c60a9d00c service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:27.214063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a360583-6e04-4518-9b04-8e8c60a9d00c service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:27.218795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bba16e-30fa-4aa3-8e4b-32ea77f6a4e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:27.218795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bba16e-30fa-4aa3-8e4b-32ea77f6a4e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:27.218795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bba16e-30fa-4aa3-8e4b-32ea77f6a4e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:27.219166 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bba16e-30fa-4aa3-8e4b-32ea77f6a4e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:27.220752 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a3bba16e-30fa-4aa3-8e4b-32ea77f6a4e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:27.246864 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1eed6-c870-4867-8794-5fef97e68956 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:27.246864 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1eed6-c870-4867-8794-5fef97e68956 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:27.270213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1242/2447] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:26:27.281516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bba16e-30fa-4aa3-8e4b-32ea77f6a4e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:27.282953 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bba16e-30fa-4aa3-8e4b-32ea77f6a4e2 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:27.293171 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1206/2448] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:26:28.014391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1eed6-c870-4867-8794-5fef97e68956 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:28.026732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1eed6-c870-4867-8794-5fef97e68956 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:28.031331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534a643-fc0c-4dfa-a169-3a7e41e40560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:28.032668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534a643-fc0c-4dfa-a169-3a7e41e40560 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:28.033766 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534a643-fc0c-4dfa-a169-3a7e41e40560 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:28.034230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534a643-fc0c-4dfa-a169-3a7e41e40560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:28.040758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7534a643-fc0c-4dfa-a169-3a7e41e40560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:28.125484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534a643-fc0c-4dfa-a169-3a7e41e40560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:28.126922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534a643-fc0c-4dfa-a169-3a7e41e40560 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:28.146155 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1243/2449] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:26:28.173837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bba16e-30fa-4aa3-8e4b-32ea77f6a4e2 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:28.175543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a3bba16e-30fa-4aa3-8e4b-32ea77f6a4e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:28.191024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bba16e-30fa-4aa3-8e4b-32ea77f6a4e2 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:28.195987 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411171fc-89a4-40f8-8716-c9fc235128b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:28.196855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411171fc-89a4-40f8-8716-c9fc235128b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:28.197215 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411171fc-89a4-40f8-8716-c9fc235128b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:28.197493 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411171fc-89a4-40f8-8716-c9fc235128b9 admin admin] PATH_INFO: `/v3/users/5c5441d2e6a34ebca9ef5c17408b95e9` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:28.212187 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411171fc-89a4-40f8-8716-c9fc235128b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c5441d2e6a34ebca9ef5c17408b95e9)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:28.214831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411171fc-89a4-40f8-8716-c9fc235128b9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:28.394522 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-411171fc-89a4-40f8-8716-c9fc235128b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c5441d2e6a34ebca9ef5c17408b95e9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:28.395226 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-411171fc-89a4-40f8-8716-c9fc235128b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c5441d2e6a34ebca9ef5c17408b95e9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:28.436180 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-411171fc-89a4-40f8-8716-c9fc235128b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c5441d2e6a34ebca9ef5c17408b95e9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:28.437667 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-411171fc-89a4-40f8-8716-c9fc235128b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c5441d2e6a34ebca9ef5c17408b95e9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:28.450671 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-411171fc-89a4-40f8-8716-c9fc235128b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c5441d2e6a34ebca9ef5c17408b95e9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:28.564741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1207/2450] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:26:28 2022] DELETE /identity/v3/users/5c5441d2e6a34ebca9ef5c17408b95e9 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:28.569460 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03798482-0337-4dd6-8cf2-a7a56306fa57 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:28.569849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03798482-0337-4dd6-8cf2-a7a56306fa57 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:28.570205 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03798482-0337-4dd6-8cf2-a7a56306fa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:28.598021 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-03798482-0337-4dd6-8cf2-a7a56306fa57 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:28.599342 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-03798482-0337-4dd6-8cf2-a7a56306fa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:28.663714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1244/2451] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:28.676571 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411171fc-89a4-40f8-8716-c9fc235128b9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:28.680472 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-411171fc-89a4-40f8-8716-c9fc235128b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:28.768622 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411171fc-89a4-40f8-8716-c9fc235128b9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:28.775723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dac27e-ab3f-43e9-85bf-77647381ebd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:28.776939 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dac27e-ab3f-43e9-85bf-77647381ebd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:28.778096 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dac27e-ab3f-43e9-85bf-77647381ebd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:28.778096 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dac27e-ab3f-43e9-85bf-77647381ebd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:28.802008 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03798482-0337-4dd6-8cf2-a7a56306fa57 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:28.806395 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dac27e-ab3f-43e9-85bf-77647381ebd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:28.812259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dac27e-ab3f-43e9-85bf-77647381ebd1 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:28.814694 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03798482-0337-4dd6-8cf2-a7a56306fa57 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:28.819369 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee32045-6f55-4475-8005-71739cb92d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:28.825647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee32045-6f55-4475-8005-71739cb92d6e service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:28.825647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee32045-6f55-4475-8005-71739cb92d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:28.825647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee32045-6f55-4475-8005-71739cb92d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:28.825647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fee32045-6f55-4475-8005-71739cb92d6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:28.844894 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1208/2452] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:26:28.872839 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee32045-6f55-4475-8005-71739cb92d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:28.879981 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee32045-6f55-4475-8005-71739cb92d6e service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:28.894852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1245/2453] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:26:29.109594 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dac27e-ab3f-43e9-85bf-77647381ebd1 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:29.111128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a2dac27e-ab3f-43e9-85bf-77647381ebd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:29.122093 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dac27e-ab3f-43e9-85bf-77647381ebd1 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:29.125795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70205f9-36b9-4ae5-b709-cb27cf4e91fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:29.126435 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70205f9-36b9-4ae5-b709-cb27cf4e91fb service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:29.126715 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70205f9-36b9-4ae5-b709-cb27cf4e91fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:29.127020 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70205f9-36b9-4ae5-b709-cb27cf4e91fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:29.128800 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c70205f9-36b9-4ae5-b709-cb27cf4e91fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:29.143187 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70205f9-36b9-4ae5-b709-cb27cf4e91fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:29.144669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70205f9-36b9-4ae5-b709-cb27cf4e91fb service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:29.156077 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1209/2454] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:26:29.307390 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee32045-6f55-4475-8005-71739cb92d6e service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:29.309122 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fee32045-6f55-4475-8005-71739cb92d6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:29.443342 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee32045-6f55-4475-8005-71739cb92d6e service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:29.450199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c59ce4-fb7f-4f5a-9459-41c6b535fa84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:29.450865 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c59ce4-fb7f-4f5a-9459-41c6b535fa84 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:29.451409 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c59ce4-fb7f-4f5a-9459-41c6b535fa84 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:29.451787 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c59ce4-fb7f-4f5a-9459-41c6b535fa84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:29.453676 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-28c59ce4-fb7f-4f5a-9459-41c6b535fa84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:29.468213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c59ce4-fb7f-4f5a-9459-41c6b535fa84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:29.469904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c59ce4-fb7f-4f5a-9459-41c6b535fa84 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:29.483005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1246/2455] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:26:29.660659 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70205f9-36b9-4ae5-b709-cb27cf4e91fb service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:29.664180 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c70205f9-36b9-4ae5-b709-cb27cf4e91fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:29.691738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70205f9-36b9-4ae5-b709-cb27cf4e91fb service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:29.707326 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860f0fb-5d31-4baf-8234-dec8515a6203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:29.708980 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860f0fb-5d31-4baf-8234-dec8515a6203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:29.709459 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860f0fb-5d31-4baf-8234-dec8515a6203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:29.709912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860f0fb-5d31-4baf-8234-dec8515a6203 admin admin] PATH_INFO: `/v3/projects/a88ac006d21c49c99c5fefabce9bc149` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:29.729567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860f0fb-5d31-4baf-8234-dec8515a6203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a88ac006d21c49c99c5fefabce9bc149)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:29.729567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860f0fb-5d31-4baf-8234-dec8515a6203 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:29.877687 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6860f0fb-5d31-4baf-8234-dec8515a6203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a88ac006d21c49c99c5fefabce9bc149', 'request_id': 'req-6860f0fb-5d31-4baf-8234-dec8515a6203'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:29.951977 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6860f0fb-5d31-4baf-8234-dec8515a6203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a88ac006d21c49c99c5fefabce9bc149', 'request_id': 'req-6860f0fb-5d31-4baf-8234-dec8515a6203'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:29.965135 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6860f0fb-5d31-4baf-8234-dec8515a6203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a88ac006d21c49c99c5fefabce9bc149', 'request_id': 'req-6860f0fb-5d31-4baf-8234-dec8515a6203'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:29.978849 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6860f0fb-5d31-4baf-8234-dec8515a6203 admin admin] The token cache is being invalidate because project a88ac006d21c49c99c5fefabce9bc149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:26:29.979746 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6860f0fb-5d31-4baf-8234-dec8515a6203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:29.980589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6860f0fb-5d31-4baf-8234-dec8515a6203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:29.982689 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1210/2456] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:26:29 2022] DELETE /identity/v3/projects/a88ac006d21c49c99c5fefabce9bc149 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:29.986359 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c59ce4-fb7f-4f5a-9459-41c6b535fa84 service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:29.999401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c59ce4-fb7f-4f5a-9459-41c6b535fa84 service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:30.070841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a24280-7334-438a-96ad-29387daa271f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:30.072034 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a24280-7334-438a-96ad-29387daa271f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:30.072527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a24280-7334-438a-96ad-29387daa271f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:30.072993 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a24280-7334-438a-96ad-29387daa271f admin admin] PATH_INFO: `/v3/users/45bd55318ab54a72b6f2af850ac0787d` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:30.090659 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a24280-7334-438a-96ad-29387daa271f admin admin] RBAC: Authorizing `identity:delete_user(user_id=45bd55318ab54a72b6f2af850ac0787d)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:30.093319 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a24280-7334-438a-96ad-29387daa271f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:30.351502 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-60a24280-7334-438a-96ad-29387daa271f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45bd55318ab54a72b6f2af850ac0787d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:30.352414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-60a24280-7334-438a-96ad-29387daa271f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45bd55318ab54a72b6f2af850ac0787d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:30.353273 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-60a24280-7334-438a-96ad-29387daa271f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45bd55318ab54a72b6f2af850ac0787d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:30.367942 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-60a24280-7334-438a-96ad-29387daa271f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45bd55318ab54a72b6f2af850ac0787d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:30.375908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-60a24280-7334-438a-96ad-29387daa271f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45bd55318ab54a72b6f2af850ac0787d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:30.436692 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1247/2457] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:26:29 2022] DELETE /identity/v3/users/45bd55318ab54a72b6f2af850ac0787d => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:31.281245 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860f0fb-5d31-4baf-8234-dec8515a6203 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:31.282734 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6860f0fb-5d31-4baf-8234-dec8515a6203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:31.306445 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860f0fb-5d31-4baf-8234-dec8515a6203 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:31.421038 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfe26a-71c2-47c9-bdf8-1e42aefe6e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:31.423360 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfe26a-71c2-47c9-bdf8-1e42aefe6e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:31.424210 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfe26a-71c2-47c9-bdf8-1e42aefe6e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:31.424732 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfe26a-71c2-47c9-bdf8-1e42aefe6e97 admin admin] PATH_INFO: `/v3/projects/fb91910cf43245e1a86eec498c921775` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:31.440952 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfe26a-71c2-47c9-bdf8-1e42aefe6e97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb91910cf43245e1a86eec498c921775)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:31.443081 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfe26a-71c2-47c9-bdf8-1e42aefe6e97 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:31.593813 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dadfe26a-71c2-47c9-bdf8-1e42aefe6e97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb91910cf43245e1a86eec498c921775', 'request_id': 'req-dadfe26a-71c2-47c9-bdf8-1e42aefe6e97'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:31.685216 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dadfe26a-71c2-47c9-bdf8-1e42aefe6e97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb91910cf43245e1a86eec498c921775', 'request_id': 'req-dadfe26a-71c2-47c9-bdf8-1e42aefe6e97'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:31.692543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dadfe26a-71c2-47c9-bdf8-1e42aefe6e97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb91910cf43245e1a86eec498c921775', 'request_id': 'req-dadfe26a-71c2-47c9-bdf8-1e42aefe6e97'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:31.719121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dadfe26a-71c2-47c9-bdf8-1e42aefe6e97 admin admin] The token cache is being invalidate because project fb91910cf43245e1a86eec498c921775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:26:31.719722 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dadfe26a-71c2-47c9-bdf8-1e42aefe6e97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:31.720896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dadfe26a-71c2-47c9-bdf8-1e42aefe6e97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:31.726024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1211/2458] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:26:31 2022] DELETE /identity/v3/projects/fb91910cf43245e1a86eec498c921775 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:31.731197 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a1b6b-530b-4aa8-a689-ac312f07525f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:31.732286 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a1b6b-530b-4aa8-a689-ac312f07525f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:31.732731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a1b6b-530b-4aa8-a689-ac312f07525f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:31.822311 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d00a1b6b-530b-4aa8-a689-ac312f07525f None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:31.824146 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d00a1b6b-530b-4aa8-a689-ac312f07525f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:31.971553 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1248/2459] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:31.979913 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dd3c1-2c2b-4570-907f-5399a4b109ff None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:31.980472 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dd3c1-2c2b-4570-907f-5399a4b109ff None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:31.980927 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dd3c1-2c2b-4570-907f-5399a4b109ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:32.021064 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-fe3dd3c1-2c2b-4570-907f-5399a4b109ff None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:32.022331 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fe3dd3c1-2c2b-4570-907f-5399a4b109ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:32.043297 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a1b6b-530b-4aa8-a689-ac312f07525f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:32.043974 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1212/2460] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:32.062608 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a1b6b-530b-4aa8-a689-ac312f07525f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:32.069855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bf3d0-a070-43d2-b612-e144a2ba0f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:32.070943 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bf3d0-a070-43d2-b612-e144a2ba0f14 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:32.071445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bf3d0-a070-43d2-b612-e144a2ba0f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:32.071914 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bf3d0-a070-43d2-b612-e144a2ba0f14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:32.073869 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2bf3d0-a070-43d2-b612-e144a2ba0f14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:26:32.074438 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2bf3d0-a070-43d2-b612-e144a2ba0f14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:32.076925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2bf3d0-a070-43d2-b612-e144a2ba0f14 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:32.094069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1249/2461] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:26:32.098292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dd3c1-2c2b-4570-907f-5399a4b109ff None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:32.114895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dd3c1-2c2b-4570-907f-5399a4b109ff None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:32.121510 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e1a48-253e-4e00-81a9-718a45a1ab0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:32.122749 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e1a48-253e-4e00-81a9-718a45a1ab0d admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:32.123671 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e1a48-253e-4e00-81a9-718a45a1ab0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:32.124211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e1a48-253e-4e00-81a9-718a45a1ab0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:32.125174 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e1a48-253e-4e00-81a9-718a45a1ab0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:32.127338 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e1a48-253e-4e00-81a9-718a45a1ab0d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:32.235498 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1213/2462] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:26:32 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:32.235949 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bf3d0-a070-43d2-b612-e144a2ba0f14 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:32.250945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bf3d0-a070-43d2-b612-e144a2ba0f14 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:32.323889 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34821ad7-a800-4faa-a351-1c1f52612657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:32.325138 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34821ad7-a800-4faa-a351-1c1f52612657 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:32.325138 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34821ad7-a800-4faa-a351-1c1f52612657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:32.325138 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34821ad7-a800-4faa-a351-1c1f52612657 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:32.325730 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34821ad7-a800-4faa-a351-1c1f52612657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:32.327654 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34821ad7-a800-4faa-a351-1c1f52612657 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:32.434976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1250/2463] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:26:32 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:32.437095 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e1a48-253e-4e00-81a9-718a45a1ab0d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:32.452246 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e1a48-253e-4e00-81a9-718a45a1ab0d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:32.467146 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede402a-8c7b-4292-818d-d7dbabe4e7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:32.467866 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede402a-8c7b-4292-818d-d7dbabe4e7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:32.468385 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede402a-8c7b-4292-818d-d7dbabe4e7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:32.468878 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede402a-8c7b-4292-818d-d7dbabe4e7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:32.469824 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede402a-8c7b-4292-818d-d7dbabe4e7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:32.471652 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede402a-8c7b-4292-818d-d7dbabe4e7f9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:32.497290 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1214/2464] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:32.501096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34821ad7-a800-4faa-a351-1c1f52612657 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:32.520546 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34821ad7-a800-4faa-a351-1c1f52612657 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:32.528007 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc416099-4c4f-448d-a1e7-26496b502aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:32.533646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc416099-4c4f-448d-a1e7-26496b502aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:32.533646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc416099-4c4f-448d-a1e7-26496b502aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:32.533646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc416099-4c4f-448d-a1e7-26496b502aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:32.533646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc416099-4c4f-448d-a1e7-26496b502aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:32.533646 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc416099-4c4f-448d-a1e7-26496b502aa4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:32.543583 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1251/2465] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:32.548028 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede402a-8c7b-4292-818d-d7dbabe4e7f9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:32.581504 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede402a-8c7b-4292-818d-d7dbabe4e7f9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:32.587477 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa33f9b-d19c-4c82-a31f-e58dc0d10f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:32.588997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa33f9b-d19c-4c82-a31f-e58dc0d10f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:32.589304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa33f9b-d19c-4c82-a31f-e58dc0d10f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:32.590100 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa33f9b-d19c-4c82-a31f-e58dc0d10f50 admin admin] PATH_INFO: `/v3/projects/4dc581fd9a0349eea166bea29a4fa44f/users/0342015060e44a07961c923dd37f075e/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:32.609990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa33f9b-d19c-4c82-a31f-e58dc0d10f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dc581fd9a0349eea166bea29a4fa44f, user_id=0342015060e44a07961c923dd37f075e, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:32.613398 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa33f9b-d19c-4c82-a31f-e58dc0d10f50 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:32.696827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1215/2466] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:32 2022] PUT /identity/v3/projects/4dc581fd9a0349eea166bea29a4fa44f/users/0342015060e44a07961c923dd37f075e/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:32.708982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95511d9f-e315-4eee-8d9a-86078ea97d62 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:32.710250 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95511d9f-e315-4eee-8d9a-86078ea97d62 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:32.710564 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95511d9f-e315-4eee-8d9a-86078ea97d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:32.755356 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-95511d9f-e315-4eee-8d9a-86078ea97d62 None None] MFA Rules not processed for user `0342015060e44a07961c923dd37f075e`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:32.756632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-95511d9f-e315-4eee-8d9a-86078ea97d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:32.874515 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1252/2467] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:32.887038 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa33f9b-d19c-4c82-a31f-e58dc0d10f50 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:32.889095 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8aa33f9b-d19c-4c82-a31f-e58dc0d10f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:32.981014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa33f9b-d19c-4c82-a31f-e58dc0d10f50 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:32.985773 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a0e5c-6a8c-45c9-9978-e422712e10a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:32.986907 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a0e5c-6a8c-45c9-9978-e422712e10a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:32.987376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a0e5c-6a8c-45c9-9978-e422712e10a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:32.987867 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a0e5c-6a8c-45c9-9978-e422712e10a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:32.999914 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a0e5c-6a8c-45c9-9978-e422712e10a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:33.001653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a0e5c-6a8c-45c9-9978-e422712e10a1 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:33.012500 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1216/2468] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:26:33.033650 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95511d9f-e315-4eee-8d9a-86078ea97d62 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:33.123862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95511d9f-e315-4eee-8d9a-86078ea97d62 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:33.129418 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16886a88-2e2d-407a-a29a-b8ff31f11751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:33.130349 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16886a88-2e2d-407a-a29a-b8ff31f11751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:33.130839 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16886a88-2e2d-407a-a29a-b8ff31f11751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:33.131111 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16886a88-2e2d-407a-a29a-b8ff31f11751 admin admin] PATH_INFO: `/v3/users/0342015060e44a07961c923dd37f075e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:33.132559 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16886a88-2e2d-407a-a29a-b8ff31f11751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0342015060e44a07961c923dd37f075e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:33.134466 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16886a88-2e2d-407a-a29a-b8ff31f11751 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:33.371788 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-16886a88-2e2d-407a-a29a-b8ff31f11751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0342015060e44a07961c923dd37f075e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:33.372591 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-16886a88-2e2d-407a-a29a-b8ff31f11751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0342015060e44a07961c923dd37f075e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:33.373193 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-16886a88-2e2d-407a-a29a-b8ff31f11751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0342015060e44a07961c923dd37f075e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:33.394001 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-16886a88-2e2d-407a-a29a-b8ff31f11751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0342015060e44a07961c923dd37f075e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:33.403429 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-16886a88-2e2d-407a-a29a-b8ff31f11751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0342015060e44a07961c923dd37f075e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:33.490074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1253/2469] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:26:33 2022] DELETE /identity/v3/users/0342015060e44a07961c923dd37f075e => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:33.495004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a7ec9-c472-4351-aba1-3ebfa1880d7a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:33.495566 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a7ec9-c472-4351-aba1-3ebfa1880d7a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:33.495658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a7ec9-c472-4351-aba1-3ebfa1880d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:33.521528 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2a1a7ec9-c472-4351-aba1-3ebfa1880d7a None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:33.521528 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2a1a7ec9-c472-4351-aba1-3ebfa1880d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:33.630831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1217/2470] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:33.637321 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16886a88-2e2d-407a-a29a-b8ff31f11751 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:33.639652 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-16886a88-2e2d-407a-a29a-b8ff31f11751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:33.715769 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16886a88-2e2d-407a-a29a-b8ff31f11751 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:33.719517 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165f0ed-220a-46f1-b47b-facdb8647d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:33.720318 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165f0ed-220a-46f1-b47b-facdb8647d9f service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:33.720603 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165f0ed-220a-46f1-b47b-facdb8647d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:33.720878 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165f0ed-220a-46f1-b47b-facdb8647d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:33.730271 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165f0ed-220a-46f1-b47b-facdb8647d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:33.731726 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165f0ed-220a-46f1-b47b-facdb8647d9f service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:33.742311 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1254/2471] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:26:34.292653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a7ec9-c472-4351-aba1-3ebfa1880d7a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:34.296008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2a1a7ec9-c472-4351-aba1-3ebfa1880d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:34.314280 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a7ec9-c472-4351-aba1-3ebfa1880d7a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:34.332107 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a299638-53b4-4408-850c-352b3ab39f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:34.332107 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a299638-53b4-4408-850c-352b3ab39f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:34.332107 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a299638-53b4-4408-850c-352b3ab39f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:34.332107 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a299638-53b4-4408-850c-352b3ab39f6a admin admin] PATH_INFO: `/v3/projects/4dc581fd9a0349eea166bea29a4fa44f` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:34.333104 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a299638-53b4-4408-850c-352b3ab39f6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dc581fd9a0349eea166bea29a4fa44f)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:34.333104 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a299638-53b4-4408-850c-352b3ab39f6a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:34.461718 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5a299638-53b4-4408-850c-352b3ab39f6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dc581fd9a0349eea166bea29a4fa44f', 'request_id': 'req-5a299638-53b4-4408-850c-352b3ab39f6a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:34.519590 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5a299638-53b4-4408-850c-352b3ab39f6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dc581fd9a0349eea166bea29a4fa44f', 'request_id': 'req-5a299638-53b4-4408-850c-352b3ab39f6a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:34.533615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5a299638-53b4-4408-850c-352b3ab39f6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dc581fd9a0349eea166bea29a4fa44f', 'request_id': 'req-5a299638-53b4-4408-850c-352b3ab39f6a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:34.547320 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5a299638-53b4-4408-850c-352b3ab39f6a admin admin] The token cache is being invalidate because project 4dc581fd9a0349eea166bea29a4fa44f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:26:34.547755 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5a299638-53b4-4408-850c-352b3ab39f6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:34.559060 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5a299638-53b4-4408-850c-352b3ab39f6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:34.559060 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1218/2472] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:26:34 2022] DELETE /identity/v3/projects/4dc581fd9a0349eea166bea29a4fa44f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:34.559308 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2473ca-f586-4c11-ac68-3eb4b6de8e93 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:34.559308 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2473ca-f586-4c11-ac68-3eb4b6de8e93 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:34.559308 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2473ca-f586-4c11-ac68-3eb4b6de8e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:34.577414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-9c2473ca-f586-4c11-ac68-3eb4b6de8e93 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:34.579160 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9c2473ca-f586-4c11-ac68-3eb4b6de8e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:34.648555 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1255/2473] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:34.658425 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed27aa-063f-4576-a802-5a33af1facd9 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:34.658785 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed27aa-063f-4576-a802-5a33af1facd9 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:34.659132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed27aa-063f-4576-a802-5a33af1facd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:34.689531 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2473ca-f586-4c11-ac68-3eb4b6de8e93 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:34.690613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3bed27aa-063f-4576-a802-5a33af1facd9 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:34.692039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9c2473ca-f586-4c11-ac68-3eb4b6de8e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:34.695514 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3bed27aa-063f-4576-a802-5a33af1facd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:34.709412 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1219/2474] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:34.710652 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed27aa-063f-4576-a802-5a33af1facd9 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:34.724520 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed27aa-063f-4576-a802-5a33af1facd9 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:34.725660 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2473ca-f586-4c11-ac68-3eb4b6de8e93 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:34.729623 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812e2ef-20ad-464e-bc15-20dbbdea784f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:34.730673 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812e2ef-20ad-464e-bc15-20dbbdea784f admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:34.738751 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812e2ef-20ad-464e-bc15-20dbbdea784f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:34.738751 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812e2ef-20ad-464e-bc15-20dbbdea784f admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:34.739098 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772feff-24d4-4997-8002-2c21fb8bfc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:34.739976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772feff-24d4-4997-8002-2c21fb8bfc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:34.740266 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772feff-24d4-4997-8002-2c21fb8bfc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:34.740722 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772feff-24d4-4997-8002-2c21fb8bfc74 admin admin] PATH_INFO: `/v3/users/9f11c63feb0740aeb5283907c8b61680` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:34.742072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772feff-24d4-4997-8002-2c21fb8bfc74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f11c63feb0740aeb5283907c8b61680)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:34.744118 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772feff-24d4-4997-8002-2c21fb8bfc74 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:34.744720 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812e2ef-20ad-464e-bc15-20dbbdea784f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:26:34.745155 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812e2ef-20ad-464e-bc15-20dbbdea784f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:34.747097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812e2ef-20ad-464e-bc15-20dbbdea784f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:34.762597 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1220/2475] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:26:34.766948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812e2ef-20ad-464e-bc15-20dbbdea784f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:34.779024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812e2ef-20ad-464e-bc15-20dbbdea784f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:34.784487 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce10f34-b1bf-4399-b4a6-7a453e17a7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:34.785346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce10f34-b1bf-4399-b4a6-7a453e17a7fa admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:34.785807 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce10f34-b1bf-4399-b4a6-7a453e17a7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:34.788663 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce10f34-b1bf-4399-b4a6-7a453e17a7fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:34.788663 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce10f34-b1bf-4399-b4a6-7a453e17a7fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:34.789393 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce10f34-b1bf-4399-b4a6-7a453e17a7fa admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:34.897069 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1221/2476] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:26:34 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:34.898228 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce10f34-b1bf-4399-b4a6-7a453e17a7fa admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:34.960718 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce10f34-b1bf-4399-b4a6-7a453e17a7fa admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:34.966417 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12892fa1-0790-4227-9a8a-eb80e0768fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:34.967094 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12892fa1-0790-4227-9a8a-eb80e0768fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:34.967382 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12892fa1-0790-4227-9a8a-eb80e0768fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:34.967659 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12892fa1-0790-4227-9a8a-eb80e0768fd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:34.968451 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12892fa1-0790-4227-9a8a-eb80e0768fd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:34.970508 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12892fa1-0790-4227-9a8a-eb80e0768fd1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:34.988786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5772feff-24d4-4997-8002-2c21fb8bfc74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f11c63feb0740aeb5283907c8b61680'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:34.989691 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5772feff-24d4-4997-8002-2c21fb8bfc74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f11c63feb0740aeb5283907c8b61680'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:34.990471 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5772feff-24d4-4997-8002-2c21fb8bfc74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f11c63feb0740aeb5283907c8b61680'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:35.004186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5772feff-24d4-4997-8002-2c21fb8bfc74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f11c63feb0740aeb5283907c8b61680'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:35.014940 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5772feff-24d4-4997-8002-2c21fb8bfc74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f11c63feb0740aeb5283907c8b61680'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:35.070351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1222/2477] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:26:34 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:35.079878 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12892fa1-0790-4227-9a8a-eb80e0768fd1 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:35.082029 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-12892fa1-0790-4227-9a8a-eb80e0768fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:35.095555 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12892fa1-0790-4227-9a8a-eb80e0768fd1 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:35.100963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91f087-79cb-4e57-8916-5460e4159525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:35.101839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91f087-79cb-4e57-8916-5460e4159525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:35.102109 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91f087-79cb-4e57-8916-5460e4159525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:35.102587 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91f087-79cb-4e57-8916-5460e4159525 admin admin] PATH_INFO: `/v3/users/4097ea09148b4093914d1c4796e05df8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:35.104608 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91f087-79cb-4e57-8916-5460e4159525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4097ea09148b4093914d1c4796e05df8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:35.108910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1256/2478] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:26:34 2022] DELETE /identity/v3/users/9f11c63feb0740aeb5283907c8b61680 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:35.109193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91f087-79cb-4e57-8916-5460e4159525 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:35.109300 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772feff-24d4-4997-8002-2c21fb8bfc74 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:35.109300 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5772feff-24d4-4997-8002-2c21fb8bfc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:35.192577 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772feff-24d4-4997-8002-2c21fb8bfc74 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:35.200908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240685d-7ea3-495a-8714-4c98768fecd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:35.201911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240685d-7ea3-495a-8714-4c98768fecd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:35.202353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240685d-7ea3-495a-8714-4c98768fecd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:35.202793 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240685d-7ea3-495a-8714-4c98768fecd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:35.204401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240685d-7ea3-495a-8714-4c98768fecd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:35.206229 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240685d-7ea3-495a-8714-4c98768fecd6 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:35.223018 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1257/2479] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:35.227078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240685d-7ea3-495a-8714-4c98768fecd6 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:35.240655 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240685d-7ea3-495a-8714-4c98768fecd6 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:35.262667 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b10516-97b4-40b5-ab44-f1014d68dffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:35.262667 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b10516-97b4-40b5-ab44-f1014d68dffa admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:35.262667 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b10516-97b4-40b5-ab44-f1014d68dffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:35.262667 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b10516-97b4-40b5-ab44-f1014d68dffa admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:35.263308 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b10516-97b4-40b5-ab44-f1014d68dffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:35.263308 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b10516-97b4-40b5-ab44-f1014d68dffa admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:35.275452 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1258/2480] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:35.277003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b10516-97b4-40b5-ab44-f1014d68dffa admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:35.293728 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b10516-97b4-40b5-ab44-f1014d68dffa admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:35.302639 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074b2e7-e628-41c7-b104-3c79647e790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:35.304283 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074b2e7-e628-41c7-b104-3c79647e790a admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:35.305396 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074b2e7-e628-41c7-b104-3c79647e790a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:35.305760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074b2e7-e628-41c7-b104-3c79647e790a admin admin] PATH_INFO: `/v3/projects/3981c9e85f7a4e8ebfbbf3f4bebb5c5d/users/ef13c47b8081479885a477550e4a508d/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:35.326198 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074b2e7-e628-41c7-b104-3c79647e790a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3981c9e85f7a4e8ebfbbf3f4bebb5c5d, user_id=ef13c47b8081479885a477550e4a508d, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:35.330446 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074b2e7-e628-41c7-b104-3c79647e790a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:35.355154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fb91f087-79cb-4e57-8916-5460e4159525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4097ea09148b4093914d1c4796e05df8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:35.355893 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fb91f087-79cb-4e57-8916-5460e4159525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4097ea09148b4093914d1c4796e05df8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:35.367424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fb91f087-79cb-4e57-8916-5460e4159525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4097ea09148b4093914d1c4796e05df8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:35.368446 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fb91f087-79cb-4e57-8916-5460e4159525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4097ea09148b4093914d1c4796e05df8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:35.375601 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fb91f087-79cb-4e57-8916-5460e4159525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4097ea09148b4093914d1c4796e05df8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:35.422739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1259/2481] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:35 2022] PUT /identity/v3/projects/3981c9e85f7a4e8ebfbbf3f4bebb5c5d/users/ef13c47b8081479885a477550e4a508d/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:35.433881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76055d4e-73c4-4dd8-b158-23f33f176842 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:35.434168 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76055d4e-73c4-4dd8-b158-23f33f176842 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:35.434446 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76055d4e-73c4-4dd8-b158-23f33f176842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:35.449237 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1223/2482] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:26:35 2022] DELETE /identity/v3/users/4097ea09148b4093914d1c4796e05df8 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:35.454688 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91f087-79cb-4e57-8916-5460e4159525 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:35.454688 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fb91f087-79cb-4e57-8916-5460e4159525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:35.475930 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-76055d4e-73c4-4dd8-b158-23f33f176842 None None] MFA Rules not processed for user `ef13c47b8081479885a477550e4a508d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:35.477374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-76055d4e-73c4-4dd8-b158-23f33f176842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:35.559992 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1260/2483] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:26:35.566977 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76055d4e-73c4-4dd8-b158-23f33f176842 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:35.568481 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-76055d4e-73c4-4dd8-b158-23f33f176842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:35.574164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91f087-79cb-4e57-8916-5460e4159525 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:35.583812 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb2bdc-018a-4191-90ae-4ab04a6ca37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:35.588621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb2bdc-018a-4191-90ae-4ab04a6ca37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:35.588621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb2bdc-018a-4191-90ae-4ab04a6ca37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:35.588621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb2bdc-018a-4191-90ae-4ab04a6ca37f admin admin] PATH_INFO: `/v3/projects/91ccbfb303dc40a7a2313fe5e6ab3332` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:35.588621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb2bdc-018a-4191-90ae-4ab04a6ca37f admin admin] RBAC: Authorizing `identity:delete_project(project_id=91ccbfb303dc40a7a2313fe5e6ab3332)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:35.589670 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb2bdc-018a-4191-90ae-4ab04a6ca37f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:35.647854 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76055d4e-73c4-4dd8-b158-23f33f176842 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:35.651928 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283bd3d-611a-4fe7-9899-fed6f46e4983 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:35.652599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283bd3d-611a-4fe7-9899-fed6f46e4983 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:35.652882 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283bd3d-611a-4fe7-9899-fed6f46e4983 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:35.653162 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283bd3d-611a-4fe7-9899-fed6f46e4983 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:35.663144 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283bd3d-611a-4fe7-9899-fed6f46e4983 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:35.664662 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283bd3d-611a-4fe7-9899-fed6f46e4983 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:35.678458 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1261/2484] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:26:35.743805 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0cfb2bdc-018a-4191-90ae-4ab04a6ca37f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91ccbfb303dc40a7a2313fe5e6ab3332', 'request_id': 'req-0cfb2bdc-018a-4191-90ae-4ab04a6ca37f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:35.783920 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283bd3d-611a-4fe7-9899-fed6f46e4983 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:35.786158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4283bd3d-611a-4fe7-9899-fed6f46e4983 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:35.800406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0cfb2bdc-018a-4191-90ae-4ab04a6ca37f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91ccbfb303dc40a7a2313fe5e6ab3332', 'request_id': 'req-0cfb2bdc-018a-4191-90ae-4ab04a6ca37f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:35.807136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283bd3d-611a-4fe7-9899-fed6f46e4983 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:35.809896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0cfb2bdc-018a-4191-90ae-4ab04a6ca37f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91ccbfb303dc40a7a2313fe5e6ab3332', 'request_id': 'req-0cfb2bdc-018a-4191-90ae-4ab04a6ca37f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:35.831337 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0cfb2bdc-018a-4191-90ae-4ab04a6ca37f admin admin] The token cache is being invalidate because project 91ccbfb303dc40a7a2313fe5e6ab3332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:26:35.831624 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0cfb2bdc-018a-4191-90ae-4ab04a6ca37f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:35.832524 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0cfb2bdc-018a-4191-90ae-4ab04a6ca37f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:35.834481 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1224/2485] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:26:35 2022] DELETE /identity/v3/projects/91ccbfb303dc40a7a2313fe5e6ab3332 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:35.842006 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace94aa-7379-4fdb-ac5e-aadf57fb4c06 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:35.842290 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace94aa-7379-4fdb-ac5e-aadf57fb4c06 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:35.842564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace94aa-7379-4fdb-ac5e-aadf57fb4c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:35.861036 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4ace94aa-7379-4fdb-ac5e-aadf57fb4c06 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:35.862291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4ace94aa-7379-4fdb-ac5e-aadf57fb4c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:35.880788 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8241de-f1a2-4f1b-9b28-d24d43ba5d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:35.881888 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8241de-f1a2-4f1b-9b28-d24d43ba5d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:35.882347 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8241de-f1a2-4f1b-9b28-d24d43ba5d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:35.882796 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8241de-f1a2-4f1b-9b28-d24d43ba5d01 admin admin] PATH_INFO: `/v3/projects/d3c6164700aa4d2a87819ad713a5fa37` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:35.884508 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8241de-f1a2-4f1b-9b28-d24d43ba5d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3c6164700aa4d2a87819ad713a5fa37)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:35.887174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8241de-f1a2-4f1b-9b28-d24d43ba5d01 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:35.938766 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1225/2486] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:35.947169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e8e4e-fe2b-4eb4-9f9f-7cc17bae23b9 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:35.947457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e8e4e-fe2b-4eb4-9f9f-7cc17bae23b9 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:35.947755 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e8e4e-fe2b-4eb4-9f9f-7cc17bae23b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:35.971521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-aa1e8e4e-fe2b-4eb4-9f9f-7cc17bae23b9 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:35.973046 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-aa1e8e4e-fe2b-4eb4-9f9f-7cc17bae23b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:35.982011 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1226/2487] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:35.988815 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e8e4e-fe2b-4eb4-9f9f-7cc17bae23b9 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:36.002251 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e8e4e-fe2b-4eb4-9f9f-7cc17bae23b9 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:36.017223 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9d8241de-f1a2-4f1b-9b28-d24d43ba5d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3c6164700aa4d2a87819ad713a5fa37', 'request_id': 'req-9d8241de-f1a2-4f1b-9b28-d24d43ba5d01'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:36.062086 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557e59a-469f-4b34-ad19-e9495086dfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:36.062764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557e59a-469f-4b34-ad19-e9495086dfdc admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:36.063053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557e59a-469f-4b34-ad19-e9495086dfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:36.063332 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557e59a-469f-4b34-ad19-e9495086dfdc admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:36.064104 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557e59a-469f-4b34-ad19-e9495086dfdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:26:36.064632 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557e59a-469f-4b34-ad19-e9495086dfdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:36.066566 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557e59a-469f-4b34-ad19-e9495086dfdc admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:36.081045 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1227/2488] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:26:36.084913 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557e59a-469f-4b34-ad19-e9495086dfdc admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:36.094803 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557e59a-469f-4b34-ad19-e9495086dfdc admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:36.099362 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbcd9f-7f3f-41ab-8dc0-28054ed59c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:36.100080 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbcd9f-7f3f-41ab-8dc0-28054ed59c39 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:36.100340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbcd9f-7f3f-41ab-8dc0-28054ed59c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:36.100618 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbcd9f-7f3f-41ab-8dc0-28054ed59c39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:36.101303 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbcd9f-7f3f-41ab-8dc0-28054ed59c39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:36.103211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbcd9f-7f3f-41ab-8dc0-28054ed59c39 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:36.124783 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9d8241de-f1a2-4f1b-9b28-d24d43ba5d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3c6164700aa4d2a87819ad713a5fa37', 'request_id': 'req-9d8241de-f1a2-4f1b-9b28-d24d43ba5d01'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:36.130282 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9d8241de-f1a2-4f1b-9b28-d24d43ba5d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3c6164700aa4d2a87819ad713a5fa37', 'request_id': 'req-9d8241de-f1a2-4f1b-9b28-d24d43ba5d01'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:36.142363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9d8241de-f1a2-4f1b-9b28-d24d43ba5d01 admin admin] The token cache is being invalidate because project d3c6164700aa4d2a87819ad713a5fa37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:26:36.142660 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9d8241de-f1a2-4f1b-9b28-d24d43ba5d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:36.143350 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9d8241de-f1a2-4f1b-9b28-d24d43ba5d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:36.144976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1262/2489] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:26:35 2022] DELETE /identity/v3/projects/d3c6164700aa4d2a87819ad713a5fa37 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:36.150786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6116e-ba74-4739-b9df-a42f986f150b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:36.151122 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6116e-ba74-4739-b9df-a42f986f150b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:36.151406 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6116e-ba74-4739-b9df-a42f986f150b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:36.179226 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f1a6116e-ba74-4739-b9df-a42f986f150b None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:36.179517 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f1a6116e-ba74-4739-b9df-a42f986f150b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:36.190744 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1263/2490] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:26:36.199412 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3fedd-f224-4a14-b878-59da54a5a83b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:36.199958 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3fedd-f224-4a14-b878-59da54a5a83b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:36.200460 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3fedd-f224-4a14-b878-59da54a5a83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:36.209988 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1228/2491] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:26:36 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:26:36.211134 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbcd9f-7f3f-41ab-8dc0-28054ed59c39 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:36.212905 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f5fbcd9f-7f3f-41ab-8dc0-28054ed59c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:36.220727 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-1ad3fedd-f224-4a14-b878-59da54a5a83b None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:36.221749 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1ad3fedd-f224-4a14-b878-59da54a5a83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:36.313709 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbcd9f-7f3f-41ab-8dc0-28054ed59c39 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:36.319785 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04046a37-6553-4836-854c-832989f2b865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:36.320470 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04046a37-6553-4836-854c-832989f2b865 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:36.320781 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04046a37-6553-4836-854c-832989f2b865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:36.324596 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1264/2492] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:36.324725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04046a37-6553-4836-854c-832989f2b865 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:36.324725 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04046a37-6553-4836-854c-832989f2b865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:36.325201 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04046a37-6553-4836-854c-832989f2b865 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:36.325726 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3fedd-f224-4a14-b878-59da54a5a83b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:36.335300 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3fedd-f224-4a14-b878-59da54a5a83b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:36.341909 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b03c81-d5c6-4bcb-83ed-962e65b7794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:36.342585 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b03c81-d5c6-4bcb-83ed-962e65b7794d admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:36.342867 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b03c81-d5c6-4bcb-83ed-962e65b7794d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:36.343142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b03c81-d5c6-4bcb-83ed-962e65b7794d admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:36.343947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b03c81-d5c6-4bcb-83ed-962e65b7794d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:26:36.344256 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b03c81-d5c6-4bcb-83ed-962e65b7794d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:36.345839 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b03c81-d5c6-4bcb-83ed-962e65b7794d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:36.358867 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1265/2493] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:26:36.364333 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b03c81-d5c6-4bcb-83ed-962e65b7794d admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:36.375794 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b03c81-d5c6-4bcb-83ed-962e65b7794d admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:36.380956 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8b315-fe07-481c-b6dc-28380b066ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:36.381670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8b315-fe07-481c-b6dc-28380b066ffd admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:36.382202 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8b315-fe07-481c-b6dc-28380b066ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:36.382421 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8b315-fe07-481c-b6dc-28380b066ffd admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:36.383324 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8b315-fe07-481c-b6dc-28380b066ffd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:36.386228 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8b315-fe07-481c-b6dc-28380b066ffd admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:36.451724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1229/2494] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:26:36 2022] POST /identity/v3/users => generated 287 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:36.455479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04046a37-6553-4836-854c-832989f2b865 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:36.466337 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04046a37-6553-4836-854c-832989f2b865 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:36.471096 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395ed26-ff29-4666-95ef-bc235bd3f4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:36.472058 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395ed26-ff29-4666-95ef-bc235bd3f4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:36.472337 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395ed26-ff29-4666-95ef-bc235bd3f4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:36.472606 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395ed26-ff29-4666-95ef-bc235bd3f4a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:36.473327 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395ed26-ff29-4666-95ef-bc235bd3f4a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:36.474709 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1266/2495] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:26:36 2022] POST /identity/v3/projects => generated 405 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:36.474918 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395ed26-ff29-4666-95ef-bc235bd3f4a9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:36.478832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8b315-fe07-481c-b6dc-28380b066ffd admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:36.486642 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1230/2496] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:26:36.490306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395ed26-ff29-4666-95ef-bc235bd3f4a9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:36.501027 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395ed26-ff29-4666-95ef-bc235bd3f4a9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:36.547853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8b315-fe07-481c-b6dc-28380b066ffd admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:36.553135 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d70f40-e62e-469f-9539-a5f2591105e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:36.553825 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d70f40-e62e-469f-9539-a5f2591105e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:36.554113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d70f40-e62e-469f-9539-a5f2591105e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:36.554388 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d70f40-e62e-469f-9539-a5f2591105e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:36.555101 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d70f40-e62e-469f-9539-a5f2591105e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:36.557075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d70f40-e62e-469f-9539-a5f2591105e9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:36.581511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf592d-39ca-4005-9414-6c6c89a32279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:36.582943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf592d-39ca-4005-9414-6c6c89a32279 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:36.583241 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf592d-39ca-4005-9414-6c6c89a32279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:36.583513 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf592d-39ca-4005-9414-6c6c89a32279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:36.584646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf592d-39ca-4005-9414-6c6c89a32279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:36.586422 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf592d-39ca-4005-9414-6c6c89a32279 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:36.601928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1231/2497] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:26:36.607032 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf592d-39ca-4005-9414-6c6c89a32279 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:36.617283 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf592d-39ca-4005-9414-6c6c89a32279 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:36.622620 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc703c5d-9464-4dbd-820b-73fbdd5595b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:36.623629 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc703c5d-9464-4dbd-820b-73fbdd5595b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:36.623971 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc703c5d-9464-4dbd-820b-73fbdd5595b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:36.624250 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc703c5d-9464-4dbd-820b-73fbdd5595b9 admin admin] PATH_INFO: `/v3/projects/196d48b0ecf34adf85012a2fd8ef2cf0/users/d62d6c8b3a1e4cc7b00e2b979d1be8b2/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:36.640447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1267/2498] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:26:36 2022] POST /identity/v3/users => generated 303 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:26:36.641095 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc703c5d-9464-4dbd-820b-73fbdd5595b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=196d48b0ecf34adf85012a2fd8ef2cf0, user_id=d62d6c8b3a1e4cc7b00e2b979d1be8b2, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:36.644003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc703c5d-9464-4dbd-820b-73fbdd5595b9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:36.644219 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d70f40-e62e-469f-9539-a5f2591105e9 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:36.655932 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d70f40-e62e-469f-9539-a5f2591105e9 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:36.660850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142ce43-9118-4b41-b64a-ce5aedb62faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:36.661752 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142ce43-9118-4b41-b64a-ce5aedb62faf admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:36.662213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142ce43-9118-4b41-b64a-ce5aedb62faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:36.662551 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142ce43-9118-4b41-b64a-ce5aedb62faf admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:36.663355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142ce43-9118-4b41-b64a-ce5aedb62faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:36.665049 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142ce43-9118-4b41-b64a-ce5aedb62faf admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:36.677295 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1268/2499] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:36.681030 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142ce43-9118-4b41-b64a-ce5aedb62faf admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:36.690712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142ce43-9118-4b41-b64a-ce5aedb62faf admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:36.696539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d207a-d888-4b1e-b852-82a33b70a733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:36.699726 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d207a-d888-4b1e-b852-82a33b70a733 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:36.699726 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d207a-d888-4b1e-b852-82a33b70a733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:36.699726 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d207a-d888-4b1e-b852-82a33b70a733 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:36.699726 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d207a-d888-4b1e-b852-82a33b70a733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:36.701009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d207a-d888-4b1e-b852-82a33b70a733 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:36.712600 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1269/2500] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:26:36.717133 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d207a-d888-4b1e-b852-82a33b70a733 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:36.724844 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1232/2501] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:36 2022] PUT /identity/v3/projects/196d48b0ecf34adf85012a2fd8ef2cf0/users/d62d6c8b3a1e4cc7b00e2b979d1be8b2/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:36.726305 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d207a-d888-4b1e-b852-82a33b70a733 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:36.741461 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b660d4-a046-4d75-bbb3-a9e3b6ef13e7 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:36.741747 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b660d4-a046-4d75-bbb3-a9e3b6ef13e7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:36.742020 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b660d4-a046-4d75-bbb3-a9e3b6ef13e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:36.767895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f8b660d4-a046-4d75-bbb3-a9e3b6ef13e7 None None] MFA Rules not processed for user `d62d6c8b3a1e4cc7b00e2b979d1be8b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:36.769125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f8b660d4-a046-4d75-bbb3-a9e3b6ef13e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:36.781470 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d218635-5193-4204-8fed-87aabb73fba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:36.782311 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d218635-5193-4204-8fed-87aabb73fba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:36.782615 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d218635-5193-4204-8fed-87aabb73fba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:36.782893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d218635-5193-4204-8fed-87aabb73fba2 admin admin] PATH_INFO: `/v3/projects/39a3a9aff0d7416bae04fbc128ce4029/users/9963e4066c944427a9eb493aa708d848/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:36.797483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d218635-5193-4204-8fed-87aabb73fba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39a3a9aff0d7416bae04fbc128ce4029, user_id=9963e4066c944427a9eb493aa708d848, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:36.800324 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d218635-5193-4204-8fed-87aabb73fba2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:36.832614 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1233/2502] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:26:36.844393 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b660d4-a046-4d75-bbb3-a9e3b6ef13e7 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:36.845813 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f8b660d4-a046-4d75-bbb3-a9e3b6ef13e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:36.872683 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1270/2503] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:36 2022] PUT /identity/v3/projects/39a3a9aff0d7416bae04fbc128ce4029/users/9963e4066c944427a9eb493aa708d848/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:36.877738 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac4a17-c3c8-413d-9bb6-89ed8664bfb0 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:36.878027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac4a17-c3c8-413d-9bb6-89ed8664bfb0 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:36.878624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac4a17-c3c8-413d-9bb6-89ed8664bfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:36.895922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-a4ac4a17-c3c8-413d-9bb6-89ed8664bfb0 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:36.897170 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a4ac4a17-c3c8-413d-9bb6-89ed8664bfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:36.920351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b660d4-a046-4d75-bbb3-a9e3b6ef13e7 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:36.959197 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1271/2504] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:26:36.969270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac4a17-c3c8-413d-9bb6-89ed8664bfb0 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:36.970443 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a4ac4a17-c3c8-413d-9bb6-89ed8664bfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:36.992030 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994792e6-3140-419c-869b-3105ce47531f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:36.992814 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994792e6-3140-419c-869b-3105ce47531f service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:36.993092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994792e6-3140-419c-869b-3105ce47531f service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:36.993378 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994792e6-3140-419c-869b-3105ce47531f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:37.033499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac4a17-c3c8-413d-9bb6-89ed8664bfb0 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:37.037249 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6211ed-7bf7-4163-b330-8dce8dcade30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:37.037959 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6211ed-7bf7-4163-b330-8dce8dcade30 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:37.038318 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6211ed-7bf7-4163-b330-8dce8dcade30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:37.038748 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6211ed-7bf7-4163-b330-8dce8dcade30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:37.049218 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6211ed-7bf7-4163-b330-8dce8dcade30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:37.050634 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6211ed-7bf7-4163-b330-8dce8dcade30 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:37.051225 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994792e6-3140-419c-869b-3105ce47531f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:37.052868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994792e6-3140-419c-869b-3105ce47531f service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:37.061555 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1272/2505] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:26:37.066165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1234/2506] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:26:37.527634 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6211ed-7bf7-4163-b330-8dce8dcade30 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:37.529162 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3e6211ed-7bf7-4163-b330-8dce8dcade30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:37.540579 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6211ed-7bf7-4163-b330-8dce8dcade30 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:37.545439 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e3dc1-1cc1-446b-8e46-09acaf20c171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:37.546286 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e3dc1-1cc1-446b-8e46-09acaf20c171 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:37.546568 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e3dc1-1cc1-446b-8e46-09acaf20c171 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:37.546839 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e3dc1-1cc1-446b-8e46-09acaf20c171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:37.548613 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-984e3dc1-1cc1-446b-8e46-09acaf20c171 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:37.561304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e3dc1-1cc1-446b-8e46-09acaf20c171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:37.562787 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e3dc1-1cc1-446b-8e46-09acaf20c171 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:37.573085 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1273/2507] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:26:38.605573 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4654bd-6120-40c8-adfd-5e4d2646e9ce None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:38.606104 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4654bd-6120-40c8-adfd-5e4d2646e9ce None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:38.606219 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4654bd-6120-40c8-adfd-5e4d2646e9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:38.638904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1c4654bd-6120-40c8-adfd-5e4d2646e9ce None None] MFA Rules not processed for user `9963e4066c944427a9eb493aa708d848`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:38.640293 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1c4654bd-6120-40c8-adfd-5e4d2646e9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:38.711160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1235/2508] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:38.716079 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e3dc1-1cc1-446b-8e46-09acaf20c171 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:38.726460 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e3dc1-1cc1-446b-8e46-09acaf20c171 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:38.731232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46439a70-a2e6-407c-91bd-9c95aa3e0595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:38.731930 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46439a70-a2e6-407c-91bd-9c95aa3e0595 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:38.732210 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46439a70-a2e6-407c-91bd-9c95aa3e0595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:38.732486 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46439a70-a2e6-407c-91bd-9c95aa3e0595 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:38.733190 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46439a70-a2e6-407c-91bd-9c95aa3e0595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:38.735232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46439a70-a2e6-407c-91bd-9c95aa3e0595 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:38.743365 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4654bd-6120-40c8-adfd-5e4d2646e9ce None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:38.745564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1c4654bd-6120-40c8-adfd-5e4d2646e9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:38.759557 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4654bd-6120-40c8-adfd-5e4d2646e9ce None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:38.766939 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c96db-5aba-4ac9-b682-7eb57a345c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:38.766939 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c96db-5aba-4ac9-b682-7eb57a345c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:38.766939 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c96db-5aba-4ac9-b682-7eb57a345c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:38.766939 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c96db-5aba-4ac9-b682-7eb57a345c67 admin admin] PATH_INFO: `/v3/users/ef13c47b8081479885a477550e4a508d` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:38.767417 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c96db-5aba-4ac9-b682-7eb57a345c67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef13c47b8081479885a477550e4a508d)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:38.769557 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c96db-5aba-4ac9-b682-7eb57a345c67 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:38.861313 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1274/2509] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:26:38 2022] POST /identity/v3/projects => generated 405 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:38.862335 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46439a70-a2e6-407c-91bd-9c95aa3e0595 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:38.950595 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46439a70-a2e6-407c-91bd-9c95aa3e0595 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:38.955248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2759b70-0e26-4a9c-8090-2c46878fdf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:38.955961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2759b70-0e26-4a9c-8090-2c46878fdf13 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:38.957126 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2759b70-0e26-4a9c-8090-2c46878fdf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:38.957126 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2759b70-0e26-4a9c-8090-2c46878fdf13 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:38.957557 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2759b70-0e26-4a9c-8090-2c46878fdf13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:38.959761 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2759b70-0e26-4a9c-8090-2c46878fdf13 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:38.992655 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-aa1c96db-5aba-4ac9-b682-7eb57a345c67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef13c47b8081479885a477550e4a508d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:38.993659 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-aa1c96db-5aba-4ac9-b682-7eb57a345c67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef13c47b8081479885a477550e4a508d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:39.005930 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-aa1c96db-5aba-4ac9-b682-7eb57a345c67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef13c47b8081479885a477550e4a508d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:39.006649 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-aa1c96db-5aba-4ac9-b682-7eb57a345c67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef13c47b8081479885a477550e4a508d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:39.013741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-aa1c96db-5aba-4ac9-b682-7eb57a345c67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef13c47b8081479885a477550e4a508d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:39.058819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1275/2510] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:26:38 2022] POST /identity/v3/users => generated 309 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:26:39.060165 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2759b70-0e26-4a9c-8090-2c46878fdf13 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:39.061806 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f2759b70-0e26-4a9c-8090-2c46878fdf13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:39.073872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2759b70-0e26-4a9c-8090-2c46878fdf13 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:39.078779 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aea1da-26cc-4187-8237-04cee38b24a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:39.079449 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aea1da-26cc-4187-8237-04cee38b24a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:39.079769 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aea1da-26cc-4187-8237-04cee38b24a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:39.080050 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aea1da-26cc-4187-8237-04cee38b24a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:39.080914 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aea1da-26cc-4187-8237-04cee38b24a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:39.082506 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aea1da-26cc-4187-8237-04cee38b24a1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:39.092660 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1276/2511] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:26:39.097465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aea1da-26cc-4187-8237-04cee38b24a1 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:39.107172 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aea1da-26cc-4187-8237-04cee38b24a1 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:39.111936 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7e2c3-d057-4135-8dce-2edbe5f4d764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:39.112807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7e2c3-d057-4135-8dce-2edbe5f4d764 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:39.113088 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7e2c3-d057-4135-8dce-2edbe5f4d764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:39.113361 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7e2c3-d057-4135-8dce-2edbe5f4d764 admin admin] PATH_INFO: `/v3/projects/5ad153229dea48f081cf0e26b6b33542/users/1d8f79bded6e4a25923236eb799b0fa6/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:39.126228 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1236/2512] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:26:38 2022] DELETE /identity/v3/users/ef13c47b8081479885a477550e4a508d => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:39.131144 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f393766-acfd-45f5-bd66-76f7f519afbc None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:39.131580 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f393766-acfd-45f5-bd66-76f7f519afbc None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:39.131996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f393766-acfd-45f5-bd66-76f7f519afbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:39.133274 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7e2c3-d057-4135-8dce-2edbe5f4d764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad153229dea48f081cf0e26b6b33542, user_id=1d8f79bded6e4a25923236eb799b0fa6, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:39.134865 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7e2c3-d057-4135-8dce-2edbe5f4d764 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:39.149406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1f393766-acfd-45f5-bd66-76f7f519afbc None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:39.154771 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1f393766-acfd-45f5-bd66-76f7f519afbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:39.218396 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1277/2513] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:39 2022] PUT /identity/v3/projects/5ad153229dea48f081cf0e26b6b33542/users/1d8f79bded6e4a25923236eb799b0fa6/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:39.219919 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7e2c3-d057-4135-8dce-2edbe5f4d764 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:39.224692 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1237/2514] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:26:39.238888 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f393766-acfd-45f5-bd66-76f7f519afbc None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:39.242290 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1f393766-acfd-45f5-bd66-76f7f519afbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:39.302713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7e2c3-d057-4135-8dce-2edbe5f4d764 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:39.309123 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01f7d8-0e2d-4051-9a38-52f42ade0c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:39.310086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01f7d8-0e2d-4051-9a38-52f42ade0c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:39.310535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01f7d8-0e2d-4051-9a38-52f42ade0c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:39.310897 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01f7d8-0e2d-4051-9a38-52f42ade0c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:39.311726 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01f7d8-0e2d-4051-9a38-52f42ade0c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:39.313574 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01f7d8-0e2d-4051-9a38-52f42ade0c93 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:39.318367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f393766-acfd-45f5-bd66-76f7f519afbc None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:39.326641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1278/2515] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:26:39.330910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01f7d8-0e2d-4051-9a38-52f42ade0c93 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:39.341534 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01f7d8-0e2d-4051-9a38-52f42ade0c93 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:39.346697 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ca05a-7e17-47d9-b4dc-2362fb62b609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:39.347607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ca05a-7e17-47d9-b4dc-2362fb62b609 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:39.348073 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ca05a-7e17-47d9-b4dc-2362fb62b609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:39.348346 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ca05a-7e17-47d9-b4dc-2362fb62b609 admin admin] PATH_INFO: `/v3/projects/5ad153229dea48f081cf0e26b6b33542/users/1d8f79bded6e4a25923236eb799b0fa6/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:39.350390 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ca05a-7e17-47d9-b4dc-2362fb62b609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad153229dea48f081cf0e26b6b33542, user_id=1d8f79bded6e4a25923236eb799b0fa6, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:39.353212 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ca05a-7e17-47d9-b4dc-2362fb62b609 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:39.364739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1279/2516] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:39 2022] PUT /identity/v3/projects/5ad153229dea48f081cf0e26b6b33542/users/1d8f79bded6e4a25923236eb799b0fa6/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:39.371992 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1142416-5085-4b8c-a180-80281428aec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:39.372785 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1142416-5085-4b8c-a180-80281428aec1 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:39.373192 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1142416-5085-4b8c-a180-80281428aec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:39.373698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1142416-5085-4b8c-a180-80281428aec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:39.383993 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1142416-5085-4b8c-a180-80281428aec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:39.385666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1142416-5085-4b8c-a180-80281428aec1 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:39.396479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1238/2517] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:26:39.874267 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ca05a-7e17-47d9-b4dc-2362fb62b609 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:39.874267 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4c2ca05a-7e17-47d9-b4dc-2362fb62b609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:39.972554 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ca05a-7e17-47d9-b4dc-2362fb62b609 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:39.976717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115189c4-3a2d-4b3b-8276-c8f413959340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:39.977528 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115189c4-3a2d-4b3b-8276-c8f413959340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:39.977811 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115189c4-3a2d-4b3b-8276-c8f413959340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:39.978090 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115189c4-3a2d-4b3b-8276-c8f413959340 admin admin] PATH_INFO: `/v3/projects/3981c9e85f7a4e8ebfbbf3f4bebb5c5d` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:39.979308 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115189c4-3a2d-4b3b-8276-c8f413959340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3981c9e85f7a4e8ebfbbf3f4bebb5c5d)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:39.981250 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115189c4-3a2d-4b3b-8276-c8f413959340 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:40.105990 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-115189c4-3a2d-4b3b-8276-c8f413959340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3981c9e85f7a4e8ebfbbf3f4bebb5c5d', 'request_id': 'req-115189c4-3a2d-4b3b-8276-c8f413959340'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:40.200367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-115189c4-3a2d-4b3b-8276-c8f413959340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3981c9e85f7a4e8ebfbbf3f4bebb5c5d', 'request_id': 'req-115189c4-3a2d-4b3b-8276-c8f413959340'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:40.207052 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-115189c4-3a2d-4b3b-8276-c8f413959340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3981c9e85f7a4e8ebfbbf3f4bebb5c5d', 'request_id': 'req-115189c4-3a2d-4b3b-8276-c8f413959340'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:40.219382 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-115189c4-3a2d-4b3b-8276-c8f413959340 admin admin] The token cache is being invalidate because project 3981c9e85f7a4e8ebfbbf3f4bebb5c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:26:40.219801 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-115189c4-3a2d-4b3b-8276-c8f413959340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:40.220536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-115189c4-3a2d-4b3b-8276-c8f413959340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:40.225579 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1280/2518] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:26:39 2022] DELETE /identity/v3/projects/3981c9e85f7a4e8ebfbbf3f4bebb5c5d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:40.227497 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de7d17-b81e-4f21-b501-f0a7b075f2b5 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:40.227991 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de7d17-b81e-4f21-b501-f0a7b075f2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:40.228218 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de7d17-b81e-4f21-b501-f0a7b075f2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:40.251011 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-59de7d17-b81e-4f21-b501-f0a7b075f2b5 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:40.252639 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-59de7d17-b81e-4f21-b501-f0a7b075f2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:40.333087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115189c4-3a2d-4b3b-8276-c8f413959340 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:40.333087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-115189c4-3a2d-4b3b-8276-c8f413959340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:40.345110 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1239/2519] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:40.352739 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815eb184-22e5-415f-8fd5-76ec67c6cf6e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:40.353235 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815eb184-22e5-415f-8fd5-76ec67c6cf6e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:40.353748 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815eb184-22e5-415f-8fd5-76ec67c6cf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:40.374382 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-815eb184-22e5-415f-8fd5-76ec67c6cf6e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:40.376230 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-815eb184-22e5-415f-8fd5-76ec67c6cf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:40.386771 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1240/2520] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:40.391951 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815eb184-22e5-415f-8fd5-76ec67c6cf6e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:40.404119 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115189c4-3a2d-4b3b-8276-c8f413959340 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:40.405395 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815eb184-22e5-415f-8fd5-76ec67c6cf6e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:40.410712 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d138cb-85fa-47f9-8bf1-044ab40be249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:40.411723 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d138cb-85fa-47f9-8bf1-044ab40be249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:40.411905 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac215b0-cee0-445d-89db-be1fce42f1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:40.412019 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d138cb-85fa-47f9-8bf1-044ab40be249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:40.412385 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d138cb-85fa-47f9-8bf1-044ab40be249 admin admin] PATH_INFO: `/v3/users/d62d6c8b3a1e4cc7b00e2b979d1be8b2` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:40.412611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac215b0-cee0-445d-89db-be1fce42f1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:40.412898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac215b0-cee0-445d-89db-be1fce42f1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:40.413301 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac215b0-cee0-445d-89db-be1fce42f1b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:40.413894 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d138cb-85fa-47f9-8bf1-044ab40be249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d62d6c8b3a1e4cc7b00e2b979d1be8b2)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:40.414031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac215b0-cee0-445d-89db-be1fce42f1b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:26:40.414334 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac215b0-cee0-445d-89db-be1fce42f1b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:40.416077 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac215b0-cee0-445d-89db-be1fce42f1b5 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:40.416301 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d138cb-85fa-47f9-8bf1-044ab40be249 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:40.431510 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1241/2521] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:26:40.435858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac215b0-cee0-445d-89db-be1fce42f1b5 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:40.445913 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac215b0-cee0-445d-89db-be1fce42f1b5 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:40.451488 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2eaca-3ede-4da7-8f83-c3f12b7c8135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:40.452256 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2eaca-3ede-4da7-8f83-c3f12b7c8135 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:40.452618 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2eaca-3ede-4da7-8f83-c3f12b7c8135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:40.452968 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2eaca-3ede-4da7-8f83-c3f12b7c8135 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:40.453738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2eaca-3ede-4da7-8f83-c3f12b7c8135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:40.455767 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2eaca-3ede-4da7-8f83-c3f12b7c8135 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:40.592275 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1242/2522] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:26:40 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:26:40.596285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2eaca-3ede-4da7-8f83-c3f12b7c8135 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:40.636445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e9d138cb-85fa-47f9-8bf1-044ab40be249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd62d6c8b3a1e4cc7b00e2b979d1be8b2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:40.637248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e9d138cb-85fa-47f9-8bf1-044ab40be249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd62d6c8b3a1e4cc7b00e2b979d1be8b2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:40.638286 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e9d138cb-85fa-47f9-8bf1-044ab40be249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd62d6c8b3a1e4cc7b00e2b979d1be8b2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:40.657217 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e9d138cb-85fa-47f9-8bf1-044ab40be249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd62d6c8b3a1e4cc7b00e2b979d1be8b2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:40.671495 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e9d138cb-85fa-47f9-8bf1-044ab40be249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd62d6c8b3a1e4cc7b00e2b979d1be8b2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:40.683018 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2eaca-3ede-4da7-8f83-c3f12b7c8135 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:40.692207 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5306c2a-ceef-48cf-835b-948126af396d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:40.693063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5306c2a-ceef-48cf-835b-948126af396d admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:40.693384 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5306c2a-ceef-48cf-835b-948126af396d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:40.693730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5306c2a-ceef-48cf-835b-948126af396d admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:40.698851 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5306c2a-ceef-48cf-835b-948126af396d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:40.698851 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5306c2a-ceef-48cf-835b-948126af396d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:40.753945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1281/2523] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:26:40 2022] DELETE /identity/v3/users/d62d6c8b3a1e4cc7b00e2b979d1be8b2 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:40.758492 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46432997-be76-4230-b51a-fc2fe3da2781 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:40.758782 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46432997-be76-4230-b51a-fc2fe3da2781 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:40.759055 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46432997-be76-4230-b51a-fc2fe3da2781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:40.776298 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-46432997-be76-4230-b51a-fc2fe3da2781 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:40.777590 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-46432997-be76-4230-b51a-fc2fe3da2781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:40.786168 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1243/2524] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:26:40 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:40.789044 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5306c2a-ceef-48cf-835b-948126af396d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:40.790666 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a5306c2a-ceef-48cf-835b-948126af396d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:40.803224 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5306c2a-ceef-48cf-835b-948126af396d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:40.839061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1282/2525] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:26:40.848740 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46432997-be76-4230-b51a-fc2fe3da2781 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:40.850106 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-46432997-be76-4230-b51a-fc2fe3da2781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:40.862342 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2ae8e-08b2-4cf9-9d69-565f2a883581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:40.863008 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2ae8e-08b2-4cf9-9d69-565f2a883581 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:40.863286 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2ae8e-08b2-4cf9-9d69-565f2a883581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:40.863554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2ae8e-08b2-4cf9-9d69-565f2a883581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:40.864309 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2ae8e-08b2-4cf9-9d69-565f2a883581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:40.865986 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2ae8e-08b2-4cf9-9d69-565f2a883581 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:40.877974 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1244/2526] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:26:40.881155 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2ae8e-08b2-4cf9-9d69-565f2a883581 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:40.894583 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2ae8e-08b2-4cf9-9d69-565f2a883581 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:40.899793 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2f6a1-a701-4f8d-898c-a86d28297c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:40.900886 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2f6a1-a701-4f8d-898c-a86d28297c42 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:40.900886 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2f6a1-a701-4f8d-898c-a86d28297c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:40.901607 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2f6a1-a701-4f8d-898c-a86d28297c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:40.902352 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2f6a1-a701-4f8d-898c-a86d28297c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:40.903850 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2f6a1-a701-4f8d-898c-a86d28297c42 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:40.918229 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1245/2527] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:26:40.919125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2f6a1-a701-4f8d-898c-a86d28297c42 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:40.931980 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2f6a1-a701-4f8d-898c-a86d28297c42 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:40.936574 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46432997-be76-4230-b51a-fc2fe3da2781 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:40.937122 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd39ca-2eb7-4988-9727-4c748874e49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:40.937892 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd39ca-2eb7-4988-9727-4c748874e49c admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:40.938176 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd39ca-2eb7-4988-9727-4c748874e49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:40.938456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd39ca-2eb7-4988-9727-4c748874e49c admin admin] PATH_INFO: `/v3/projects/5ae3a88827a548a3814d29074421ad90/users/4761df768dea4a90a1ae831cebf0f95f/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:40.950576 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155d0f3-875e-4786-b52b-9bdc28119ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:40.952711 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155d0f3-875e-4786-b52b-9bdc28119ebf service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:40.953088 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155d0f3-875e-4786-b52b-9bdc28119ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:40.958647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155d0f3-875e-4786-b52b-9bdc28119ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:40.958780 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd39ca-2eb7-4988-9727-4c748874e49c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae3a88827a548a3814d29074421ad90, user_id=4761df768dea4a90a1ae831cebf0f95f, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:40.959652 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd39ca-2eb7-4988-9727-4c748874e49c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:40.970170 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155d0f3-875e-4786-b52b-9bdc28119ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:40.972024 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155d0f3-875e-4786-b52b-9bdc28119ebf service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:40.987171 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1283/2528] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:26:41.026025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d57c8a-b696-4983-813b-a49b4951b481 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:41.026633 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d57c8a-b696-4983-813b-a49b4951b481 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:41.027102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d57c8a-b696-4983-813b-a49b4951b481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:41.046590 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1246/2529] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:40 2022] PUT /identity/v3/projects/5ae3a88827a548a3814d29074421ad90/users/4761df768dea4a90a1ae831cebf0f95f/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:41.059398 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e3a48-b065-4b49-a3bc-d14551750475 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:41.059931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e3a48-b065-4b49-a3bc-d14551750475 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:41.060679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e3a48-b065-4b49-a3bc-d14551750475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:41.085386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-12d57c8a-b696-4983-813b-a49b4951b481 None None] MFA Rules not processed for user `1d8f79bded6e4a25923236eb799b0fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:41.086611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-12d57c8a-b696-4983-813b-a49b4951b481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:41.124464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c94e3a48-b065-4b49-a3bc-d14551750475 None None] MFA Rules not processed for user `4761df768dea4a90a1ae831cebf0f95f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:41.126732 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c94e3a48-b065-4b49-a3bc-d14551750475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:41.220537 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1284/2530] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:41 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:41.236969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1247/2531] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:26:41.249901 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d57c8a-b696-4983-813b-a49b4951b481 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:41.251605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-12d57c8a-b696-4983-813b-a49b4951b481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:41.370537 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d57c8a-b696-4983-813b-a49b4951b481 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:41.374974 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f08e4-789d-4867-a22d-228a838aa5bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:41.375867 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f08e4-789d-4867-a22d-228a838aa5bb service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:41.376156 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f08e4-789d-4867-a22d-228a838aa5bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:41.376432 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f08e4-789d-4867-a22d-228a838aa5bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:41.389955 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f08e4-789d-4867-a22d-228a838aa5bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:41.392272 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f08e4-789d-4867-a22d-228a838aa5bb service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:41.414002 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1285/2532] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:26:41.502624 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e3a48-b065-4b49-a3bc-d14551750475 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:41.505392 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c94e3a48-b065-4b49-a3bc-d14551750475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:41.602676 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e3a48-b065-4b49-a3bc-d14551750475 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:41.606840 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af900cf6-b5a5-4d1b-9a92-badfd829a6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:41.608017 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af900cf6-b5a5-4d1b-9a92-badfd829a6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:41.608410 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af900cf6-b5a5-4d1b-9a92-badfd829a6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:41.608841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af900cf6-b5a5-4d1b-9a92-badfd829a6d5 admin admin] PATH_INFO: `/v3/projects/196d48b0ecf34adf85012a2fd8ef2cf0` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:41.610279 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af900cf6-b5a5-4d1b-9a92-badfd829a6d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=196d48b0ecf34adf85012a2fd8ef2cf0)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:41.612427 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af900cf6-b5a5-4d1b-9a92-badfd829a6d5 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:41.753386 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-af900cf6-b5a5-4d1b-9a92-badfd829a6d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '196d48b0ecf34adf85012a2fd8ef2cf0', 'request_id': 'req-af900cf6-b5a5-4d1b-9a92-badfd829a6d5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:41.822549 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-af900cf6-b5a5-4d1b-9a92-badfd829a6d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '196d48b0ecf34adf85012a2fd8ef2cf0', 'request_id': 'req-af900cf6-b5a5-4d1b-9a92-badfd829a6d5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:41.829112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-af900cf6-b5a5-4d1b-9a92-badfd829a6d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '196d48b0ecf34adf85012a2fd8ef2cf0', 'request_id': 'req-af900cf6-b5a5-4d1b-9a92-badfd829a6d5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:41.846549 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-af900cf6-b5a5-4d1b-9a92-badfd829a6d5 admin admin] The token cache is being invalidate because project 196d48b0ecf34adf85012a2fd8ef2cf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:26:41.846969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-af900cf6-b5a5-4d1b-9a92-badfd829a6d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:41.847750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-af900cf6-b5a5-4d1b-9a92-badfd829a6d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:41.849821 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1248/2533] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:26:41 2022] DELETE /identity/v3/projects/196d48b0ecf34adf85012a2fd8ef2cf0 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:41.860114 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c3358-1e11-4fe8-a22d-371077e9aa1f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:41.860114 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c3358-1e11-4fe8-a22d-371077e9aa1f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:41.860114 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c3358-1e11-4fe8-a22d-371077e9aa1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:41.876325 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e69c3358-1e11-4fe8-a22d-371077e9aa1f None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:41.878092 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e69c3358-1e11-4fe8-a22d-371077e9aa1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:41.979732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1286/2534] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:41.986179 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d182659-d2ed-45e3-ba1d-39614b455532 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:41.986576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d182659-d2ed-45e3-ba1d-39614b455532 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:41.986930 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d182659-d2ed-45e3-ba1d-39614b455532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:42.032975 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1d182659-d2ed-45e3-ba1d-39614b455532 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:42.034632 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1d182659-d2ed-45e3-ba1d-39614b455532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:42.062092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1249/2535] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:42.066312 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c3358-1e11-4fe8-a22d-371077e9aa1f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:42.077902 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c3358-1e11-4fe8-a22d-371077e9aa1f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:42.083901 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe2f6c-89dc-4424-8dd8-a79ac141c633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:42.084881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe2f6c-89dc-4424-8dd8-a79ac141c633 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:42.085417 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe2f6c-89dc-4424-8dd8-a79ac141c633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:42.086041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe2f6c-89dc-4424-8dd8-a79ac141c633 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:42.092366 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe2f6c-89dc-4424-8dd8-a79ac141c633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:26:42.098345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe2f6c-89dc-4424-8dd8-a79ac141c633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:42.098345 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe2f6c-89dc-4424-8dd8-a79ac141c633 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:42.112687 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1287/2536] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:26:42.114626 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d182659-d2ed-45e3-ba1d-39614b455532 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:42.125522 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d182659-d2ed-45e3-ba1d-39614b455532 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:42.131883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2dec0-99f5-4a00-b26c-bf34bb13955d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:42.132554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2dec0-99f5-4a00-b26c-bf34bb13955d admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:42.132837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2dec0-99f5-4a00-b26c-bf34bb13955d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:42.133114 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2dec0-99f5-4a00-b26c-bf34bb13955d admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:42.133928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2dec0-99f5-4a00-b26c-bf34bb13955d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:42.136643 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2dec0-99f5-4a00-b26c-bf34bb13955d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:42.231767 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1250/2537] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:26:42 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:42.233605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe2f6c-89dc-4424-8dd8-a79ac141c633 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:42.248593 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe2f6c-89dc-4424-8dd8-a79ac141c633 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:42.304432 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f04698-687e-4c5e-916b-84fcdabebcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:42.305091 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f04698-687e-4c5e-916b-84fcdabebcb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:42.305317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f04698-687e-4c5e-916b-84fcdabebcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:42.305782 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f04698-687e-4c5e-916b-84fcdabebcb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:42.306496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f04698-687e-4c5e-916b-84fcdabebcb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:42.309053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f04698-687e-4c5e-916b-84fcdabebcb1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:42.376514 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2dec0-99f5-4a00-b26c-bf34bb13955d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:42.378294 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b5f2dec0-99f5-4a00-b26c-bf34bb13955d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:42.391077 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2dec0-99f5-4a00-b26c-bf34bb13955d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:42.395925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20da52-c3fe-4d2c-b8c1-d1bb94f7f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:42.396795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20da52-c3fe-4d2c-b8c1-d1bb94f7f678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:42.397124 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20da52-c3fe-4d2c-b8c1-d1bb94f7f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:42.397340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20da52-c3fe-4d2c-b8c1-d1bb94f7f678 admin admin] PATH_INFO: `/v3/users/13ef78da38e941b3a09f1de838581d54` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:42.398588 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20da52-c3fe-4d2c-b8c1-d1bb94f7f678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13ef78da38e941b3a09f1de838581d54)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:42.400585 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20da52-c3fe-4d2c-b8c1-d1bb94f7f678 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:42.423641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1288/2538] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:26:42 2022] POST /identity/v3/users => generated 284 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:26:42.427563 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f04698-687e-4c5e-916b-84fcdabebcb1 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:42.437216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f04698-687e-4c5e-916b-84fcdabebcb1 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:42.442014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239f1d3-e8e3-492d-8629-67200f5dbb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:42.442679 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239f1d3-e8e3-492d-8629-67200f5dbb12 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:42.442964 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239f1d3-e8e3-492d-8629-67200f5dbb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:42.443237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239f1d3-e8e3-492d-8629-67200f5dbb12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:42.444013 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239f1d3-e8e3-492d-8629-67200f5dbb12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:42.445588 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239f1d3-e8e3-492d-8629-67200f5dbb12 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:42.455817 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1289/2539] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:26:42.462027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239f1d3-e8e3-492d-8629-67200f5dbb12 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:42.472558 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239f1d3-e8e3-492d-8629-67200f5dbb12 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:42.477280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e63e5-b6c9-4891-956b-4ec914906c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:42.478001 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e63e5-b6c9-4891-956b-4ec914906c65 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:42.478219 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e63e5-b6c9-4891-956b-4ec914906c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:42.478491 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e63e5-b6c9-4891-956b-4ec914906c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:42.479318 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e63e5-b6c9-4891-956b-4ec914906c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:42.481430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e63e5-b6c9-4891-956b-4ec914906c65 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:42.492038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1290/2540] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:42.496101 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e63e5-b6c9-4891-956b-4ec914906c65 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:42.506329 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e63e5-b6c9-4891-956b-4ec914906c65 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:42.511099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2a1be-9c1a-43da-80bc-a78dc670311e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:42.512004 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2a1be-9c1a-43da-80bc-a78dc670311e admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:42.512299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2a1be-9c1a-43da-80bc-a78dc670311e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:42.512558 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2a1be-9c1a-43da-80bc-a78dc670311e admin admin] PATH_INFO: `/v3/projects/be6d4c367260464da778cbcf0cd4b29b/users/2da1806e498248e297455f15b9c8bd75/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:42.528173 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2a1be-9c1a-43da-80bc-a78dc670311e admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6d4c367260464da778cbcf0cd4b29b, user_id=2da1806e498248e297455f15b9c8bd75, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:42.530809 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2a1be-9c1a-43da-80bc-a78dc670311e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:42.590009 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cd20da52-c3fe-4d2c-b8c1-d1bb94f7f678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13ef78da38e941b3a09f1de838581d54'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:42.590702 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cd20da52-c3fe-4d2c-b8c1-d1bb94f7f678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13ef78da38e941b3a09f1de838581d54'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:42.602582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cd20da52-c3fe-4d2c-b8c1-d1bb94f7f678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13ef78da38e941b3a09f1de838581d54'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:42.603232 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cd20da52-c3fe-4d2c-b8c1-d1bb94f7f678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13ef78da38e941b3a09f1de838581d54'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:42.610471 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cd20da52-c3fe-4d2c-b8c1-d1bb94f7f678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13ef78da38e941b3a09f1de838581d54'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:42.634108 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1291/2541] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:42 2022] PUT /identity/v3/projects/be6d4c367260464da778cbcf0cd4b29b/users/2da1806e498248e297455f15b9c8bd75/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:42.645881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51f190-8abb-454e-a1b1-825514788d11 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:42.646169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51f190-8abb-454e-a1b1-825514788d11 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:42.646444 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51f190-8abb-454e-a1b1-825514788d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:42.684272 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6c51f190-8abb-454e-a1b1-825514788d11 None None] MFA Rules not processed for user `2da1806e498248e297455f15b9c8bd75`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:42.686060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6c51f190-8abb-454e-a1b1-825514788d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:42.691151 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1251/2542] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:26:42 2022] DELETE /identity/v3/users/13ef78da38e941b3a09f1de838581d54 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:42.763634 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1292/2543] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:26:42.774891 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20da52-c3fe-4d2c-b8c1-d1bb94f7f678 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:42.776964 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cd20da52-c3fe-4d2c-b8c1-d1bb94f7f678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:42.839898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20da52-c3fe-4d2c-b8c1-d1bb94f7f678 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:42.843794 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b62f30-7f97-4fdd-93a1-25357225de59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:42.844389 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b62f30-7f97-4fdd-93a1-25357225de59 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:42.844669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b62f30-7f97-4fdd-93a1-25357225de59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:42.845140 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b62f30-7f97-4fdd-93a1-25357225de59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:42.855782 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b62f30-7f97-4fdd-93a1-25357225de59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:42.857356 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b62f30-7f97-4fdd-93a1-25357225de59 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:42.867195 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1252/2544] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:26:42.962764 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51f190-8abb-454e-a1b1-825514788d11 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:42.965230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6c51f190-8abb-454e-a1b1-825514788d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:43.040035 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51f190-8abb-454e-a1b1-825514788d11 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:43.044776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caee978-20b3-4477-91a5-5aae3a021e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:43.046125 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caee978-20b3-4477-91a5-5aae3a021e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:43.046318 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caee978-20b3-4477-91a5-5aae3a021e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:43.046590 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caee978-20b3-4477-91a5-5aae3a021e65 admin admin] PATH_INFO: `/v3/projects/b772df3ea0d9417188aab057dce4d320` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:43.047846 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caee978-20b3-4477-91a5-5aae3a021e65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b772df3ea0d9417188aab057dce4d320)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:43.049823 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caee978-20b3-4477-91a5-5aae3a021e65 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:43.053885 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b62f30-7f97-4fdd-93a1-25357225de59 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:43.055460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-73b62f30-7f97-4fdd-93a1-25357225de59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:43.070615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b62f30-7f97-4fdd-93a1-25357225de59 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:43.075859 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cae0a-fec4-4819-879a-154299dc04a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:43.076715 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cae0a-fec4-4819-879a-154299dc04a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:43.079537 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cae0a-fec4-4819-879a-154299dc04a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:43.079537 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cae0a-fec4-4819-879a-154299dc04a7 admin admin] PATH_INFO: `/v3/users/9963e4066c944427a9eb493aa708d848` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:43.079537 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cae0a-fec4-4819-879a-154299dc04a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9963e4066c944427a9eb493aa708d848)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:43.080613 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cae0a-fec4-4819-879a-154299dc04a7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:43.147989 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9caee978-20b3-4477-91a5-5aae3a021e65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b772df3ea0d9417188aab057dce4d320', 'request_id': 'req-9caee978-20b3-4477-91a5-5aae3a021e65'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:43.210221 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9caee978-20b3-4477-91a5-5aae3a021e65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b772df3ea0d9417188aab057dce4d320', 'request_id': 'req-9caee978-20b3-4477-91a5-5aae3a021e65'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:43.216089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9caee978-20b3-4477-91a5-5aae3a021e65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b772df3ea0d9417188aab057dce4d320', 'request_id': 'req-9caee978-20b3-4477-91a5-5aae3a021e65'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:43.226961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9caee978-20b3-4477-91a5-5aae3a021e65 admin admin] The token cache is being invalidate because project b772df3ea0d9417188aab057dce4d320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:26:43.227249 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9caee978-20b3-4477-91a5-5aae3a021e65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:43.227919 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9caee978-20b3-4477-91a5-5aae3a021e65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:43.229468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1293/2545] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:26:42 2022] DELETE /identity/v3/projects/b772df3ea0d9417188aab057dce4d320 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:43.235215 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de568972-2c53-4932-9118-355ecc391518 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:43.235503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de568972-2c53-4932-9118-355ecc391518 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:43.235822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de568972-2c53-4932-9118-355ecc391518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:43.253932 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-de568972-2c53-4932-9118-355ecc391518 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:43.255176 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-de568972-2c53-4932-9118-355ecc391518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:43.286600 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5d0cae0a-fec4-4819-879a-154299dc04a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9963e4066c944427a9eb493aa708d848'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:43.287540 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5d0cae0a-fec4-4819-879a-154299dc04a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9963e4066c944427a9eb493aa708d848'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:43.317700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1294/2546] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:26:43.319581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b98eea-e0a5-4910-92fd-258b3727ce08 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:43.319947 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5d0cae0a-fec4-4819-879a-154299dc04a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9963e4066c944427a9eb493aa708d848'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:43.320293 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b98eea-e0a5-4910-92fd-258b3727ce08 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:43.320651 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5d0cae0a-fec4-4819-879a-154299dc04a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9963e4066c944427a9eb493aa708d848'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:43.320895 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b98eea-e0a5-4910-92fd-258b3727ce08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:43.329665 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5d0cae0a-fec4-4819-879a-154299dc04a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9963e4066c944427a9eb493aa708d848'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:43.339562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-c2b98eea-e0a5-4910-92fd-258b3727ce08 None None] MFA Rules not processed for user `4761df768dea4a90a1ae831cebf0f95f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:43.340964 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c2b98eea-e0a5-4910-92fd-258b3727ce08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:43.396235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1295/2547] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:43.400570 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd03c8c-f6e0-47dd-9e12-a7d9f1cb9420 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:43.400570 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd03c8c-f6e0-47dd-9e12-a7d9f1cb9420 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:43.400570 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd03c8c-f6e0-47dd-9e12-a7d9f1cb9420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:43.415927 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-abd03c8c-f6e0-47dd-9e12-a7d9f1cb9420 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:43.417153 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-abd03c8c-f6e0-47dd-9e12-a7d9f1cb9420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:43.428338 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1296/2548] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:43.428495 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1253/2549] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:26:43 2022] DELETE /identity/v3/users/9963e4066c944427a9eb493aa708d848 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:43.437623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd03c8c-f6e0-47dd-9e12-a7d9f1cb9420 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:43.446763 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd03c8c-f6e0-47dd-9e12-a7d9f1cb9420 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:43.521820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcdf61-815c-445a-9805-84fc01171309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:43.521820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcdf61-815c-445a-9805-84fc01171309 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:43.521820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcdf61-815c-445a-9805-84fc01171309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:43.521820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcdf61-815c-445a-9805-84fc01171309 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:43.522365 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcdf61-815c-445a-9805-84fc01171309 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:26:43.522365 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcdf61-815c-445a-9805-84fc01171309 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:43.522365 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcdf61-815c-445a-9805-84fc01171309 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:43.531391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1297/2550] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:26:43.535738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cae0a-fec4-4819-879a-154299dc04a7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:43.547350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cae0a-fec4-4819-879a-154299dc04a7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:43.552682 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e964f-b6d5-4f2f-873f-109dfd308d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:43.553540 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e964f-b6d5-4f2f-873f-109dfd308d1b admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:43.554000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e964f-b6d5-4f2f-873f-109dfd308d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:43.554459 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e964f-b6d5-4f2f-873f-109dfd308d1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:43.555930 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e964f-b6d5-4f2f-873f-109dfd308d1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:43.563258 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e964f-b6d5-4f2f-873f-109dfd308d1b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:43.696929 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1254/2551] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:26:43 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:26:43.703507 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcdf61-815c-445a-9805-84fc01171309 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:43.716769 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcdf61-815c-445a-9805-84fc01171309 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:43.780504 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d928f-a39d-4dcf-a194-b79e9c5ada53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:43.781187 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d928f-a39d-4dcf-a194-b79e9c5ada53 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:43.781472 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d928f-a39d-4dcf-a194-b79e9c5ada53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:43.781745 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d928f-a39d-4dcf-a194-b79e9c5ada53 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:43.782446 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d928f-a39d-4dcf-a194-b79e9c5ada53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:43.784410 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d928f-a39d-4dcf-a194-b79e9c5ada53 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:43.876680 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1298/2552] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:26:43 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:43.877886 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e964f-b6d5-4f2f-873f-109dfd308d1b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:43.888553 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e964f-b6d5-4f2f-873f-109dfd308d1b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:43.893329 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634080da-3c3a-4174-8bdf-bee66bc69d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:43.894013 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634080da-3c3a-4174-8bdf-bee66bc69d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:43.894296 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634080da-3c3a-4174-8bdf-bee66bc69d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:43.894571 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634080da-3c3a-4174-8bdf-bee66bc69d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:43.895315 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634080da-3c3a-4174-8bdf-bee66bc69d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:43.897031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634080da-3c3a-4174-8bdf-bee66bc69d77 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:43.912623 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1255/2553] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:26:43.913823 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d928f-a39d-4dcf-a194-b79e9c5ada53 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:43.925850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d928f-a39d-4dcf-a194-b79e9c5ada53 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:43.929980 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57de5d-4544-4019-ba46-6d686eff3eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:43.930662 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57de5d-4544-4019-ba46-6d686eff3eac admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:43.930948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57de5d-4544-4019-ba46-6d686eff3eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:43.931224 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57de5d-4544-4019-ba46-6d686eff3eac admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:43.932012 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57de5d-4544-4019-ba46-6d686eff3eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:43.933671 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57de5d-4544-4019-ba46-6d686eff3eac admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:43.948022 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1299/2554] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:43.949190 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634080da-3c3a-4174-8bdf-bee66bc69d77 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:43.959573 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634080da-3c3a-4174-8bdf-bee66bc69d77 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:43.965274 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed19d9-314e-4078-ba47-8a1f0cab38e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:43.966177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed19d9-314e-4078-ba47-8a1f0cab38e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:43.966460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed19d9-314e-4078-ba47-8a1f0cab38e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:43.966736 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed19d9-314e-4078-ba47-8a1f0cab38e7 admin admin] PATH_INFO: `/v3/projects/4432dcfd6e554a67991a541369f489ef/users/90cf256fb29c43abb729f9f29987cc71/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:43.982776 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed19d9-314e-4078-ba47-8a1f0cab38e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4432dcfd6e554a67991a541369f489ef, user_id=90cf256fb29c43abb729f9f29987cc71, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:43.985536 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed19d9-314e-4078-ba47-8a1f0cab38e7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:44.051420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1256/2555] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:43 2022] PUT /identity/v3/projects/4432dcfd6e554a67991a541369f489ef/users/90cf256fb29c43abb729f9f29987cc71/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:44.061795 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abc687-73fb-4883-ae85-60f63754dddb None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:44.062393 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abc687-73fb-4883-ae85-60f63754dddb None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:44.062574 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abc687-73fb-4883-ae85-60f63754dddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:44.090256 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-54abc687-73fb-4883-ae85-60f63754dddb None None] MFA Rules not processed for user `90cf256fb29c43abb729f9f29987cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:44.091556 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-54abc687-73fb-4883-ae85-60f63754dddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:44.165731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1300/2556] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:44.170822 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed19d9-314e-4078-ba47-8a1f0cab38e7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:44.212468 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abc687-73fb-4883-ae85-60f63754dddb None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:44.214588 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-54abc687-73fb-4883-ae85-60f63754dddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:44.236063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed19d9-314e-4078-ba47-8a1f0cab38e7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:44.241166 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002d570-b2d5-42bc-a5a5-ba23bd832837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:44.242089 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002d570-b2d5-42bc-a5a5-ba23bd832837 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:44.242234 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002d570-b2d5-42bc-a5a5-ba23bd832837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:44.242513 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002d570-b2d5-42bc-a5a5-ba23bd832837 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:44.243206 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002d570-b2d5-42bc-a5a5-ba23bd832837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:44.245174 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002d570-b2d5-42bc-a5a5-ba23bd832837 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:44.295858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abc687-73fb-4883-ae85-60f63754dddb None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:44.306944 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae35bd-6675-42dd-9c5a-b5321782074e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:44.306944 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae35bd-6675-42dd-9c5a-b5321782074e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:44.306944 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae35bd-6675-42dd-9c5a-b5321782074e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:44.306944 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae35bd-6675-42dd-9c5a-b5321782074e admin admin] PATH_INFO: `/v3/projects/39a3a9aff0d7416bae04fbc128ce4029` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:44.307380 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae35bd-6675-42dd-9c5a-b5321782074e admin admin] RBAC: Authorizing `identity:delete_project(project_id=39a3a9aff0d7416bae04fbc128ce4029)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:44.307380 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae35bd-6675-42dd-9c5a-b5321782074e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:44.354795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1257/2557] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:26:44 2022] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:44.354795 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002d570-b2d5-42bc-a5a5-ba23bd832837 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:44.355438 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9002d570-b2d5-42bc-a5a5-ba23bd832837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:44.417090 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c5ae35bd-6675-42dd-9c5a-b5321782074e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39a3a9aff0d7416bae04fbc128ce4029', 'request_id': 'req-c5ae35bd-6675-42dd-9c5a-b5321782074e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:44.425243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002d570-b2d5-42bc-a5a5-ba23bd832837 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:44.482073 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a46626-9e34-455e-aa9f-cd5d9a61753c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d2edf68b1b440097981097699bb307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:44.482691 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a46626-9e34-455e-aa9f-cd5d9a61753c service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:44.482912 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a46626-9e34-455e-aa9f-cd5d9a61753c service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:44.483214 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a46626-9e34-455e-aa9f-cd5d9a61753c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:44.485107 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-39a46626-9e34-455e-aa9f-cd5d9a61753c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:44.496177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a46626-9e34-455e-aa9f-cd5d9a61753c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:44.496464 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c5ae35bd-6675-42dd-9c5a-b5321782074e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39a3a9aff0d7416bae04fbc128ce4029', 'request_id': 'req-c5ae35bd-6675-42dd-9c5a-b5321782074e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:44.497755 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a46626-9e34-455e-aa9f-cd5d9a61753c service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:44.502494 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c5ae35bd-6675-42dd-9c5a-b5321782074e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39a3a9aff0d7416bae04fbc128ce4029', 'request_id': 'req-c5ae35bd-6675-42dd-9c5a-b5321782074e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:44.507514 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1258/2558] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:26:44.510042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a46626-9e34-455e-aa9f-cd5d9a61753c service placement] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:44.515915 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c5ae35bd-6675-42dd-9c5a-b5321782074e admin admin] The token cache is being invalidate because project 39a3a9aff0d7416bae04fbc128ce4029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:26:44.515915 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c5ae35bd-6675-42dd-9c5a-b5321782074e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:44.516595 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c5ae35bd-6675-42dd-9c5a-b5321782074e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:44.518329 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1301/2559] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:26:44 2022] DELETE /identity/v3/projects/39a3a9aff0d7416bae04fbc128ce4029 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:44.522227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae35bd-6675-42dd-9c5a-b5321782074e admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:44.523803 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c5ae35bd-6675-42dd-9c5a-b5321782074e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:44.576798 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a46626-9e34-455e-aa9f-cd5d9a61753c service placement] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:44.582186 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dac01-56b2-466d-982a-5011ad5f40d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:44.582895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dac01-56b2-466d-982a-5011ad5f40d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:44.583306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dac01-56b2-466d-982a-5011ad5f40d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:44.583474 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dac01-56b2-466d-982a-5011ad5f40d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:44.584373 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247dac01-56b2-466d-982a-5011ad5f40d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:44.586379 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247dac01-56b2-466d-982a-5011ad5f40d3 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:44.597190 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae35bd-6675-42dd-9c5a-b5321782074e admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:44.602415 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee577b86-74b1-452d-9df6-4c570e718e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:44.603297 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee577b86-74b1-452d-9df6-4c570e718e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:44.603618 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee577b86-74b1-452d-9df6-4c570e718e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:44.603913 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee577b86-74b1-452d-9df6-4c570e718e0f admin admin] PATH_INFO: `/v3/users/1d8f79bded6e4a25923236eb799b0fa6` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:44.605186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee577b86-74b1-452d-9df6-4c570e718e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d8f79bded6e4a25923236eb799b0fa6)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:44.607115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee577b86-74b1-452d-9df6-4c570e718e0f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:44.672145 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1259/2560] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:26:44 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:44.673602 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dac01-56b2-466d-982a-5011ad5f40d3 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:44.675398 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-247dac01-56b2-466d-982a-5011ad5f40d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:44.688559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dac01-56b2-466d-982a-5011ad5f40d3 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:44.693224 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779ebcc-a26d-48b3-85be-b0d1156a9b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:44.693879 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779ebcc-a26d-48b3-85be-b0d1156a9b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:44.694159 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779ebcc-a26d-48b3-85be-b0d1156a9b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:44.694426 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779ebcc-a26d-48b3-85be-b0d1156a9b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:44.695251 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779ebcc-a26d-48b3-85be-b0d1156a9b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:44.697011 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779ebcc-a26d-48b3-85be-b0d1156a9b02 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:44.712545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1260/2561] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:44.712545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779ebcc-a26d-48b3-85be-b0d1156a9b02 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:44.721860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779ebcc-a26d-48b3-85be-b0d1156a9b02 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:44.726822 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb5482-1a1d-4028-949d-db0a7159e974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:44.727722 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb5482-1a1d-4028-949d-db0a7159e974 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:44.727996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb5482-1a1d-4028-949d-db0a7159e974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:44.728266 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb5482-1a1d-4028-949d-db0a7159e974 admin admin] PATH_INFO: `/v3/projects/88cd9684ca6e432da3692c276fbbf9bc/users/57a557ee84bd43378f21271e4821db95/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:44.747358 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ee577b86-74b1-452d-9df6-4c570e718e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d8f79bded6e4a25923236eb799b0fa6'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:44.748242 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ee577b86-74b1-452d-9df6-4c570e718e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d8f79bded6e4a25923236eb799b0fa6'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:44.749120 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ee577b86-74b1-452d-9df6-4c570e718e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d8f79bded6e4a25923236eb799b0fa6'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:44.750077 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb5482-1a1d-4028-949d-db0a7159e974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88cd9684ca6e432da3692c276fbbf9bc, user_id=57a557ee84bd43378f21271e4821db95, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:44.753790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb5482-1a1d-4028-949d-db0a7159e974 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:44.765659 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ee577b86-74b1-452d-9df6-4c570e718e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d8f79bded6e4a25923236eb799b0fa6'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:44.773216 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ee577b86-74b1-452d-9df6-4c570e718e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d8f79bded6e4a25923236eb799b0fa6'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:44.828621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1261/2562] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:44 2022] PUT /identity/v3/projects/88cd9684ca6e432da3692c276fbbf9bc/users/57a557ee84bd43378f21271e4821db95/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:44.832423 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb5482-1a1d-4028-949d-db0a7159e974 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:44.834306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3bbb5482-1a1d-4028-949d-db0a7159e974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:44.861121 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1302/2563] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:26:44 2022] DELETE /identity/v3/users/1d8f79bded6e4a25923236eb799b0fa6 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:44.904831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb5482-1a1d-4028-949d-db0a7159e974 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:44.963536 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7096dc-2060-4c49-9ccc-5a2f5dc5d7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:44.965060 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7096dc-2060-4c49-9ccc-5a2f5dc5d7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:44.965866 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7096dc-2060-4c49-9ccc-5a2f5dc5d7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:44.965866 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7096dc-2060-4c49-9ccc-5a2f5dc5d7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:44.966374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7096dc-2060-4c49-9ccc-5a2f5dc5d7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:44.968270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7096dc-2060-4c49-9ccc-5a2f5dc5d7b0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:44.983888 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1262/2564] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:26:44.987802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee577b86-74b1-452d-9df6-4c570e718e0f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:44.998632 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee577b86-74b1-452d-9df6-4c570e718e0f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:45.004231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75b00a-0bd5-435a-86bc-23ba8fd81e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:45.005209 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75b00a-0bd5-435a-86bc-23ba8fd81e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:45.005625 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75b00a-0bd5-435a-86bc-23ba8fd81e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:45.006225 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75b00a-0bd5-435a-86bc-23ba8fd81e29 admin admin] PATH_INFO: `/v3/projects/88cd9684ca6e432da3692c276fbbf9bc/users/57a557ee84bd43378f21271e4821db95/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:45.008591 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75b00a-0bd5-435a-86bc-23ba8fd81e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88cd9684ca6e432da3692c276fbbf9bc, user_id=57a557ee84bd43378f21271e4821db95, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:45.012504 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75b00a-0bd5-435a-86bc-23ba8fd81e29 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:45.024569 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1303/2565] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:44 2022] PUT /identity/v3/projects/88cd9684ca6e432da3692c276fbbf9bc/users/57a557ee84bd43378f21271e4821db95/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:45.036439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557b364-2cc3-469a-8936-8ac88bedd05d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:45.036738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557b364-2cc3-469a-8936-8ac88bedd05d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:45.037017 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557b364-2cc3-469a-8936-8ac88bedd05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:45.070094 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b557b364-2cc3-469a-8936-8ac88bedd05d None None] MFA Rules not processed for user `57a557ee84bd43378f21271e4821db95`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:45.071349 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b557b364-2cc3-469a-8936-8ac88bedd05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:45.099375 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75b00a-0bd5-435a-86bc-23ba8fd81e29 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:45.101546 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-da75b00a-0bd5-435a-86bc-23ba8fd81e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:45.153574 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1263/2566] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:45 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:26:45.165121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557b364-2cc3-469a-8936-8ac88bedd05d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:45.166676 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b557b364-2cc3-469a-8936-8ac88bedd05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:45.181408 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75b00a-0bd5-435a-86bc-23ba8fd81e29 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:45.186760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cef7b4-66c4-414e-baa8-633418568006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:45.187668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cef7b4-66c4-414e-baa8-633418568006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:45.187980 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cef7b4-66c4-414e-baa8-633418568006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:45.188252 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cef7b4-66c4-414e-baa8-633418568006 admin admin] PATH_INFO: `/v3/projects/5ad153229dea48f081cf0e26b6b33542` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:45.189441 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cef7b4-66c4-414e-baa8-633418568006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad153229dea48f081cf0e26b6b33542)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:45.191394 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cef7b4-66c4-414e-baa8-633418568006 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:45.246563 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557b364-2cc3-469a-8936-8ac88bedd05d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:45.250328 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e53da-d86e-44fa-94d3-26e8a833063b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:45.250979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e53da-d86e-44fa-94d3-26e8a833063b service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:45.251260 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e53da-d86e-44fa-94d3-26e8a833063b service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:45.251533 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e53da-d86e-44fa-94d3-26e8a833063b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:45.261823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e53da-d86e-44fa-94d3-26e8a833063b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:45.263230 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e53da-d86e-44fa-94d3-26e8a833063b service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:45.272693 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1264/2567] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:45 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:26:45.332591 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-97cef7b4-66c4-414e-baa8-633418568006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad153229dea48f081cf0e26b6b33542', 'request_id': 'req-97cef7b4-66c4-414e-baa8-633418568006'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:45.400001 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-97cef7b4-66c4-414e-baa8-633418568006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad153229dea48f081cf0e26b6b33542', 'request_id': 'req-97cef7b4-66c4-414e-baa8-633418568006'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:45.406486 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-97cef7b4-66c4-414e-baa8-633418568006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad153229dea48f081cf0e26b6b33542', 'request_id': 'req-97cef7b4-66c4-414e-baa8-633418568006'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:45.418785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-97cef7b4-66c4-414e-baa8-633418568006 admin admin] The token cache is being invalidate because project 5ad153229dea48f081cf0e26b6b33542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:26:45.419170 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-97cef7b4-66c4-414e-baa8-633418568006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:45.419954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-97cef7b4-66c4-414e-baa8-633418568006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:45.421864 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1304/2568] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:26:45 2022] DELETE /identity/v3/projects/5ad153229dea48f081cf0e26b6b33542 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:45.427059 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16408c5-c1ab-4692-93db-1b48b6a94771 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:45.427429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16408c5-c1ab-4692-93db-1b48b6a94771 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:45.427773 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16408c5-c1ab-4692-93db-1b48b6a94771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:45.447473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b16408c5-c1ab-4692-93db-1b48b6a94771 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:45.449436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b16408c5-c1ab-4692-93db-1b48b6a94771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:45.515027 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1265/2569] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:45.523017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a39ebf-7f4c-41bd-b858-e648d9878e14 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:45.523302 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a39ebf-7f4c-41bd-b858-e648d9878e14 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:45.523604 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a39ebf-7f4c-41bd-b858-e648d9878e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:45.541764 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-47a39ebf-7f4c-41bd-b858-e648d9878e14 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:45.542975 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-47a39ebf-7f4c-41bd-b858-e648d9878e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:45.551466 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1305/2570] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:26:45.557109 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16408c5-c1ab-4692-93db-1b48b6a94771 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:45.567648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16408c5-c1ab-4692-93db-1b48b6a94771 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:45.575522 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023b1f5-96de-4806-8b21-e45aae66e3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:45.576297 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023b1f5-96de-4806-8b21-e45aae66e3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:45.576631 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023b1f5-96de-4806-8b21-e45aae66e3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:45.576934 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023b1f5-96de-4806-8b21-e45aae66e3a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:45.577701 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023b1f5-96de-4806-8b21-e45aae66e3a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:26:45.577960 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023b1f5-96de-4806-8b21-e45aae66e3a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:45.579545 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023b1f5-96de-4806-8b21-e45aae66e3a0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:45.593235 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1266/2571] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:26:45.595979 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a39ebf-7f4c-41bd-b858-e648d9878e14 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:45.606855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a39ebf-7f4c-41bd-b858-e648d9878e14 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:45.612144 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd193030-984e-40f3-81f1-a626daa4f958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:45.612807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd193030-984e-40f3-81f1-a626daa4f958 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:45.613098 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd193030-984e-40f3-81f1-a626daa4f958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:45.613354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd193030-984e-40f3-81f1-a626daa4f958 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:45.614096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd193030-984e-40f3-81f1-a626daa4f958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:45.615978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd193030-984e-40f3-81f1-a626daa4f958 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:45.709156 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1306/2572] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:26:45 2022] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:45.713283 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023b1f5-96de-4806-8b21-e45aae66e3a0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:45.723997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023b1f5-96de-4806-8b21-e45aae66e3a0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:45.779931 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93174ea-97b4-40c9-8433-8a97d14ac0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:45.780525 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93174ea-97b4-40c9-8433-8a97d14ac0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:45.780928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93174ea-97b4-40c9-8433-8a97d14ac0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:45.781220 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93174ea-97b4-40c9-8433-8a97d14ac0a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:45.781924 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93174ea-97b4-40c9-8433-8a97d14ac0a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:45.783889 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93174ea-97b4-40c9-8433-8a97d14ac0a5 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:45.874593 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1267/2573] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:26:45 2022] POST /identity/v3/users => generated 282 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:45.878798 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd193030-984e-40f3-81f1-a626daa4f958 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:45.889364 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd193030-984e-40f3-81f1-a626daa4f958 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:45.894286 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315edd9-2f99-4ff1-93d5-02fe9199c49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:45.894950 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315edd9-2f99-4ff1-93d5-02fe9199c49b admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:45.895235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315edd9-2f99-4ff1-93d5-02fe9199c49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:45.895505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315edd9-2f99-4ff1-93d5-02fe9199c49b admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:45.896270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315edd9-2f99-4ff1-93d5-02fe9199c49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:45.897925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315edd9-2f99-4ff1-93d5-02fe9199c49b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:45.909368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1307/2574] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:45.913311 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93174ea-97b4-40c9-8433-8a97d14ac0a5 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:45.924321 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93174ea-97b4-40c9-8433-8a97d14ac0a5 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:45.929020 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6b976-8370-4992-b87f-026c1d8fe546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:45.929694 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6b976-8370-4992-b87f-026c1d8fe546 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:45.929972 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6b976-8370-4992-b87f-026c1d8fe546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:45.930249 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6b976-8370-4992-b87f-026c1d8fe546 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:45.930979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6b976-8370-4992-b87f-026c1d8fe546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:45.933277 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6b976-8370-4992-b87f-026c1d8fe546 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:45.942982 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1268/2575] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:26:45.947164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315edd9-2f99-4ff1-93d5-02fe9199c49b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:45.957115 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315edd9-2f99-4ff1-93d5-02fe9199c49b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:45.963450 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd510c-3aa0-4d22-9c19-95b94dda3e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:45.964446 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd510c-3aa0-4d22-9c19-95b94dda3e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:45.964729 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd510c-3aa0-4d22-9c19-95b94dda3e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:45.965082 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd510c-3aa0-4d22-9c19-95b94dda3e5a admin admin] PATH_INFO: `/v3/projects/2350e78f0cf843eebbe0c1e7a3984f44/users/f0e23a950ad84130ac04297e7bddcefa/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:45.980916 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd510c-3aa0-4d22-9c19-95b94dda3e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2350e78f0cf843eebbe0c1e7a3984f44, user_id=f0e23a950ad84130ac04297e7bddcefa, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:45.983571 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd510c-3aa0-4d22-9c19-95b94dda3e5a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:46.063426 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1308/2576] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:45 2022] PUT /identity/v3/projects/2350e78f0cf843eebbe0c1e7a3984f44/users/f0e23a950ad84130ac04297e7bddcefa/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:46.073600 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364d549-d20f-4db7-abc9-8803723bb7c0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:46.073889 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364d549-d20f-4db7-abc9-8803723bb7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:46.074191 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364d549-d20f-4db7-abc9-8803723bb7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:46.105189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8364d549-d20f-4db7-abc9-8803723bb7c0 None None] MFA Rules not processed for user `f0e23a950ad84130ac04297e7bddcefa`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:46.106401 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8364d549-d20f-4db7-abc9-8803723bb7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:46.169897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1269/2577] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:46 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:46.174611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd510c-3aa0-4d22-9c19-95b94dda3e5a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:46.194450 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364d549-d20f-4db7-abc9-8803723bb7c0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:46.195975 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8364d549-d20f-4db7-abc9-8803723bb7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:46.237176 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd510c-3aa0-4d22-9c19-95b94dda3e5a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:46.242002 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e1fc9-ab10-401e-8aa7-9ceda9a66162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:46.242653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e1fc9-ab10-401e-8aa7-9ceda9a66162 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:46.242933 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e1fc9-ab10-401e-8aa7-9ceda9a66162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:46.243205 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e1fc9-ab10-401e-8aa7-9ceda9a66162 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:46.243946 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e1fc9-ab10-401e-8aa7-9ceda9a66162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:46.245860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e1fc9-ab10-401e-8aa7-9ceda9a66162 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:46.260720 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364d549-d20f-4db7-abc9-8803723bb7c0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:46.265341 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009ff8e-d9a9-4a3c-8a4f-edda48662291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:46.269121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009ff8e-d9a9-4a3c-8a4f-edda48662291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:46.269121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009ff8e-d9a9-4a3c-8a4f-edda48662291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:46.269121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009ff8e-d9a9-4a3c-8a4f-edda48662291 admin admin] PATH_INFO: `/v3/users/90cf256fb29c43abb729f9f29987cc71` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:46.269121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009ff8e-d9a9-4a3c-8a4f-edda48662291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90cf256fb29c43abb729f9f29987cc71)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:46.270024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009ff8e-d9a9-4a3c-8a4f-edda48662291 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:46.403442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1309/2578] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:26:46 2022] POST /identity/v3/projects => generated 363 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:46.404797 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e1fc9-ab10-401e-8aa7-9ceda9a66162 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:46.467215 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e1fc9-ab10-401e-8aa7-9ceda9a66162 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:46.472867 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87882b64-0493-4843-b4b3-dd6ef76cebcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:46.474005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87882b64-0493-4843-b4b3-dd6ef76cebcb admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:46.474648 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87882b64-0493-4843-b4b3-dd6ef76cebcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:46.475110 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87882b64-0493-4843-b4b3-dd6ef76cebcb admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:46.475842 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87882b64-0493-4843-b4b3-dd6ef76cebcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:46.477819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87882b64-0493-4843-b4b3-dd6ef76cebcb admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:46.539923 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0009ff8e-d9a9-4a3c-8a4f-edda48662291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90cf256fb29c43abb729f9f29987cc71'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:46.541494 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0009ff8e-d9a9-4a3c-8a4f-edda48662291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90cf256fb29c43abb729f9f29987cc71'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:46.560403 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1310/2579] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:26:46 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:46.564743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87882b64-0493-4843-b4b3-dd6ef76cebcb admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:46.567463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0009ff8e-d9a9-4a3c-8a4f-edda48662291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90cf256fb29c43abb729f9f29987cc71'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:46.571499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0009ff8e-d9a9-4a3c-8a4f-edda48662291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90cf256fb29c43abb729f9f29987cc71'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:46.582655 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87882b64-0493-4843-b4b3-dd6ef76cebcb admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:46.584124 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0009ff8e-d9a9-4a3c-8a4f-edda48662291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90cf256fb29c43abb729f9f29987cc71'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:46.588505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb759f3-cfd6-4ab0-82ad-ff6bfd24b497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:46.589833 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb759f3-cfd6-4ab0-82ad-ff6bfd24b497 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:46.590135 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb759f3-cfd6-4ab0-82ad-ff6bfd24b497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:46.590422 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb759f3-cfd6-4ab0-82ad-ff6bfd24b497 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:46.591429 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb759f3-cfd6-4ab0-82ad-ff6bfd24b497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:46.593063 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb759f3-cfd6-4ab0-82ad-ff6bfd24b497 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:46.603760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1311/2580] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:46.611948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb759f3-cfd6-4ab0-82ad-ff6bfd24b497 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:46.613846 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-adb759f3-cfd6-4ab0-82ad-ff6bfd24b497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:46.627945 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb759f3-cfd6-4ab0-82ad-ff6bfd24b497 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:46.632749 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e6ff4-c754-481b-a074-cb88493d75dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:46.633708 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e6ff4-c754-481b-a074-cb88493d75dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:46.634067 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e6ff4-c754-481b-a074-cb88493d75dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:46.634435 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e6ff4-c754-481b-a074-cb88493d75dc admin admin] PATH_INFO: `/v3/projects/51663302e19e46b18f2f380d04952540/users/06297b2fe5b141c6a8b91e75952544f9/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:46.650236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e6ff4-c754-481b-a074-cb88493d75dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=51663302e19e46b18f2f380d04952540, user_id=06297b2fe5b141c6a8b91e75952544f9, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:46.653584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e6ff4-c754-481b-a074-cb88493d75dc admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:46.747090 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1270/2581] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:26:46 2022] DELETE /identity/v3/users/90cf256fb29c43abb729f9f29987cc71 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:46.748997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c326e1-a083-4064-8bab-ca71dec787c0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:46.749290 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c326e1-a083-4064-8bab-ca71dec787c0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:46.749565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c326e1-a083-4064-8bab-ca71dec787c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:46.768835 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-02c326e1-a083-4064-8bab-ca71dec787c0 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:46.770054 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-02c326e1-a083-4064-8bab-ca71dec787c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:46.771892 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1312/2582] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:46 2022] PUT /identity/v3/projects/51663302e19e46b18f2f380d04952540/users/06297b2fe5b141c6a8b91e75952544f9/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:46.778056 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e6ff4-c754-481b-a074-cb88493d75dc admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:46.837369 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1271/2583] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:46.847503 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c326e1-a083-4064-8bab-ca71dec787c0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:46.848990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-02c326e1-a083-4064-8bab-ca71dec787c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:46.853597 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e6ff4-c754-481b-a074-cb88493d75dc admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:46.863453 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6600b2-bcc0-40ec-a528-f61a95f007fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:46.864039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6600b2-bcc0-40ec-a528-f61a95f007fa admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:46.864327 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6600b2-bcc0-40ec-a528-f61a95f007fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:46.866709 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6600b2-bcc0-40ec-a528-f61a95f007fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:46.866709 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6600b2-bcc0-40ec-a528-f61a95f007fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:46.867259 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6600b2-bcc0-40ec-a528-f61a95f007fa admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:46.882194 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1313/2584] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:46.892763 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6600b2-bcc0-40ec-a528-f61a95f007fa admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:46.915718 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6600b2-bcc0-40ec-a528-f61a95f007fa admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:46.932125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c326e1-a083-4064-8bab-ca71dec787c0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:46.935729 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050bfb2-9559-4ea8-bdae-f39ad473776d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:46.936342 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9756b0a-ca04-4641-8c0c-c3a76c54fdbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:46.936636 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050bfb2-9559-4ea8-bdae-f39ad473776d admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:46.936917 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050bfb2-9559-4ea8-bdae-f39ad473776d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:46.937190 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050bfb2-9559-4ea8-bdae-f39ad473776d admin admin] PATH_INFO: `/v3/projects/51663302e19e46b18f2f380d04952540/users/06297b2fe5b141c6a8b91e75952544f9/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:46.937358 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9756b0a-ca04-4641-8c0c-c3a76c54fdbd service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:46.937763 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9756b0a-ca04-4641-8c0c-c3a76c54fdbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:46.938104 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9756b0a-ca04-4641-8c0c-c3a76c54fdbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:46.940924 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050bfb2-9559-4ea8-bdae-f39ad473776d admin admin] RBAC: Authorizing `identity:create_grant(project_id=51663302e19e46b18f2f380d04952540, user_id=06297b2fe5b141c6a8b91e75952544f9, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:46.943572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050bfb2-9559-4ea8-bdae-f39ad473776d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:46.957816 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9756b0a-ca04-4641-8c0c-c3a76c54fdbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:46.959006 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1314/2585] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:46 2022] PUT /identity/v3/projects/51663302e19e46b18f2f380d04952540/users/06297b2fe5b141c6a8b91e75952544f9/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:46.960537 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9756b0a-ca04-4641-8c0c-c3a76c54fdbd service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:46.973618 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499a15c-480d-49b9-a206-0e356630be11 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:46.973915 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499a15c-480d-49b9-a206-0e356630be11 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:46.974197 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499a15c-480d-49b9-a206-0e356630be11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:46.981433 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1272/2586] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:26:47.024423 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-9499a15c-480d-49b9-a206-0e356630be11 None None] MFA Rules not processed for user `06297b2fe5b141c6a8b91e75952544f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:47.025728 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9499a15c-480d-49b9-a206-0e356630be11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:47.104405 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1315/2587] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:46 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:47.116331 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9756b0a-ca04-4641-8c0c-c3a76c54fdbd service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:47.117832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a9756b0a-ca04-4641-8c0c-c3a76c54fdbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:47.175388 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9756b0a-ca04-4641-8c0c-c3a76c54fdbd service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:47.226263 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e031d2-53a9-428a-871a-890b1b596a49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:47.226920 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e031d2-53a9-428a-871a-890b1b596a49 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:47.227201 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e031d2-53a9-428a-871a-890b1b596a49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:47.227481 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e031d2-53a9-428a-871a-890b1b596a49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:47.238867 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e031d2-53a9-428a-871a-890b1b596a49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:47.240350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e031d2-53a9-428a-871a-890b1b596a49 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:47.251853 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1273/2588] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:47 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:26:47.452696 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499a15c-480d-49b9-a206-0e356630be11 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:47.454481 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9499a15c-480d-49b9-a206-0e356630be11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:47.502987 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e031d2-53a9-428a-871a-890b1b596a49 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:47.511883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e031d2-53a9-428a-871a-890b1b596a49 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:47.516732 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da9c83-cc4a-4e46-8f26-722b68c415ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:47.522714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da9c83-cc4a-4e46-8f26-722b68c415ac service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:47.522714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da9c83-cc4a-4e46-8f26-722b68c415ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:47.522714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da9c83-cc4a-4e46-8f26-722b68c415ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:47.522714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-06da9c83-cc4a-4e46-8f26-722b68c415ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:47.529351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499a15c-480d-49b9-a206-0e356630be11 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:47.534539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b4f96-27d2-4067-b37f-68b5041b2d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:47.535497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b4f96-27d2-4067-b37f-68b5041b2d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:47.535886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b4f96-27d2-4067-b37f-68b5041b2d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:47.536238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b4f96-27d2-4067-b37f-68b5041b2d4e admin admin] PATH_INFO: `/v3/projects/4432dcfd6e554a67991a541369f489ef` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:47.537522 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b4f96-27d2-4067-b37f-68b5041b2d4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4432dcfd6e554a67991a541369f489ef)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:47.539578 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b4f96-27d2-4067-b37f-68b5041b2d4e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:47.582462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da9c83-cc4a-4e46-8f26-722b68c415ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:47.585786 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da9c83-cc4a-4e46-8f26-722b68c415ac service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:47.593337 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1274/2589] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:47 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:26:47.656895 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-791b4f96-27d2-4067-b37f-68b5041b2d4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4432dcfd6e554a67991a541369f489ef', 'request_id': 'req-791b4f96-27d2-4067-b37f-68b5041b2d4e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:47.759667 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-791b4f96-27d2-4067-b37f-68b5041b2d4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4432dcfd6e554a67991a541369f489ef', 'request_id': 'req-791b4f96-27d2-4067-b37f-68b5041b2d4e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:47.765816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-791b4f96-27d2-4067-b37f-68b5041b2d4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4432dcfd6e554a67991a541369f489ef', 'request_id': 'req-791b4f96-27d2-4067-b37f-68b5041b2d4e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:47.779241 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-791b4f96-27d2-4067-b37f-68b5041b2d4e admin admin] The token cache is being invalidate because project 4432dcfd6e554a67991a541369f489ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:26:47.779601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-791b4f96-27d2-4067-b37f-68b5041b2d4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:47.781513 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-791b4f96-27d2-4067-b37f-68b5041b2d4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:47.783559 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1316/2590] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:26:47 2022] DELETE /identity/v3/projects/4432dcfd6e554a67991a541369f489ef => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:47.787562 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da9c83-cc4a-4e46-8f26-722b68c415ac service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:47.800965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da9c83-cc4a-4e46-8f26-722b68c415ac service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:47.861463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe5a7f-8e2a-42eb-877e-7982583d2e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:47.862501 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe5a7f-8e2a-42eb-877e-7982583d2e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:47.862783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe5a7f-8e2a-42eb-877e-7982583d2e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:47.863056 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe5a7f-8e2a-42eb-877e-7982583d2e71 admin admin] PATH_INFO: `/v3/users/57a557ee84bd43378f21271e4821db95` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:47.864302 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe5a7f-8e2a-42eb-877e-7982583d2e71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a557ee84bd43378f21271e4821db95)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:47.866217 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe5a7f-8e2a-42eb-877e-7982583d2e71 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:48.031153 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e4fe5a7f-8e2a-42eb-877e-7982583d2e71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a557ee84bd43378f21271e4821db95'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:48.031865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e4fe5a7f-8e2a-42eb-877e-7982583d2e71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a557ee84bd43378f21271e4821db95'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:48.046073 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e4fe5a7f-8e2a-42eb-877e-7982583d2e71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a557ee84bd43378f21271e4821db95'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:48.046910 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e4fe5a7f-8e2a-42eb-877e-7982583d2e71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a557ee84bd43378f21271e4821db95'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:48.064043 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e4fe5a7f-8e2a-42eb-877e-7982583d2e71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a557ee84bd43378f21271e4821db95'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:48.143469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1275/2591] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:26:47 2022] DELETE /identity/v3/users/57a557ee84bd43378f21271e4821db95 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:48.609026 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b4f96-27d2-4067-b37f-68b5041b2d4e admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:48.614424 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-791b4f96-27d2-4067-b37f-68b5041b2d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:48.628308 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b4f96-27d2-4067-b37f-68b5041b2d4e admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:48.699456 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724675c0-70b1-4a28-8b62-89be6962a994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:48.700352 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724675c0-70b1-4a28-8b62-89be6962a994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:48.700698 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724675c0-70b1-4a28-8b62-89be6962a994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:48.701007 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724675c0-70b1-4a28-8b62-89be6962a994 admin admin] PATH_INFO: `/v3/projects/88cd9684ca6e432da3692c276fbbf9bc` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:48.702233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724675c0-70b1-4a28-8b62-89be6962a994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88cd9684ca6e432da3692c276fbbf9bc)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:48.704181 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724675c0-70b1-4a28-8b62-89be6962a994 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:48.867381 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-724675c0-70b1-4a28-8b62-89be6962a994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88cd9684ca6e432da3692c276fbbf9bc', 'request_id': 'req-724675c0-70b1-4a28-8b62-89be6962a994'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:48.960074 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-724675c0-70b1-4a28-8b62-89be6962a994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88cd9684ca6e432da3692c276fbbf9bc', 'request_id': 'req-724675c0-70b1-4a28-8b62-89be6962a994'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:48.968133 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-724675c0-70b1-4a28-8b62-89be6962a994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88cd9684ca6e432da3692c276fbbf9bc', 'request_id': 'req-724675c0-70b1-4a28-8b62-89be6962a994'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:48.981825 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-724675c0-70b1-4a28-8b62-89be6962a994 admin admin] The token cache is being invalidate because project 88cd9684ca6e432da3692c276fbbf9bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:26:48.983909 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-724675c0-70b1-4a28-8b62-89be6962a994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:48.983909 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-724675c0-70b1-4a28-8b62-89be6962a994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:48.985179 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1317/2592] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:26:48 2022] DELETE /identity/v3/projects/88cd9684ca6e432da3692c276fbbf9bc => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:48.991023 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e2acd-ac00-48f8-b594-eea57c78ba68 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:48.991537 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e2acd-ac00-48f8-b594-eea57c78ba68 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:48.991651 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e2acd-ac00-48f8-b594-eea57c78ba68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:49.034057 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-af6e2acd-ac00-48f8-b594-eea57c78ba68 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:49.035463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-af6e2acd-ac00-48f8-b594-eea57c78ba68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:49.126306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1276/2593] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:49.134907 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bae6a-68a7-4166-8d54-374a26e43f7f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:49.135214 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bae6a-68a7-4166-8d54-374a26e43f7f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:49.135496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bae6a-68a7-4166-8d54-374a26e43f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:49.155416 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-2b0bae6a-68a7-4166-8d54-374a26e43f7f None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:49.156943 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2b0bae6a-68a7-4166-8d54-374a26e43f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:49.172077 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e2acd-ac00-48f8-b594-eea57c78ba68 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:49.174122 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1318/2594] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:26:49.187123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e2acd-ac00-48f8-b594-eea57c78ba68 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:49.192625 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550123d-a207-41f0-bbd8-bc135b4b3efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:49.193564 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550123d-a207-41f0-bbd8-bc135b4b3efd admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:49.193963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550123d-a207-41f0-bbd8-bc135b4b3efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:49.194310 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550123d-a207-41f0-bbd8-bc135b4b3efd admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:49.195183 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550123d-a207-41f0-bbd8-bc135b4b3efd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:26:49.195572 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550123d-a207-41f0-bbd8-bc135b4b3efd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:49.220695 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550123d-a207-41f0-bbd8-bc135b4b3efd admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:49.220695 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1277/2595] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:26:49.224245 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0bae6a-68a7-4166-8d54-374a26e43f7f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:49.234848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0bae6a-68a7-4166-8d54-374a26e43f7f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:49.241112 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fc84a-b813-4111-87d9-fc21115787bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:49.241780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fc84a-b813-4111-87d9-fc21115787bb admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:49.242208 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fc84a-b813-4111-87d9-fc21115787bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:49.242483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fc84a-b813-4111-87d9-fc21115787bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:49.243184 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fc84a-b813-4111-87d9-fc21115787bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:49.245725 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fc84a-b813-4111-87d9-fc21115787bb admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:49.366344 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1319/2596] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:26:49 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:49.371182 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550123d-a207-41f0-bbd8-bc135b4b3efd admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:49.381331 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550123d-a207-41f0-bbd8-bc135b4b3efd admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:49.438984 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18611e5-5583-420c-95b1-c68612ee51d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:49.439655 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18611e5-5583-420c-95b1-c68612ee51d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:49.439969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18611e5-5583-420c-95b1-c68612ee51d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:49.440245 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18611e5-5583-420c-95b1-c68612ee51d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:49.440936 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18611e5-5583-420c-95b1-c68612ee51d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:49.442922 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18611e5-5583-420c-95b1-c68612ee51d1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:49.560569 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1278/2597] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:26:49 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:49.564653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fc84a-b813-4111-87d9-fc21115787bb admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:49.574644 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fc84a-b813-4111-87d9-fc21115787bb admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:49.579192 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c76ab-d572-4aa2-9e04-bf33d4557071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:49.579874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c76ab-d572-4aa2-9e04-bf33d4557071 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:49.580260 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c76ab-d572-4aa2-9e04-bf33d4557071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:49.580485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c76ab-d572-4aa2-9e04-bf33d4557071 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:49.581238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c76ab-d572-4aa2-9e04-bf33d4557071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:49.582803 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c76ab-d572-4aa2-9e04-bf33d4557071 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:49.593257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1320/2598] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:49.597142 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18611e5-5583-420c-95b1-c68612ee51d1 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:49.607371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18611e5-5583-420c-95b1-c68612ee51d1 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:49.612137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0f3d2-dd6f-4ed7-a586-777e0be0c571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:49.612776 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0f3d2-dd6f-4ed7-a586-777e0be0c571 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:49.613053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0f3d2-dd6f-4ed7-a586-777e0be0c571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:49.613352 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0f3d2-dd6f-4ed7-a586-777e0be0c571 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:49.614033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0f3d2-dd6f-4ed7-a586-777e0be0c571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:49.615596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0f3d2-dd6f-4ed7-a586-777e0be0c571 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:49.627633 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1279/2599] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:49.631779 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c76ab-d572-4aa2-9e04-bf33d4557071 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:49.642251 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c76ab-d572-4aa2-9e04-bf33d4557071 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:49.653961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0ecda-4faa-443a-8483-009d5ac68f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:49.653961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0ecda-4faa-443a-8483-009d5ac68f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:49.653961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0ecda-4faa-443a-8483-009d5ac68f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:49.653961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0ecda-4faa-443a-8483-009d5ac68f0e admin admin] PATH_INFO: `/v3/projects/501f3f5a8f234d738da37d3d77322287/users/79a2f48dbea543d5b773e2b09e3ed3d5/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:49.662965 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0ecda-4faa-443a-8483-009d5ac68f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=501f3f5a8f234d738da37d3d77322287, user_id=79a2f48dbea543d5b773e2b09e3ed3d5, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:49.665605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0ecda-4faa-443a-8483-009d5ac68f0e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:49.725696 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1321/2600] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:49 2022] PUT /identity/v3/projects/501f3f5a8f234d738da37d3d77322287/users/79a2f48dbea543d5b773e2b09e3ed3d5/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:49.737482 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7294bc8-3cea-4df1-b312-33b249da99bf None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:49.737768 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7294bc8-3cea-4df1-b312-33b249da99bf None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:49.738168 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7294bc8-3cea-4df1-b312-33b249da99bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:49.764065 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a7294bc8-3cea-4df1-b312-33b249da99bf None None] MFA Rules not processed for user `79a2f48dbea543d5b773e2b09e3ed3d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:49.765298 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a7294bc8-3cea-4df1-b312-33b249da99bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:49.830386 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1280/2601] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:49.834859 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0ecda-4faa-443a-8483-009d5ac68f0e admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:49.897378 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0ecda-4faa-443a-8483-009d5ac68f0e admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:49.902595 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aff706-f0df-42db-bcc7-e199a1cd83a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:49.904091 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aff706-f0df-42db-bcc7-e199a1cd83a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:49.904091 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aff706-f0df-42db-bcc7-e199a1cd83a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:49.904091 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aff706-f0df-42db-bcc7-e199a1cd83a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:49.904533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aff706-f0df-42db-bcc7-e199a1cd83a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:49.906409 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aff706-f0df-42db-bcc7-e199a1cd83a7 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:49.990043 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1322/2602] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:26:49 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:49.994370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7294bc8-3cea-4df1-b312-33b249da99bf None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:50.006511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7294bc8-3cea-4df1-b312-33b249da99bf None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:50.079908 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd797aa-49cd-4b87-9649-7e656e82e380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:50.080712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd797aa-49cd-4b87-9649-7e656e82e380 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:50.080982 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd797aa-49cd-4b87-9649-7e656e82e380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:50.081256 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd797aa-49cd-4b87-9649-7e656e82e380 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:50.081955 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd797aa-49cd-4b87-9649-7e656e82e380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:50.083941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd797aa-49cd-4b87-9649-7e656e82e380 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:50.162417 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1281/2603] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:26:49 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:50.163622 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aff706-f0df-42db-bcc7-e199a1cd83a7 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:50.174709 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aff706-f0df-42db-bcc7-e199a1cd83a7 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:50.179482 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef925620-0873-4dc4-a48e-4c45321725d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:50.186965 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef925620-0873-4dc4-a48e-4c45321725d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:50.186965 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef925620-0873-4dc4-a48e-4c45321725d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:50.186965 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef925620-0873-4dc4-a48e-4c45321725d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:50.186965 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef925620-0873-4dc4-a48e-4c45321725d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:50.186965 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef925620-0873-4dc4-a48e-4c45321725d9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:50.193585 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1323/2604] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:26:50.197744 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd797aa-49cd-4b87-9649-7e656e82e380 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:50.209351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd797aa-49cd-4b87-9649-7e656e82e380 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:50.214803 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd8b9e-e218-4c17-aa75-cd48d5da60d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:50.215844 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd8b9e-e218-4c17-aa75-cd48d5da60d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:50.216124 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd8b9e-e218-4c17-aa75-cd48d5da60d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:50.216398 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd8b9e-e218-4c17-aa75-cd48d5da60d7 admin admin] PATH_INFO: `/v3/projects/37ad6f8b46714b26a7c5ad4fd69ee3c5/users/ff73a4bd3fca4db88217f92261bfe420/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:50.231485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd8b9e-e218-4c17-aa75-cd48d5da60d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ad6f8b46714b26a7c5ad4fd69ee3c5, user_id=ff73a4bd3fca4db88217f92261bfe420, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:50.234222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd8b9e-e218-4c17-aa75-cd48d5da60d7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:50.333113 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1282/2605] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:50 2022] PUT /identity/v3/projects/37ad6f8b46714b26a7c5ad4fd69ee3c5/users/ff73a4bd3fca4db88217f92261bfe420/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:50.337119 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef925620-0873-4dc4-a48e-4c45321725d9 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:50.348674 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef925620-0873-4dc4-a48e-4c45321725d9 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:50.409330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0dd1c-f77b-4eb5-b8f1-0d1db8b6a027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:50.410043 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0dd1c-f77b-4eb5-b8f1-0d1db8b6a027 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:50.410328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0dd1c-f77b-4eb5-b8f1-0d1db8b6a027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:50.410596 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0dd1c-f77b-4eb5-b8f1-0d1db8b6a027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:50.411320 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0dd1c-f77b-4eb5-b8f1-0d1db8b6a027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:50.416430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0dd1c-f77b-4eb5-b8f1-0d1db8b6a027 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:50.422896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1324/2606] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:50.427155 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd8b9e-e218-4c17-aa75-cd48d5da60d7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:50.437429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd8b9e-e218-4c17-aa75-cd48d5da60d7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:50.442099 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e394b14-417d-4c47-9340-56351bd4710e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:50.452961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e394b14-417d-4c47-9340-56351bd4710e admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:50.452961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e394b14-417d-4c47-9340-56351bd4710e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:50.452961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e394b14-417d-4c47-9340-56351bd4710e admin admin] PATH_INFO: `/v3/projects/37ad6f8b46714b26a7c5ad4fd69ee3c5/users/ff73a4bd3fca4db88217f92261bfe420/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:50.452961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e394b14-417d-4c47-9340-56351bd4710e admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ad6f8b46714b26a7c5ad4fd69ee3c5, user_id=ff73a4bd3fca4db88217f92261bfe420, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:50.452961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e394b14-417d-4c47-9340-56351bd4710e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:50.459069 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1283/2607] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:50 2022] PUT /identity/v3/projects/37ad6f8b46714b26a7c5ad4fd69ee3c5/users/ff73a4bd3fca4db88217f92261bfe420/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:50.469976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ca0dd-7ca7-4048-85a6-09e2d601692e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:50.470351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ca0dd-7ca7-4048-85a6-09e2d601692e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:50.470698 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ca0dd-7ca7-4048-85a6-09e2d601692e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:50.498949 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-df0ca0dd-7ca7-4048-85a6-09e2d601692e None None] MFA Rules not processed for user `ff73a4bd3fca4db88217f92261bfe420`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:50.500204 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-df0ca0dd-7ca7-4048-85a6-09e2d601692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:50.581235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1325/2608] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:50.598265 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e394b14-417d-4c47-9340-56351bd4710e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:50.598265 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2e394b14-417d-4c47-9340-56351bd4710e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:50.651889 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e394b14-417d-4c47-9340-56351bd4710e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:50.655542 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74ac9e-5029-4673-8373-37808d6b45d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:50.656212 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74ac9e-5029-4673-8373-37808d6b45d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:50.656494 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74ac9e-5029-4673-8373-37808d6b45d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:50.656765 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74ac9e-5029-4673-8373-37808d6b45d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:50.665732 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74ac9e-5029-4673-8373-37808d6b45d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:50.667223 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74ac9e-5029-4673-8373-37808d6b45d5 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:50.676604 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1284/2609] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:26:51.221924 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ca0dd-7ca7-4048-85a6-09e2d601692e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:51.286414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ca0dd-7ca7-4048-85a6-09e2d601692e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:51.290927 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fd19c-1e2c-45bd-b850-54ed14ffcb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:51.292383 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fd19c-1e2c-45bd-b850-54ed14ffcb10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:51.292796 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fd19c-1e2c-45bd-b850-54ed14ffcb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:51.293080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fd19c-1e2c-45bd-b850-54ed14ffcb10 admin admin] PATH_INFO: `/v3/users/79a2f48dbea543d5b773e2b09e3ed3d5` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:51.294289 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42fd19c-1e2c-45bd-b850-54ed14ffcb10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79a2f48dbea543d5b773e2b09e3ed3d5)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:51.296514 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42fd19c-1e2c-45bd-b850-54ed14ffcb10 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:51.358513 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74ac9e-5029-4673-8373-37808d6b45d5 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:51.359961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ab74ac9e-5029-4673-8373-37808d6b45d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:51.373378 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74ac9e-5029-4673-8373-37808d6b45d5 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:51.377953 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de7b75-8409-42be-8bf8-dd4d0e04cc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:51.378864 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de7b75-8409-42be-8bf8-dd4d0e04cc0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:51.379149 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de7b75-8409-42be-8bf8-dd4d0e04cc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:51.379424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de7b75-8409-42be-8bf8-dd4d0e04cc0d admin admin] PATH_INFO: `/v3/users/f0e23a950ad84130ac04297e7bddcefa` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:51.380654 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de7b75-8409-42be-8bf8-dd4d0e04cc0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0e23a950ad84130ac04297e7bddcefa)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:51.382555 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de7b75-8409-42be-8bf8-dd4d0e04cc0d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:51.480917 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a42fd19c-1e2c-45bd-b850-54ed14ffcb10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79a2f48dbea543d5b773e2b09e3ed3d5'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:51.481478 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a42fd19c-1e2c-45bd-b850-54ed14ffcb10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79a2f48dbea543d5b773e2b09e3ed3d5'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:51.482092 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a42fd19c-1e2c-45bd-b850-54ed14ffcb10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79a2f48dbea543d5b773e2b09e3ed3d5'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:51.493443 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a42fd19c-1e2c-45bd-b850-54ed14ffcb10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79a2f48dbea543d5b773e2b09e3ed3d5'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:51.500109 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a42fd19c-1e2c-45bd-b850-54ed14ffcb10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79a2f48dbea543d5b773e2b09e3ed3d5'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:51.520945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a1de7b75-8409-42be-8bf8-dd4d0e04cc0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0e23a950ad84130ac04297e7bddcefa'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:51.521600 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a1de7b75-8409-42be-8bf8-dd4d0e04cc0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0e23a950ad84130ac04297e7bddcefa'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:51.534382 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a1de7b75-8409-42be-8bf8-dd4d0e04cc0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0e23a950ad84130ac04297e7bddcefa'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:51.535006 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a1de7b75-8409-42be-8bf8-dd4d0e04cc0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0e23a950ad84130ac04297e7bddcefa'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:51.542568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a1de7b75-8409-42be-8bf8-dd4d0e04cc0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0e23a950ad84130ac04297e7bddcefa'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:51.553099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1326/2610] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:26:51 2022] DELETE /identity/v3/users/79a2f48dbea543d5b773e2b09e3ed3d5 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:51.557479 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82545acc-143e-485c-8f1e-e1118fc37a18 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:51.557770 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82545acc-143e-485c-8f1e-e1118fc37a18 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:51.558071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82545acc-143e-485c-8f1e-e1118fc37a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:51.574171 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-82545acc-143e-485c-8f1e-e1118fc37a18 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:51.575400 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-82545acc-143e-485c-8f1e-e1118fc37a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:51.587676 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1285/2611] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:26:51 2022] DELETE /identity/v3/users/f0e23a950ad84130ac04297e7bddcefa => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:51.592531 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f4fd0-b35d-403d-9a40-af53b4bf2aaa None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:51.592821 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f4fd0-b35d-403d-9a40-af53b4bf2aaa None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:51.601745 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f4fd0-b35d-403d-9a40-af53b4bf2aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:51.610536 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e45f4fd0-b35d-403d-9a40-af53b4bf2aaa None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:51.611651 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e45f4fd0-b35d-403d-9a40-af53b4bf2aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:51.640123 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1327/2612] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:26:51.650190 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82545acc-143e-485c-8f1e-e1118fc37a18 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:51.652834 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-82545acc-143e-485c-8f1e-e1118fc37a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:51.677233 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1286/2613] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:26:51.687374 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f4fd0-b35d-403d-9a40-af53b4bf2aaa None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:51.688798 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e45f4fd0-b35d-403d-9a40-af53b4bf2aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:51.714663 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82545acc-143e-485c-8f1e-e1118fc37a18 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:51.746569 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f4fd0-b35d-403d-9a40-af53b4bf2aaa None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:51.750311 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f77e30-f0e0-48e5-af49-f49763991541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:51.750958 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f77e30-f0e0-48e5-af49-f49763991541 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:51.751241 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f77e30-f0e0-48e5-af49-f49763991541 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:51.751516 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f77e30-f0e0-48e5-af49-f49763991541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:51.760561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f77e30-f0e0-48e5-af49-f49763991541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:51.762281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e5f3b-51c9-442f-9161-96daf317ac3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:51.762526 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f77e30-f0e0-48e5-af49-f49763991541 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:51.762925 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e5f3b-51c9-442f-9161-96daf317ac3a service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:51.763204 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e5f3b-51c9-442f-9161-96daf317ac3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:51.763475 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e5f3b-51c9-442f-9161-96daf317ac3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:51.772025 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1287/2614] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:26:51.773245 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e5f3b-51c9-442f-9161-96daf317ac3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:51.774679 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e5f3b-51c9-442f-9161-96daf317ac3a service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:51.785041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1328/2615] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:26:52.207872 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f77e30-f0e0-48e5-af49-f49763991541 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:52.209335 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-49f77e30-f0e0-48e5-af49-f49763991541 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:52.222200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f77e30-f0e0-48e5-af49-f49763991541 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:52.227118 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6b398-e3dc-4451-9a77-f91ac4fdb292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:52.227762 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6b398-e3dc-4451-9a77-f91ac4fdb292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:52.228406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6b398-e3dc-4451-9a77-f91ac4fdb292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:52.228406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6b398-e3dc-4451-9a77-f91ac4fdb292 admin admin] PATH_INFO: `/v3/projects/2350e78f0cf843eebbe0c1e7a3984f44` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:52.229576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6b398-e3dc-4451-9a77-f91ac4fdb292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2350e78f0cf843eebbe0c1e7a3984f44)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:52.231487 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6b398-e3dc-4451-9a77-f91ac4fdb292 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:52.237828 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e5f3b-51c9-442f-9161-96daf317ac3a service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:52.240078 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e20e5f3b-51c9-442f-9161-96daf317ac3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:52.256269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e5f3b-51c9-442f-9161-96daf317ac3a service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:52.262193 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac0f04-97b8-4c9d-bcd0-c9a928641669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:52.263359 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac0f04-97b8-4c9d-bcd0-c9a928641669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:52.263570 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac0f04-97b8-4c9d-bcd0-c9a928641669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:52.263893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac0f04-97b8-4c9d-bcd0-c9a928641669 admin admin] PATH_INFO: `/v3/projects/501f3f5a8f234d738da37d3d77322287` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:52.265281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac0f04-97b8-4c9d-bcd0-c9a928641669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=501f3f5a8f234d738da37d3d77322287)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:52.267224 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac0f04-97b8-4c9d-bcd0-c9a928641669 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:52.339457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dff6b398-e3dc-4451-9a77-f91ac4fdb292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2350e78f0cf843eebbe0c1e7a3984f44', 'request_id': 'req-dff6b398-e3dc-4451-9a77-f91ac4fdb292'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:52.373474 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-beac0f04-97b8-4c9d-bcd0-c9a928641669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '501f3f5a8f234d738da37d3d77322287', 'request_id': 'req-beac0f04-97b8-4c9d-bcd0-c9a928641669'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:52.433534 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dff6b398-e3dc-4451-9a77-f91ac4fdb292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2350e78f0cf843eebbe0c1e7a3984f44', 'request_id': 'req-dff6b398-e3dc-4451-9a77-f91ac4fdb292'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:52.439520 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dff6b398-e3dc-4451-9a77-f91ac4fdb292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2350e78f0cf843eebbe0c1e7a3984f44', 'request_id': 'req-dff6b398-e3dc-4451-9a77-f91ac4fdb292'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:52.451451 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dff6b398-e3dc-4451-9a77-f91ac4fdb292 admin admin] The token cache is being invalidate because project 2350e78f0cf843eebbe0c1e7a3984f44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:26:52.452128 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dff6b398-e3dc-4451-9a77-f91ac4fdb292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:52.452783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dff6b398-e3dc-4451-9a77-f91ac4fdb292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:52.454388 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1288/2616] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:26:52 2022] DELETE /identity/v3/projects/2350e78f0cf843eebbe0c1e7a3984f44 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:52.458226 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6b398-e3dc-4451-9a77-f91ac4fdb292 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:52.459698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-dff6b398-e3dc-4451-9a77-f91ac4fdb292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:52.497177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-beac0f04-97b8-4c9d-bcd0-c9a928641669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '501f3f5a8f234d738da37d3d77322287', 'request_id': 'req-beac0f04-97b8-4c9d-bcd0-c9a928641669'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:52.502990 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-beac0f04-97b8-4c9d-bcd0-c9a928641669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '501f3f5a8f234d738da37d3d77322287', 'request_id': 'req-beac0f04-97b8-4c9d-bcd0-c9a928641669'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:52.515616 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-beac0f04-97b8-4c9d-bcd0-c9a928641669 admin admin] The token cache is being invalidate because project 501f3f5a8f234d738da37d3d77322287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:26:52.515860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-beac0f04-97b8-4c9d-bcd0-c9a928641669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:52.516773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-beac0f04-97b8-4c9d-bcd0-c9a928641669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:52.518622 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1329/2617] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:26:52 2022] DELETE /identity/v3/projects/501f3f5a8f234d738da37d3d77322287 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:52.522482 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac0f04-97b8-4c9d-bcd0-c9a928641669 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:52.523908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-beac0f04-97b8-4c9d-bcd0-c9a928641669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:52.525071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6b398-e3dc-4451-9a77-f91ac4fdb292 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:52.582895 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee0ffe-cb7a-478e-9266-f1eb385e7bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:52.583651 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee0ffe-cb7a-478e-9266-f1eb385e7bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:52.584055 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee0ffe-cb7a-478e-9266-f1eb385e7bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:52.584433 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee0ffe-cb7a-478e-9266-f1eb385e7bd8 admin admin] PATH_INFO: `/v3/users/06297b2fe5b141c6a8b91e75952544f9` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:52.585806 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee0ffe-cb7a-478e-9266-f1eb385e7bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06297b2fe5b141c6a8b91e75952544f9)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:52.587793 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee0ffe-cb7a-478e-9266-f1eb385e7bd8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:52.591101 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac0f04-97b8-4c9d-bcd0-c9a928641669 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:52.596621 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dd99e-bf71-44bd-ad33-af15e9d2cbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:52.599392 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dd99e-bf71-44bd-ad33-af15e9d2cbb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:52.599392 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dd99e-bf71-44bd-ad33-af15e9d2cbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:52.599392 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dd99e-bf71-44bd-ad33-af15e9d2cbb5 admin admin] PATH_INFO: `/v3/users/ff73a4bd3fca4db88217f92261bfe420` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:52.599392 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dd99e-bf71-44bd-ad33-af15e9d2cbb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff73a4bd3fca4db88217f92261bfe420)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:52.601300 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dd99e-bf71-44bd-ad33-af15e9d2cbb5 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:52.778289 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-54ee0ffe-cb7a-478e-9266-f1eb385e7bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06297b2fe5b141c6a8b91e75952544f9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:52.778893 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-54ee0ffe-cb7a-478e-9266-f1eb385e7bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06297b2fe5b141c6a8b91e75952544f9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:52.789890 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-296dd99e-bf71-44bd-ad33-af15e9d2cbb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff73a4bd3fca4db88217f92261bfe420'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:52.790556 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-296dd99e-bf71-44bd-ad33-af15e9d2cbb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff73a4bd3fca4db88217f92261bfe420'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:52.790806 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-54ee0ffe-cb7a-478e-9266-f1eb385e7bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06297b2fe5b141c6a8b91e75952544f9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:52.791225 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-296dd99e-bf71-44bd-ad33-af15e9d2cbb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff73a4bd3fca4db88217f92261bfe420'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:52.791454 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-54ee0ffe-cb7a-478e-9266-f1eb385e7bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06297b2fe5b141c6a8b91e75952544f9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:52.798546 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-54ee0ffe-cb7a-478e-9266-f1eb385e7bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06297b2fe5b141c6a8b91e75952544f9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:52.803309 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-296dd99e-bf71-44bd-ad33-af15e9d2cbb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff73a4bd3fca4db88217f92261bfe420'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:52.809870 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-296dd99e-bf71-44bd-ad33-af15e9d2cbb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff73a4bd3fca4db88217f92261bfe420'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:52.907790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1289/2618] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:26:52 2022] DELETE /identity/v3/users/06297b2fe5b141c6a8b91e75952544f9 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:52.913164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee0ffe-cb7a-478e-9266-f1eb385e7bd8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:52.913164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-54ee0ffe-cb7a-478e-9266-f1eb385e7bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:52.970149 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1330/2619] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:26:52 2022] DELETE /identity/v3/users/ff73a4bd3fca4db88217f92261bfe420 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:52.989930 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee0ffe-cb7a-478e-9266-f1eb385e7bd8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:53.053557 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf7208-7a06-4fb0-9abb-0f05c1d597e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:53.054568 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf7208-7a06-4fb0-9abb-0f05c1d597e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:53.055334 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf7208-7a06-4fb0-9abb-0f05c1d597e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:53.055334 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf7208-7a06-4fb0-9abb-0f05c1d597e9 admin admin] PATH_INFO: `/v3/users/2da1806e498248e297455f15b9c8bd75` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:53.056435 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf7208-7a06-4fb0-9abb-0f05c1d597e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2da1806e498248e297455f15b9c8bd75)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:53.058877 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf7208-7a06-4fb0-9abb-0f05c1d597e9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:53.236766 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-05bf7208-7a06-4fb0-9abb-0f05c1d597e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2da1806e498248e297455f15b9c8bd75'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:53.237446 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-05bf7208-7a06-4fb0-9abb-0f05c1d597e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2da1806e498248e297455f15b9c8bd75'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:53.250694 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-05bf7208-7a06-4fb0-9abb-0f05c1d597e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2da1806e498248e297455f15b9c8bd75'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:53.251588 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-05bf7208-7a06-4fb0-9abb-0f05c1d597e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2da1806e498248e297455f15b9c8bd75'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:53.259591 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-05bf7208-7a06-4fb0-9abb-0f05c1d597e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2da1806e498248e297455f15b9c8bd75'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:53.320023 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1290/2620] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:26:52 2022] DELETE /identity/v3/users/2da1806e498248e297455f15b9c8bd75 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:53.324615 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be248a7-2eb6-494a-95b0-49e17e3a5e99 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:53.325118 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be248a7-2eb6-494a-95b0-49e17e3a5e99 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:53.325227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be248a7-2eb6-494a-95b0-49e17e3a5e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:53.342488 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-2be248a7-2eb6-494a-95b0-49e17e3a5e99 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:53.343710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2be248a7-2eb6-494a-95b0-49e17e3a5e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:53.367446 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf7208-7a06-4fb0-9abb-0f05c1d597e9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:53.369090 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-05bf7208-7a06-4fb0-9abb-0f05c1d597e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:53.423715 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1331/2621] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:26:53.431647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be248a7-2eb6-494a-95b0-49e17e3a5e99 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:53.434430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2be248a7-2eb6-494a-95b0-49e17e3a5e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:53.451164 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be248a7-2eb6-494a-95b0-49e17e3a5e99 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:53.456030 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf7208-7a06-4fb0-9abb-0f05c1d597e9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:53.463416 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6396c0-b070-40fb-845b-5beed20ec9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:53.463416 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6396c0-b070-40fb-845b-5beed20ec9c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:53.463416 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6396c0-b070-40fb-845b-5beed20ec9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:53.463416 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6396c0-b070-40fb-845b-5beed20ec9c1 admin admin] PATH_INFO: `/v3/projects/51663302e19e46b18f2f380d04952540` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:53.464863 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6396c0-b070-40fb-845b-5beed20ec9c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51663302e19e46b18f2f380d04952540)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:53.465733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cf3c6-bb5c-4d5f-933d-cae38ffffdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:53.466598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cf3c6-bb5c-4d5f-933d-cae38ffffdc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:53.466877 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cf3c6-bb5c-4d5f-933d-cae38ffffdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:53.466993 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6396c0-b070-40fb-845b-5beed20ec9c1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:53.467146 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cf3c6-bb5c-4d5f-933d-cae38ffffdc2 admin admin] PATH_INFO: `/v3/projects/37ad6f8b46714b26a7c5ad4fd69ee3c5` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:53.468357 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182cf3c6-bb5c-4d5f-933d-cae38ffffdc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37ad6f8b46714b26a7c5ad4fd69ee3c5)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:53.470337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182cf3c6-bb5c-4d5f-933d-cae38ffffdc2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:53.566081 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4a6396c0-b070-40fb-845b-5beed20ec9c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51663302e19e46b18f2f380d04952540', 'request_id': 'req-4a6396c0-b070-40fb-845b-5beed20ec9c1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:53.584295 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-182cf3c6-bb5c-4d5f-933d-cae38ffffdc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ad6f8b46714b26a7c5ad4fd69ee3c5', 'request_id': 'req-182cf3c6-bb5c-4d5f-933d-cae38ffffdc2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:53.622430 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4a6396c0-b070-40fb-845b-5beed20ec9c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51663302e19e46b18f2f380d04952540', 'request_id': 'req-4a6396c0-b070-40fb-845b-5beed20ec9c1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:53.628217 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4a6396c0-b070-40fb-845b-5beed20ec9c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51663302e19e46b18f2f380d04952540', 'request_id': 'req-4a6396c0-b070-40fb-845b-5beed20ec9c1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:53.638989 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4a6396c0-b070-40fb-845b-5beed20ec9c1 admin admin] The token cache is being invalidate because project 51663302e19e46b18f2f380d04952540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:26:53.639270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4a6396c0-b070-40fb-845b-5beed20ec9c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:53.639925 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4a6396c0-b070-40fb-845b-5beed20ec9c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:53.641463 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1291/2622] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:26:53 2022] DELETE /identity/v3/projects/51663302e19e46b18f2f380d04952540 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:53.642222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6396c0-b070-40fb-845b-5beed20ec9c1 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:53.643479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4a6396c0-b070-40fb-845b-5beed20ec9c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:53.662270 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-182cf3c6-bb5c-4d5f-933d-cae38ffffdc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ad6f8b46714b26a7c5ad4fd69ee3c5', 'request_id': 'req-182cf3c6-bb5c-4d5f-933d-cae38ffffdc2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:53.669088 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-182cf3c6-bb5c-4d5f-933d-cae38ffffdc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ad6f8b46714b26a7c5ad4fd69ee3c5', 'request_id': 'req-182cf3c6-bb5c-4d5f-933d-cae38ffffdc2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:53.680636 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-182cf3c6-bb5c-4d5f-933d-cae38ffffdc2 admin admin] The token cache is being invalidate because project 37ad6f8b46714b26a7c5ad4fd69ee3c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:26:53.680927 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-182cf3c6-bb5c-4d5f-933d-cae38ffffdc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:53.681590 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-182cf3c6-bb5c-4d5f-933d-cae38ffffdc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:53.683150 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1332/2623] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:26:53 2022] DELETE /identity/v3/projects/37ad6f8b46714b26a7c5ad4fd69ee3c5 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:53.684566 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717da9a4-c61f-4fb8-b466-603a778b6f3d None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:53.684855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717da9a4-c61f-4fb8-b466-603a778b6f3d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:53.685132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717da9a4-c61f-4fb8-b466-603a778b6f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:53.702562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-717da9a4-c61f-4fb8-b466-603a778b6f3d None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:53.703780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-717da9a4-c61f-4fb8-b466-603a778b6f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:53.703932 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6396c0-b070-40fb-845b-5beed20ec9c1 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:53.752345 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b888e12-bb6f-4ec8-adda-754b1fa4c42b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:53.753105 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b888e12-bb6f-4ec8-adda-754b1fa4c42b service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:53.753391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b888e12-bb6f-4ec8-adda-754b1fa4c42b service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:53.753667 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b888e12-bb6f-4ec8-adda-754b1fa4c42b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:53.755570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5b888e12-bb6f-4ec8-adda-754b1fa4c42b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:53.760977 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1333/2624] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:53.762251 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81bf62-9768-44e4-9faa-2de3b86dfdaf None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:53.762537 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81bf62-9768-44e4-9faa-2de3b86dfdaf None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:53.762809 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81bf62-9768-44e4-9faa-2de3b86dfdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:53.768969 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b888e12-bb6f-4ec8-adda-754b1fa4c42b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:53.770521 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b888e12-bb6f-4ec8-adda-754b1fa4c42b service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:53.780692 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-af81bf62-9768-44e4-9faa-2de3b86dfdaf None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:53.780874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1292/2625] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:26:53.781874 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-af81bf62-9768-44e4-9faa-2de3b86dfdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:53.782001 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bc036-c079-49e9-8375-1ee026e8f370 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:53.782242 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bc036-c079-49e9-8375-1ee026e8f370 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:53.782491 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bc036-c079-49e9-8375-1ee026e8f370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:53.790416 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1334/2626] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:53.798698 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e67d30-407d-416a-8c18-43335207c784 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:53.798986 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e67d30-407d-416a-8c18-43335207c784 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:53.799266 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e67d30-407d-416a-8c18-43335207c784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:53.800528 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c42bc036-c079-49e9-8375-1ee026e8f370 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:53.801722 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c42bc036-c079-49e9-8375-1ee026e8f370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:53.809733 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1293/2627] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:53.814306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bc036-c079-49e9-8375-1ee026e8f370 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:53.816710 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e2e67d30-407d-416a-8c18-43335207c784 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:53.817887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e2e67d30-407d-416a-8c18-43335207c784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:53.825092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bc036-c079-49e9-8375-1ee026e8f370 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:53.826091 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1335/2628] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:26:53.830063 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e67d30-407d-416a-8c18-43335207c784 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:53.831121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a1f2d-47d4-4301-8d13-71e34be90f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:53.832189 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a1f2d-47d4-4301-8d13-71e34be90f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:53.832624 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a1f2d-47d4-4301-8d13-71e34be90f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:53.833057 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a1f2d-47d4-4301-8d13-71e34be90f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:53.834005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a1f2d-47d4-4301-8d13-71e34be90f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:26:53.834541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a1f2d-47d4-4301-8d13-71e34be90f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:53.836328 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a1f2d-47d4-4301-8d13-71e34be90f0c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:53.839918 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e67d30-407d-416a-8c18-43335207c784 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:53.846424 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9ea3b-1dfd-4236-9fef-ff35e4da0d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:53.847088 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9ea3b-1dfd-4236-9fef-ff35e4da0d92 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:53.847368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9ea3b-1dfd-4236-9fef-ff35e4da0d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:53.847637 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9ea3b-1dfd-4236-9fef-ff35e4da0d92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:53.848394 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9ea3b-1dfd-4236-9fef-ff35e4da0d92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:26:53.848697 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9ea3b-1dfd-4236-9fef-ff35e4da0d92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:53.850424 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9ea3b-1dfd-4236-9fef-ff35e4da0d92 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:53.854011 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1294/2629] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:26:53.855610 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a1f2d-47d4-4301-8d13-71e34be90f0c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:53.864364 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1336/2630] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:26:53.868465 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a1f2d-47d4-4301-8d13-71e34be90f0c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:53.871562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9ea3b-1dfd-4236-9fef-ff35e4da0d92 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:53.871840 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff90f46-5d7f-435c-91a9-4e966d58f6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:53.872494 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff90f46-5d7f-435c-91a9-4e966d58f6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:53.872774 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff90f46-5d7f-435c-91a9-4e966d58f6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:53.873053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff90f46-5d7f-435c-91a9-4e966d58f6d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:53.873752 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff90f46-5d7f-435c-91a9-4e966d58f6d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:53.875650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff90f46-5d7f-435c-91a9-4e966d58f6d5 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:53.883572 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9ea3b-1dfd-4236-9fef-ff35e4da0d92 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:53.888333 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4324406-fa7e-4111-a81d-b7783c0f9a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:53.889070 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4324406-fa7e-4111-a81d-b7783c0f9a44 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:53.889365 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4324406-fa7e-4111-a81d-b7783c0f9a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:53.889757 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4324406-fa7e-4111-a81d-b7783c0f9a44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:53.890459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4324406-fa7e-4111-a81d-b7783c0f9a44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:53.892383 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4324406-fa7e-4111-a81d-b7783c0f9a44 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:53.968711 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1295/2631] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:26:53 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:53.970582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff90f46-5d7f-435c-91a9-4e966d58f6d5 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:53.979953 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1337/2632] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:26:53 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:53.986492 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4324406-fa7e-4111-a81d-b7783c0f9a44 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:54.051028 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4324406-fa7e-4111-a81d-b7783c0f9a44 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:54.051892 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff90f46-5d7f-435c-91a9-4e966d58f6d5 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:54.056731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7ce87-4c4a-4152-9d5b-2ef30fab918c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:54.057672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7ce87-4c4a-4152-9d5b-2ef30fab918c admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:54.057835 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7ce87-4c4a-4152-9d5b-2ef30fab918c admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:54.058027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7ce87-4c4a-4152-9d5b-2ef30fab918c admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:54.058690 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7ce87-4c4a-4152-9d5b-2ef30fab918c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:54.058945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290039b2-abc5-4cb6-9f8a-385ecf822acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:54.059623 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290039b2-abc5-4cb6-9f8a-385ecf822acf admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:54.059938 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290039b2-abc5-4cb6-9f8a-385ecf822acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:54.060213 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290039b2-abc5-4cb6-9f8a-385ecf822acf admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:54.060636 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7ce87-4c4a-4152-9d5b-2ef30fab918c admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:54.060901 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290039b2-abc5-4cb6-9f8a-385ecf822acf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:54.062929 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290039b2-abc5-4cb6-9f8a-385ecf822acf admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:54.148773 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1338/2633] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:26:53 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:26:54.153289 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7ce87-4c4a-4152-9d5b-2ef30fab918c admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:54.162599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7ce87-4c4a-4152-9d5b-2ef30fab918c admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:54.167220 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310d933-d725-4bbb-a1b2-cb1b4d0cd287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:54.167891 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310d933-d725-4bbb-a1b2-cb1b4d0cd287 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:54.168178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310d933-d725-4bbb-a1b2-cb1b4d0cd287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:54.168454 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310d933-d725-4bbb-a1b2-cb1b4d0cd287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:54.169177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310d933-d725-4bbb-a1b2-cb1b4d0cd287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:54.171171 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310d933-d725-4bbb-a1b2-cb1b4d0cd287 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:54.180493 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1296/2634] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:26:53 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:54.181567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290039b2-abc5-4cb6-9f8a-385ecf822acf admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:54.184591 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1339/2635] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:26:54.188230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310d933-d725-4bbb-a1b2-cb1b4d0cd287 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:54.189991 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6310d933-d725-4bbb-a1b2-cb1b4d0cd287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:54.199764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290039b2-abc5-4cb6-9f8a-385ecf822acf admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:54.203855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310d933-d725-4bbb-a1b2-cb1b4d0cd287 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:54.211565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41396e-f1b5-46f7-925a-d86c8b5005e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:54.211565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41396e-f1b5-46f7-925a-d86c8b5005e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:54.211565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41396e-f1b5-46f7-925a-d86c8b5005e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:54.211565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41396e-f1b5-46f7-925a-d86c8b5005e4 admin admin] PATH_INFO: `/v3/projects/be6d4c367260464da778cbcf0cd4b29b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:54.212410 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41396e-f1b5-46f7-925a-d86c8b5005e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be6d4c367260464da778cbcf0cd4b29b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:54.212663 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a813f42-86c5-44c7-afe9-d12158dede54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:54.212775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41396e-f1b5-46f7-925a-d86c8b5005e4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:54.213375 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a813f42-86c5-44c7-afe9-d12158dede54 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:54.213661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a813f42-86c5-44c7-afe9-d12158dede54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:54.214498 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a813f42-86c5-44c7-afe9-d12158dede54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:54.215331 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a813f42-86c5-44c7-afe9-d12158dede54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:54.216935 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a813f42-86c5-44c7-afe9-d12158dede54 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:54.227830 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1297/2636] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:26:54.228532 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a813f42-86c5-44c7-afe9-d12158dede54 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:54.239575 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a813f42-86c5-44c7-afe9-d12158dede54 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:54.244141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd132c6-87aa-40dd-a90d-236aa63459c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:54.244776 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd132c6-87aa-40dd-a90d-236aa63459c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:54.245054 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd132c6-87aa-40dd-a90d-236aa63459c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:54.245370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd132c6-87aa-40dd-a90d-236aa63459c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:54.246129 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd132c6-87aa-40dd-a90d-236aa63459c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:54.247783 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd132c6-87aa-40dd-a90d-236aa63459c8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:54.258200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1298/2637] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:54.259024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd132c6-87aa-40dd-a90d-236aa63459c8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:54.269092 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd132c6-87aa-40dd-a90d-236aa63459c8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:54.273710 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e4c61-ae7c-4920-84f6-1f9aa9d3209f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:54.274309 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e4c61-ae7c-4920-84f6-1f9aa9d3209f admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:54.274586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e4c61-ae7c-4920-84f6-1f9aa9d3209f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:54.274859 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e4c61-ae7c-4920-84f6-1f9aa9d3209f admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:54.275551 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e4c61-ae7c-4920-84f6-1f9aa9d3209f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:54.277771 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e4c61-ae7c-4920-84f6-1f9aa9d3209f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:54.287506 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1299/2638] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:54.288270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e4c61-ae7c-4920-84f6-1f9aa9d3209f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:54.297459 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e4c61-ae7c-4920-84f6-1f9aa9d3209f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:54.302024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0573bc-6936-4391-8e84-38b98210cd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:54.302841 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0573bc-6936-4391-8e84-38b98210cd84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:54.303116 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0573bc-6936-4391-8e84-38b98210cd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:54.303386 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0573bc-6936-4391-8e84-38b98210cd84 admin admin] PATH_INFO: `/v3/projects/50a42179a9d141648bec8b5232d1038b/users/4f9e52c8ff3f47dcaa8771dd3665fdda/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:54.317569 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0573bc-6936-4391-8e84-38b98210cd84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a42179a9d141648bec8b5232d1038b, user_id=4f9e52c8ff3f47dcaa8771dd3665fdda, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:54.318433 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5b41396e-f1b5-46f7-925a-d86c8b5005e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be6d4c367260464da778cbcf0cd4b29b', 'request_id': 'req-5b41396e-f1b5-46f7-925a-d86c8b5005e4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:54.320237 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0573bc-6936-4391-8e84-38b98210cd84 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:54.387832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5b41396e-f1b5-46f7-925a-d86c8b5005e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be6d4c367260464da778cbcf0cd4b29b', 'request_id': 'req-5b41396e-f1b5-46f7-925a-d86c8b5005e4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:54.393411 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5b41396e-f1b5-46f7-925a-d86c8b5005e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be6d4c367260464da778cbcf0cd4b29b', 'request_id': 'req-5b41396e-f1b5-46f7-925a-d86c8b5005e4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:54.404949 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5b41396e-f1b5-46f7-925a-d86c8b5005e4 admin admin] The token cache is being invalidate because project be6d4c367260464da778cbcf0cd4b29b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:26:54.405122 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1300/2639] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:54 2022] PUT /identity/v3/projects/50a42179a9d141648bec8b5232d1038b/users/4f9e52c8ff3f47dcaa8771dd3665fdda/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:54.405247 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5b41396e-f1b5-46f7-925a-d86c8b5005e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:54.405725 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5b41396e-f1b5-46f7-925a-d86c8b5005e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:54.405828 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0573bc-6936-4391-8e84-38b98210cd84 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:54.407320 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1340/2640] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:26:54 2022] DELETE /identity/v3/projects/be6d4c367260464da778cbcf0cd4b29b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:54.407646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3e0573bc-6936-4391-8e84-38b98210cd84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:54.411861 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0e02e-4fa6-4709-8c52-64ff49ad3584 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:54.412147 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0e02e-4fa6-4709-8c52-64ff49ad3584 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:54.412421 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0e02e-4fa6-4709-8c52-64ff49ad3584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:54.431186 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-b6c0e02e-4fa6-4709-8c52-64ff49ad3584 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:54.432015 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b6c0e02e-4fa6-4709-8c52-64ff49ad3584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:54.481807 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0573bc-6936-4391-8e84-38b98210cd84 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:54.488827 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f956e3-b090-4531-8514-09c41e4d23a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:54.489491 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f956e3-b090-4531-8514-09c41e4d23a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:54.489775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f956e3-b090-4531-8514-09c41e4d23a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:54.490044 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f956e3-b090-4531-8514-09c41e4d23a9 admin admin] PATH_INFO: `/v3/projects/6acbb337667e4613bdea98de91a8f5cd/users/84a07afa00444aef9c867cc0d0aa9103/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:54.496003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1341/2641] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:26:54.504746 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf120c9a-e4cd-47e6-88bf-d8e773d88889 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:54.505040 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf120c9a-e4cd-47e6-88bf-d8e773d88889 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:54.505495 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf120c9a-e4cd-47e6-88bf-d8e773d88889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:54.513865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f956e3-b090-4531-8514-09c41e4d23a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6acbb337667e4613bdea98de91a8f5cd, user_id=84a07afa00444aef9c867cc0d0aa9103, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:54.516562 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f956e3-b090-4531-8514-09c41e4d23a9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:54.534097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-cf120c9a-e4cd-47e6-88bf-d8e773d88889 None None] MFA Rules not processed for user `4f9e52c8ff3f47dcaa8771dd3665fdda`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:54.535388 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-cf120c9a-e4cd-47e6-88bf-d8e773d88889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:54.598318 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1342/2642] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:54.599785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da759a-9546-4bdc-8a29-2c6d3c92f502 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:54.600063 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da759a-9546-4bdc-8a29-2c6d3c92f502 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:54.600340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da759a-9546-4bdc-8a29-2c6d3c92f502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:54.618682 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-71da759a-9546-4bdc-8a29-2c6d3c92f502 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:54.619909 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-71da759a-9546-4bdc-8a29-2c6d3c92f502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:54.631591 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1343/2643] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:54.631591 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da759a-9546-4bdc-8a29-2c6d3c92f502 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:54.632556 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-71da759a-9546-4bdc-8a29-2c6d3c92f502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:54.635739 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1301/2644] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:54 2022] PUT /identity/v3/projects/6acbb337667e4613bdea98de91a8f5cd/users/84a07afa00444aef9c867cc0d0aa9103/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:54.637274 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f956e3-b090-4531-8514-09c41e4d23a9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:54.649401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da759a-9546-4bdc-8a29-2c6d3c92f502 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:54.735004 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dee826-85e2-48da-91b8-888bfbe28545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:54.735930 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dee826-85e2-48da-91b8-888bfbe28545 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:54.736392 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dee826-85e2-48da-91b8-888bfbe28545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:54.736825 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dee826-85e2-48da-91b8-888bfbe28545 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:54.737973 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dee826-85e2-48da-91b8-888bfbe28545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:54.739977 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dee826-85e2-48da-91b8-888bfbe28545 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:54.752834 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f956e3-b090-4531-8514-09c41e4d23a9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:54.760199 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e247f-b9b0-4c96-bce9-bdd7b7bd693d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:54.761724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e247f-b9b0-4c96-bce9-bdd7b7bd693d admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:54.762177 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e247f-b9b0-4c96-bce9-bdd7b7bd693d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:54.762644 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e247f-b9b0-4c96-bce9-bdd7b7bd693d admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:54.763804 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e247f-b9b0-4c96-bce9-bdd7b7bd693d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:26:54.764279 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e247f-b9b0-4c96-bce9-bdd7b7bd693d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:54.767125 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e247f-b9b0-4c96-bce9-bdd7b7bd693d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:54.784049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1302/2645] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:26:54.785800 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc7227-09ca-49dc-911d-9ddd78e5f6b3 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:54.786084 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc7227-09ca-49dc-911d-9ddd78e5f6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:54.786400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc7227-09ca-49dc-911d-9ddd78e5f6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:54.813345 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c8bc7227-09ca-49dc-911d-9ddd78e5f6b3 None None] MFA Rules not processed for user `84a07afa00444aef9c867cc0d0aa9103`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:54.814535 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c8bc7227-09ca-49dc-911d-9ddd78e5f6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:54.844910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1344/2646] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:26:54 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:54.844910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dee826-85e2-48da-91b8-888bfbe28545 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:54.844910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-29dee826-85e2-48da-91b8-888bfbe28545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:54.878978 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1303/2647] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:54.879897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc7227-09ca-49dc-911d-9ddd78e5f6b3 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:54.893410 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc7227-09ca-49dc-911d-9ddd78e5f6b3 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:54.923584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dee826-85e2-48da-91b8-888bfbe28545 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:54.929380 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05104c8-e66d-4651-b4ef-77554813d62d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcd54a927bf46f183b50fbda677868d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:54.930029 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05104c8-e66d-4651-b4ef-77554813d62d service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:54.930310 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05104c8-e66d-4651-b4ef-77554813d62d service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:54.930580 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05104c8-e66d-4651-b4ef-77554813d62d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:54.932378 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d05104c8-e66d-4651-b4ef-77554813d62d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:54.944295 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05104c8-e66d-4651-b4ef-77554813d62d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:54.945856 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05104c8-e66d-4651-b4ef-77554813d62d service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:54.950317 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c188b-bb09-4294-9888-c104e0c08c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:54.950977 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c188b-bb09-4294-9888-c104e0c08c63 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:54.951291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c188b-bb09-4294-9888-c104e0c08c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:54.951565 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c188b-bb09-4294-9888-c104e0c08c63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:54.952297 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c188b-bb09-4294-9888-c104e0c08c63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:54.954164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c188b-bb09-4294-9888-c104e0c08c63 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:54.957055 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1345/2648] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:26:54.957814 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05104c8-e66d-4651-b4ef-77554813d62d service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:54.974414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05104c8-e66d-4651-b4ef-77554813d62d service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:54.979061 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46482e2-10c0-474b-ae19-54271a7af832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:54.981448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46482e2-10c0-474b-ae19-54271a7af832 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:54.981684 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46482e2-10c0-474b-ae19-54271a7af832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:54.981956 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46482e2-10c0-474b-ae19-54271a7af832 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:54.982650 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46482e2-10c0-474b-ae19-54271a7af832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:54.984556 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46482e2-10c0-474b-ae19-54271a7af832 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:55.064899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1304/2649] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:26:54 2022] POST /identity/v3/projects => generated 355 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:55.065723 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c188b-bb09-4294-9888-c104e0c08c63 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:55.080095 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1346/2650] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:26:54 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:55.080997 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46482e2-10c0-474b-ae19-54271a7af832 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:55.091353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46482e2-10c0-474b-ae19-54271a7af832 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:55.127130 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c188b-bb09-4294-9888-c104e0c08c63 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:55.132052 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43440c-12ac-4ed5-945a-4a915f5d7e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:55.132706 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43440c-12ac-4ed5-945a-4a915f5d7e5f admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:55.132985 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43440c-12ac-4ed5-945a-4a915f5d7e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:55.133269 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43440c-12ac-4ed5-945a-4a915f5d7e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:55.134591 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43440c-12ac-4ed5-945a-4a915f5d7e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:55.136522 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43440c-12ac-4ed5-945a-4a915f5d7e5f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:55.150866 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3337e-a4ec-4ec8-8c50-878c79b45667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:55.152110 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3337e-a4ec-4ec8-8c50-878c79b45667 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:55.152396 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3337e-a4ec-4ec8-8c50-878c79b45667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:55.152751 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3337e-a4ec-4ec8-8c50-878c79b45667 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:55.153437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3337e-a4ec-4ec8-8c50-878c79b45667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:55.155367 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3337e-a4ec-4ec8-8c50-878c79b45667 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:55.203071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1305/2651] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:26:55 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:55.203985 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43440c-12ac-4ed5-945a-4a915f5d7e5f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:55.235288 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1347/2652] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:26:55 2022] POST /identity/v3/users => generated 278 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:55.236051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3337e-a4ec-4ec8-8c50-878c79b45667 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:55.245978 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3337e-a4ec-4ec8-8c50-878c79b45667 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:55.267963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43440c-12ac-4ed5-945a-4a915f5d7e5f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:55.274142 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504cdcd-f091-42fd-a7fd-851106d9bcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:55.274820 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504cdcd-f091-42fd-a7fd-851106d9bcdb admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:55.275102 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504cdcd-f091-42fd-a7fd-851106d9bcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:55.275385 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504cdcd-f091-42fd-a7fd-851106d9bcdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:55.276165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504cdcd-f091-42fd-a7fd-851106d9bcdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:55.278318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504cdcd-f091-42fd-a7fd-851106d9bcdb admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:55.288848 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1306/2653] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:55.289599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504cdcd-f091-42fd-a7fd-851106d9bcdb admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:55.300425 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504cdcd-f091-42fd-a7fd-851106d9bcdb admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:55.303034 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2a905-1d47-45a2-ac46-86beab6d7cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:55.303796 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2a905-1d47-45a2-ac46-86beab6d7cbb admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:55.304080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2a905-1d47-45a2-ac46-86beab6d7cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:55.304355 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2a905-1d47-45a2-ac46-86beab6d7cbb admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:55.305049 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2a905-1d47-45a2-ac46-86beab6d7cbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:55.305697 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d58064-ab0d-4bd5-96ac-0434a5c3e39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:55.306421 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d58064-ab0d-4bd5-96ac-0434a5c3e39f admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:55.306778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d58064-ab0d-4bd5-96ac-0434a5c3e39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:55.306939 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2a905-1d47-45a2-ac46-86beab6d7cbb admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:55.307196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d58064-ab0d-4bd5-96ac-0434a5c3e39f admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:55.308094 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d58064-ab0d-4bd5-96ac-0434a5c3e39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:55.309749 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d58064-ab0d-4bd5-96ac-0434a5c3e39f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:55.319547 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1307/2654] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:55.320497 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d58064-ab0d-4bd5-96ac-0434a5c3e39f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:55.330004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d58064-ab0d-4bd5-96ac-0434a5c3e39f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:55.334822 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08d364-ce2a-46af-8c58-2ba7fc30af4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:55.335801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08d364-ce2a-46af-8c58-2ba7fc30af4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:55.336089 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08d364-ce2a-46af-8c58-2ba7fc30af4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:55.336368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08d364-ce2a-46af-8c58-2ba7fc30af4a admin admin] PATH_INFO: `/v3/projects/e802fca7baae42bba62cc6993947dd92/users/d7f031e76c8b49fc9baf32124cc957c5/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:55.351155 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08d364-ce2a-46af-8c58-2ba7fc30af4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e802fca7baae42bba62cc6993947dd92, user_id=d7f031e76c8b49fc9baf32124cc957c5, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:55.354136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08d364-ce2a-46af-8c58-2ba7fc30af4a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:55.382659 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1348/2655] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:26:55 2022] POST /identity/v3/users => generated 300 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:55.383544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2a905-1d47-45a2-ac46-86beab6d7cbb admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:55.392865 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2a905-1d47-45a2-ac46-86beab6d7cbb admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:55.397501 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97e003-373c-428c-a05f-5bb60da152bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:55.398122 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97e003-373c-428c-a05f-5bb60da152bb admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:55.398402 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97e003-373c-428c-a05f-5bb60da152bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:55.398672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97e003-373c-428c-a05f-5bb60da152bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:55.399388 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97e003-373c-428c-a05f-5bb60da152bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:55.400988 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97e003-373c-428c-a05f-5bb60da152bb admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:55.411054 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1349/2656] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:55.411835 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97e003-373c-428c-a05f-5bb60da152bb admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:55.421716 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97e003-373c-428c-a05f-5bb60da152bb admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:55.426253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7430c-543c-4aeb-bfaf-d10b5fb156f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:55.426832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7430c-543c-4aeb-bfaf-d10b5fb156f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:55.427119 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7430c-543c-4aeb-bfaf-d10b5fb156f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:55.427392 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7430c-543c-4aeb-bfaf-d10b5fb156f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:55.428117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7430c-543c-4aeb-bfaf-d10b5fb156f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:55.429603 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7430c-543c-4aeb-bfaf-d10b5fb156f6 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:55.439544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1350/2657] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:55.441183 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7430c-543c-4aeb-bfaf-d10b5fb156f6 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:55.449628 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7430c-543c-4aeb-bfaf-d10b5fb156f6 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:55.454231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd238351-666f-46b7-8ae5-ae76edeb8d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:55.455050 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd238351-666f-46b7-8ae5-ae76edeb8d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:55.455328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd238351-666f-46b7-8ae5-ae76edeb8d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:55.455598 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd238351-666f-46b7-8ae5-ae76edeb8d7f admin admin] PATH_INFO: `/v3/projects/c1820ed2841245d29c46dc84a110838d/users/1ce7d2803edc437ab6a34416ae3a985d/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:55.469046 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1308/2658] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:55 2022] PUT /identity/v3/projects/e802fca7baae42bba62cc6993947dd92/users/d7f031e76c8b49fc9baf32124cc957c5/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:55.472195 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08d364-ce2a-46af-8c58-2ba7fc30af4a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:55.472332 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd238351-666f-46b7-8ae5-ae76edeb8d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1820ed2841245d29c46dc84a110838d, user_id=1ce7d2803edc437ab6a34416ae3a985d, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:55.473204 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd238351-666f-46b7-8ae5-ae76edeb8d7f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:55.531918 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08d364-ce2a-46af-8c58-2ba7fc30af4a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:55.536784 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca045afd-fa24-4f3d-94e5-989867565e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:55.537671 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca045afd-fa24-4f3d-94e5-989867565e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:55.537951 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca045afd-fa24-4f3d-94e5-989867565e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:55.538224 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca045afd-fa24-4f3d-94e5-989867565e82 admin admin] PATH_INFO: `/v3/projects/271ae3a5525f4c3c8a8285522670a843/users/0e0897c3ce844fe399746cf9f40220de/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:55.553210 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca045afd-fa24-4f3d-94e5-989867565e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=271ae3a5525f4c3c8a8285522670a843, user_id=0e0897c3ce844fe399746cf9f40220de, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:55.555932 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca045afd-fa24-4f3d-94e5-989867565e82 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:55.556350 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1351/2659] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:55 2022] PUT /identity/v3/projects/c1820ed2841245d29c46dc84a110838d/users/1ce7d2803edc437ab6a34416ae3a985d/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:55.561596 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd238351-666f-46b7-8ae5-ae76edeb8d7f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:55.621038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd238351-666f-46b7-8ae5-ae76edeb8d7f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:55.625677 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe8afc-7fdb-4c03-a6cd-dcc9760aad7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:55.626329 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe8afc-7fdb-4c03-a6cd-dcc9760aad7f admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:55.626612 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe8afc-7fdb-4c03-a6cd-dcc9760aad7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:55.626887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe8afc-7fdb-4c03-a6cd-dcc9760aad7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:55.627612 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe8afc-7fdb-4c03-a6cd-dcc9760aad7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:55.629227 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe8afc-7fdb-4c03-a6cd-dcc9760aad7f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:55.639233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1352/2660] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:55.640419 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a7733-c4b1-438c-8e85-cf951f65f274 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:55.640707 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a7733-c4b1-438c-8e85-cf951f65f274 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:55.640983 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a7733-c4b1-438c-8e85-cf951f65f274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:55.650085 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1309/2661] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:55 2022] PUT /identity/v3/projects/271ae3a5525f4c3c8a8285522670a843/users/0e0897c3ce844fe399746cf9f40220de/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:55.652700 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca045afd-fa24-4f3d-94e5-989867565e82 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:55.667533 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-168a7733-c4b1-438c-8e85-cf951f65f274 None None] MFA Rules not processed for user `1ce7d2803edc437ab6a34416ae3a985d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:55.669112 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-168a7733-c4b1-438c-8e85-cf951f65f274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:55.712054 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca045afd-fa24-4f3d-94e5-989867565e82 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:55.717569 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7e3c5-92d6-4114-b96b-61a92b6f3a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:55.718467 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7e3c5-92d6-4114-b96b-61a92b6f3a32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:55.718815 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7e3c5-92d6-4114-b96b-61a92b6f3a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:55.719032 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7e3c5-92d6-4114-b96b-61a92b6f3a32 admin admin] PATH_INFO: `/v3/projects/e802fca7baae42bba62cc6993947dd92/users/d7f031e76c8b49fc9baf32124cc957c5/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:55.721066 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7e3c5-92d6-4114-b96b-61a92b6f3a32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e802fca7baae42bba62cc6993947dd92, user_id=d7f031e76c8b49fc9baf32124cc957c5, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:55.723796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7e3c5-92d6-4114-b96b-61a92b6f3a32 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:55.731561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1353/2662] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:55 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:55.732430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a7733-c4b1-438c-8e85-cf951f65f274 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:55.734027 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1310/2663] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:55 2022] PUT /identity/v3/projects/e802fca7baae42bba62cc6993947dd92/users/d7f031e76c8b49fc9baf32124cc957c5/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:55.736169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7e3c5-92d6-4114-b96b-61a92b6f3a32 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:55.743073 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a7733-c4b1-438c-8e85-cf951f65f274 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:55.799954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7e3c5-92d6-4114-b96b-61a92b6f3a32 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:55.803107 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9081978-d15c-4b46-9c68-0db566e35dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:55.803807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9081978-d15c-4b46-9c68-0db566e35dbc admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:55.804090 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9081978-d15c-4b46-9c68-0db566e35dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:55.804390 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9081978-d15c-4b46-9c68-0db566e35dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:55.804577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d4b09-96ba-4a1c-bcc0-389ac45efecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:55.805116 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9081978-d15c-4b46-9c68-0db566e35dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:55.805226 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d4b09-96ba-4a1c-bcc0-389ac45efecc admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:55.805488 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d4b09-96ba-4a1c-bcc0-389ac45efecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:55.805762 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d4b09-96ba-4a1c-bcc0-389ac45efecc admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:55.806445 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d4b09-96ba-4a1c-bcc0-389ac45efecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:55.806700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9081978-d15c-4b46-9c68-0db566e35dbc admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:55.808417 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d4b09-96ba-4a1c-bcc0-389ac45efecc admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:55.819765 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1354/2664] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:55.819765 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f577acd-9a4c-4e7b-ab2e-8ff855bdcc20 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:55.819765 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f577acd-9a4c-4e7b-ab2e-8ff855bdcc20 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:55.819765 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f577acd-9a4c-4e7b-ab2e-8ff855bdcc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:55.847801 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6f577acd-9a4c-4e7b-ab2e-8ff855bdcc20 None None] MFA Rules not processed for user `d7f031e76c8b49fc9baf32124cc957c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:55.849128 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6f577acd-9a4c-4e7b-ab2e-8ff855bdcc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:55.893399 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1311/2665] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:26:55 2022] POST /identity/v3/projects => generated 357 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:26:55.894218 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d4b09-96ba-4a1c-bcc0-389ac45efecc admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:55.916663 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1355/2666] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:55.920962 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f577acd-9a4c-4e7b-ab2e-8ff855bdcc20 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:55.931786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f577acd-9a4c-4e7b-ab2e-8ff855bdcc20 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:55.962615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d4b09-96ba-4a1c-bcc0-389ac45efecc admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:55.970474 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951238e2-a9ba-41b8-b48e-112feb862221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:55.971363 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951238e2-a9ba-41b8-b48e-112feb862221 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:55.972114 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951238e2-a9ba-41b8-b48e-112feb862221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:55.972114 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951238e2-a9ba-41b8-b48e-112feb862221 admin admin] PATH_INFO: `/v3/projects/271ae3a5525f4c3c8a8285522670a843/users/0e0897c3ce844fe399746cf9f40220de/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:55.974299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951238e2-a9ba-41b8-b48e-112feb862221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=271ae3a5525f4c3c8a8285522670a843, user_id=0e0897c3ce844fe399746cf9f40220de, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:55.977201 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951238e2-a9ba-41b8-b48e-112feb862221 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:55.988023 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1312/2667] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:55 2022] PUT /identity/v3/projects/271ae3a5525f4c3c8a8285522670a843/users/0e0897c3ce844fe399746cf9f40220de/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:55.989602 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5443c-93a6-4c3a-b976-5ee3b0aef8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:55.990506 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5443c-93a6-4c3a-b976-5ee3b0aef8ef admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:55.990950 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5443c-93a6-4c3a-b976-5ee3b0aef8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:55.991383 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5443c-93a6-4c3a-b976-5ee3b0aef8ef admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:55.992295 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5443c-93a6-4c3a-b976-5ee3b0aef8ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:55.994200 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5443c-93a6-4c3a-b976-5ee3b0aef8ef admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:55.997173 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951238e2-a9ba-41b8-b48e-112feb862221 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:55.999291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-951238e2-a9ba-41b8-b48e-112feb862221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:56.056259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951238e2-a9ba-41b8-b48e-112feb862221 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:56.060716 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff7ea4-55b1-4fe4-b49c-e63af4042d08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:56.061364 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff7ea4-55b1-4fe4-b49c-e63af4042d08 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:56.061643 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff7ea4-55b1-4fe4-b49c-e63af4042d08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:56.061916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff7ea4-55b1-4fe4-b49c-e63af4042d08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:56.066440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1356/2668] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:26:55 2022] POST /identity/v3/users => generated 285 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:56.066440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b30d8c-72c0-4c30-b08a-f9299df9ece1 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:56.066440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b30d8c-72c0-4c30-b08a-f9299df9ece1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:56.066440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b30d8c-72c0-4c30-b08a-f9299df9ece1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:56.091590 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-62b30d8c-72c0-4c30-b08a-f9299df9ece1 None None] MFA Rules not processed for user `0e0897c3ce844fe399746cf9f40220de`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:56.092844 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-62b30d8c-72c0-4c30-b08a-f9299df9ece1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:56.119412 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff7ea4-55b1-4fe4-b49c-e63af4042d08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:56.121404 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff7ea4-55b1-4fe4-b49c-e63af4042d08 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:56.130689 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1313/2669] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:26:56.131426 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff7ea4-55b1-4fe4-b49c-e63af4042d08 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:56.176033 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1357/2670] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:56.187414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b30d8c-72c0-4c30-b08a-f9299df9ece1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:56.189388 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-62b30d8c-72c0-4c30-b08a-f9299df9ece1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:56.200462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff7ea4-55b1-4fe4-b49c-e63af4042d08 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:56.202496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b30d8c-72c0-4c30-b08a-f9299df9ece1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:56.205608 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700f72f-1d3f-4993-a265-0f614d1ec1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:56.206226 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700f72f-1d3f-4993-a265-0f614d1ec1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:56.206509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700f72f-1d3f-4993-a265-0f614d1ec1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:56.206781 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700f72f-1d3f-4993-a265-0f614d1ec1e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:56.206900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b71f5-be34-4765-ab80-650c1f93ff12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:56.207426 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b71f5-be34-4765-ab80-650c1f93ff12 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:56.207535 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700f72f-1d3f-4993-a265-0f614d1ec1e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:56.207734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b71f5-be34-4765-ab80-650c1f93ff12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:56.208013 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b71f5-be34-4765-ab80-650c1f93ff12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:56.210344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700f72f-1d3f-4993-a265-0f614d1ec1e4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:56.217528 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b71f5-be34-4765-ab80-650c1f93ff12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:56.218989 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b71f5-be34-4765-ab80-650c1f93ff12 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:56.221014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1314/2671] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:56.225476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700f72f-1d3f-4993-a265-0f614d1ec1e4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:56.228877 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1358/2672] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:26:56.236283 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700f72f-1d3f-4993-a265-0f614d1ec1e4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:56.242017 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6dc2d-50fe-482e-8498-a2b749a97fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:56.242893 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6dc2d-50fe-482e-8498-a2b749a97fad admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:56.243171 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6dc2d-50fe-482e-8498-a2b749a97fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:56.243435 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6dc2d-50fe-482e-8498-a2b749a97fad admin admin] PATH_INFO: `/v3/projects/fcbd9fc4e09e4996a6549d59b7b12540/users/9761de197ce34c52ac17929d159d9553/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:56.258911 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f6dc2d-50fe-482e-8498-a2b749a97fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcbd9fc4e09e4996a6549d59b7b12540, user_id=9761de197ce34c52ac17929d159d9553, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:56.261771 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f6dc2d-50fe-482e-8498-a2b749a97fad admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:56.265445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b71f5-be34-4765-ab80-650c1f93ff12 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:56.276593 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b71f5-be34-4765-ab80-650c1f93ff12 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:56.281443 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be7f7a-27b6-401b-83d1-0f6a8b3bbf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:56.282304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be7f7a-27b6-401b-83d1-0f6a8b3bbf61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:56.282584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be7f7a-27b6-401b-83d1-0f6a8b3bbf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:56.282858 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be7f7a-27b6-401b-83d1-0f6a8b3bbf61 admin admin] PATH_INFO: `/v3/users/84a07afa00444aef9c867cc0d0aa9103` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:56.284128 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be7f7a-27b6-401b-83d1-0f6a8b3bbf61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84a07afa00444aef9c867cc0d0aa9103)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:56.286030 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be7f7a-27b6-401b-83d1-0f6a8b3bbf61 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:56.347712 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1315/2673] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:56 2022] PUT /identity/v3/projects/fcbd9fc4e09e4996a6549d59b7b12540/users/9761de197ce34c52ac17929d159d9553/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:56.351535 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6dc2d-50fe-482e-8498-a2b749a97fad admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:56.409830 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6dc2d-50fe-482e-8498-a2b749a97fad admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:56.414499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496b7fc-f5b9-4920-a7f5-39c3f1444e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:56.415150 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496b7fc-f5b9-4920-a7f5-39c3f1444e28 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:56.415427 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496b7fc-f5b9-4920-a7f5-39c3f1444e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:56.415705 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496b7fc-f5b9-4920-a7f5-39c3f1444e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:56.416490 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496b7fc-f5b9-4920-a7f5-39c3f1444e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:56.418574 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496b7fc-f5b9-4920-a7f5-39c3f1444e28 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:56.428400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1316/2674] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:26:56.432417 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496b7fc-f5b9-4920-a7f5-39c3f1444e28 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:56.442944 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496b7fc-f5b9-4920-a7f5-39c3f1444e28 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:56.447619 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b087a-5f26-4399-88d6-5f411863354c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:56.448605 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b087a-5f26-4399-88d6-5f411863354c admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:56.448883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b087a-5f26-4399-88d6-5f411863354c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:56.449150 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b087a-5f26-4399-88d6-5f411863354c admin admin] PATH_INFO: `/v3/projects/fcbd9fc4e09e4996a6549d59b7b12540/users/9761de197ce34c52ac17929d159d9553/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:56.451173 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b087a-5f26-4399-88d6-5f411863354c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcbd9fc4e09e4996a6549d59b7b12540, user_id=9761de197ce34c52ac17929d159d9553, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:56.453824 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b087a-5f26-4399-88d6-5f411863354c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:56.459303 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-46be7f7a-27b6-401b-83d1-0f6a8b3bbf61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84a07afa00444aef9c867cc0d0aa9103'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:56.460201 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-46be7f7a-27b6-401b-83d1-0f6a8b3bbf61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84a07afa00444aef9c867cc0d0aa9103'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:56.460802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-46be7f7a-27b6-401b-83d1-0f6a8b3bbf61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84a07afa00444aef9c867cc0d0aa9103'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:56.463932 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1317/2675] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:56 2022] PUT /identity/v3/projects/fcbd9fc4e09e4996a6549d59b7b12540/users/9761de197ce34c52ac17929d159d9553/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:56.472736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-46be7f7a-27b6-401b-83d1-0f6a8b3bbf61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84a07afa00444aef9c867cc0d0aa9103'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:56.475198 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88243d83-7fa3-4b69-b271-458cd9d323c8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:56.475492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88243d83-7fa3-4b69-b271-458cd9d323c8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:56.475799 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88243d83-7fa3-4b69-b271-458cd9d323c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:56.480160 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-46be7f7a-27b6-401b-83d1-0f6a8b3bbf61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84a07afa00444aef9c867cc0d0aa9103'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:56.503523 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-88243d83-7fa3-4b69-b271-458cd9d323c8 None None] MFA Rules not processed for user `9761de197ce34c52ac17929d159d9553`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:56.504812 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-88243d83-7fa3-4b69-b271-458cd9d323c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:56.543157 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1359/2676] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:26:56 2022] DELETE /identity/v3/users/84a07afa00444aef9c867cc0d0aa9103 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:26:56.547910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ea9c7-c0ca-476b-bb90-852dce4118c3 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:56.548279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ea9c7-c0ca-476b-bb90-852dce4118c3 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:56.548636 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ea9c7-c0ca-476b-bb90-852dce4118c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:56.567092 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-9a2ea9c7-c0ca-476b-bb90-852dce4118c3 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:56.568391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9a2ea9c7-c0ca-476b-bb90-852dce4118c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:56.585584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1318/2677] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:56 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:26:56.617705 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88243d83-7fa3-4b69-b271-458cd9d323c8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:56.619146 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-88243d83-7fa3-4b69-b271-458cd9d323c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:56.634668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1360/2678] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:26:56.644672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ea9c7-c0ca-476b-bb90-852dce4118c3 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:56.646497 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9a2ea9c7-c0ca-476b-bb90-852dce4118c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:56.680303 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88243d83-7fa3-4b69-b271-458cd9d323c8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:56.712821 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ea9c7-c0ca-476b-bb90-852dce4118c3 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:56.717271 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182a2fc-4468-4739-ada4-12c906179adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:56.717922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182a2fc-4468-4739-ada4-12c906179adc service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:56.718212 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182a2fc-4468-4739-ada4-12c906179adc service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:56.718487 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182a2fc-4468-4739-ada4-12c906179adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:56.728123 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182a2fc-4468-4739-ada4-12c906179adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:56.735563 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07856265-653d-4ff4-9841-efd8445dd42f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:56.735563 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07856265-653d-4ff4-9841-efd8445dd42f service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:56.735946 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182a2fc-4468-4739-ada4-12c906179adc service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:56.736057 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07856265-653d-4ff4-9841-efd8445dd42f service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:56.736057 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07856265-653d-4ff4-9841-efd8445dd42f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:56.739665 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1361/2679] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:26:56.797053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07856265-653d-4ff4-9841-efd8445dd42f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:56.798573 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07856265-653d-4ff4-9841-efd8445dd42f service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:56.810311 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1319/2680] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:56 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:26:57.106437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182a2fc-4468-4739-ada4-12c906179adc service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:57.116299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182a2fc-4468-4739-ada4-12c906179adc service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:57.120328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6315d-c7af-4c9c-9cce-3c285afe18d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:57.121144 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6315d-c7af-4c9c-9cce-3c285afe18d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:57.121464 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6315d-c7af-4c9c-9cce-3c285afe18d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:57.121835 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6315d-c7af-4c9c-9cce-3c285afe18d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:57.123848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fed6315d-c7af-4c9c-9cce-3c285afe18d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:57.185923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6315d-c7af-4c9c-9cce-3c285afe18d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:57.187421 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6315d-c7af-4c9c-9cce-3c285afe18d2 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:57.196823 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1362/2681] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:26:57 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:26:57.225624 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07856265-653d-4ff4-9841-efd8445dd42f service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:57.227570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-07856265-653d-4ff4-9841-efd8445dd42f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:57.244163 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07856265-653d-4ff4-9841-efd8445dd42f service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:57.248865 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403348f5-17c4-4868-af5a-2282d02ed89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:57.249752 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403348f5-17c4-4868-af5a-2282d02ed89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:57.250028 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403348f5-17c4-4868-af5a-2282d02ed89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:57.250300 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403348f5-17c4-4868-af5a-2282d02ed89a admin admin] PATH_INFO: `/v3/projects/6acbb337667e4613bdea98de91a8f5cd` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:57.251610 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403348f5-17c4-4868-af5a-2282d02ed89a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6acbb337667e4613bdea98de91a8f5cd)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:57.253594 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403348f5-17c4-4868-af5a-2282d02ed89a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:57.358976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-403348f5-17c4-4868-af5a-2282d02ed89a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6acbb337667e4613bdea98de91a8f5cd', 'request_id': 'req-403348f5-17c4-4868-af5a-2282d02ed89a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:57.427668 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-403348f5-17c4-4868-af5a-2282d02ed89a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6acbb337667e4613bdea98de91a8f5cd', 'request_id': 'req-403348f5-17c4-4868-af5a-2282d02ed89a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:57.434419 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-403348f5-17c4-4868-af5a-2282d02ed89a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6acbb337667e4613bdea98de91a8f5cd', 'request_id': 'req-403348f5-17c4-4868-af5a-2282d02ed89a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:57.446013 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-403348f5-17c4-4868-af5a-2282d02ed89a admin admin] The token cache is being invalidate because project 6acbb337667e4613bdea98de91a8f5cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:26:57.446300 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-403348f5-17c4-4868-af5a-2282d02ed89a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:57.446958 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-403348f5-17c4-4868-af5a-2282d02ed89a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:57.449145 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1320/2682] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:26:57 2022] DELETE /identity/v3/projects/6acbb337667e4613bdea98de91a8f5cd => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:57.453170 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6315d-c7af-4c9c-9cce-3c285afe18d2 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:57.463820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6315d-c7af-4c9c-9cce-3c285afe18d2 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:57.518230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84009f07-a047-4967-9f01-15d9b8e28a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:57.519109 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84009f07-a047-4967-9f01-15d9b8e28a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:57.520665 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84009f07-a047-4967-9f01-15d9b8e28a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:57.520665 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84009f07-a047-4967-9f01-15d9b8e28a82 admin admin] PATH_INFO: `/v3/users/0e0897c3ce844fe399746cf9f40220de` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:57.520864 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84009f07-a047-4967-9f01-15d9b8e28a82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e0897c3ce844fe399746cf9f40220de)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:57.522778 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84009f07-a047-4967-9f01-15d9b8e28a82 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:57.709525 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-84009f07-a047-4967-9f01-15d9b8e28a82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e0897c3ce844fe399746cf9f40220de'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:57.710534 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-84009f07-a047-4967-9f01-15d9b8e28a82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e0897c3ce844fe399746cf9f40220de'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:57.711447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-84009f07-a047-4967-9f01-15d9b8e28a82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e0897c3ce844fe399746cf9f40220de'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:57.726028 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-84009f07-a047-4967-9f01-15d9b8e28a82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e0897c3ce844fe399746cf9f40220de'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:57.733803 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-84009f07-a047-4967-9f01-15d9b8e28a82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e0897c3ce844fe399746cf9f40220de'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:57.811089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1363/2683] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:26:57 2022] DELETE /identity/v3/users/0e0897c3ce844fe399746cf9f40220de => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:58.201114 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403348f5-17c4-4868-af5a-2282d02ed89a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:58.202526 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-403348f5-17c4-4868-af5a-2282d02ed89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:58.216990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403348f5-17c4-4868-af5a-2282d02ed89a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:58.273741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77caf66-af4e-404e-9808-f08dd94648ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:58.274590 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77caf66-af4e-404e-9808-f08dd94648ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:58.274868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77caf66-af4e-404e-9808-f08dd94648ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:58.275138 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77caf66-af4e-404e-9808-f08dd94648ff admin admin] PATH_INFO: `/v3/projects/271ae3a5525f4c3c8a8285522670a843` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:58.276949 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77caf66-af4e-404e-9808-f08dd94648ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=271ae3a5525f4c3c8a8285522670a843)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:58.278926 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77caf66-af4e-404e-9808-f08dd94648ff admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:58.389819 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c77caf66-af4e-404e-9808-f08dd94648ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '271ae3a5525f4c3c8a8285522670a843', 'request_id': 'req-c77caf66-af4e-404e-9808-f08dd94648ff'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:58.627540 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c77caf66-af4e-404e-9808-f08dd94648ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '271ae3a5525f4c3c8a8285522670a843', 'request_id': 'req-c77caf66-af4e-404e-9808-f08dd94648ff'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:58.633587 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c77caf66-af4e-404e-9808-f08dd94648ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '271ae3a5525f4c3c8a8285522670a843', 'request_id': 'req-c77caf66-af4e-404e-9808-f08dd94648ff'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:58.646074 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c77caf66-af4e-404e-9808-f08dd94648ff admin admin] The token cache is being invalidate because project 271ae3a5525f4c3c8a8285522670a843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:26:58.646249 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c77caf66-af4e-404e-9808-f08dd94648ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:58.646915 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c77caf66-af4e-404e-9808-f08dd94648ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:26:58.652574 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1321/2684] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:26:58 2022] DELETE /identity/v3/projects/271ae3a5525f4c3c8a8285522670a843 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:58.655142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa770d31-fe84-4df4-a1a8-09ea9d075ff9 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:58.655694 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa770d31-fe84-4df4-a1a8-09ea9d075ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:58.660853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa770d31-fe84-4df4-a1a8-09ea9d075ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:58.684053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-aa770d31-fe84-4df4-a1a8-09ea9d075ff9 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:58.684053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-aa770d31-fe84-4df4-a1a8-09ea9d075ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:58.751815 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1364/2685] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:58.759870 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebc1c9-e6ef-4a5c-8be2-d5428383937e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:58.760167 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebc1c9-e6ef-4a5c-8be2-d5428383937e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:58.760451 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebc1c9-e6ef-4a5c-8be2-d5428383937e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:58.779644 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-27ebc1c9-e6ef-4a5c-8be2-d5428383937e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:58.780937 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-27ebc1c9-e6ef-4a5c-8be2-d5428383937e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:58.789160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1322/2686] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:26:58.793920 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa770d31-fe84-4df4-a1a8-09ea9d075ff9 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:58.804000 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa770d31-fe84-4df4-a1a8-09ea9d075ff9 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:58.809000 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2154f5-d098-42d5-b6b4-daec7999184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:58.809841 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2154f5-d098-42d5-b6b4-daec7999184a admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:58.809982 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2154f5-d098-42d5-b6b4-daec7999184a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:58.810247 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2154f5-d098-42d5-b6b4-daec7999184a admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:58.810993 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2154f5-d098-42d5-b6b4-daec7999184a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:26:58.811294 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2154f5-d098-42d5-b6b4-daec7999184a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:58.812933 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2154f5-d098-42d5-b6b4-daec7999184a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:58.826140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1365/2687] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:26:58.830736 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebc1c9-e6ef-4a5c-8be2-d5428383937e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:58.841446 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebc1c9-e6ef-4a5c-8be2-d5428383937e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:58.846888 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed1e65-e81e-4aea-9e53-6a4dc908c14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:58.850687 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed1e65-e81e-4aea-9e53-6a4dc908c14e admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:58.850687 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed1e65-e81e-4aea-9e53-6a4dc908c14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:58.850687 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed1e65-e81e-4aea-9e53-6a4dc908c14e admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:58.850687 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed1e65-e81e-4aea-9e53-6a4dc908c14e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:58.851121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed1e65-e81e-4aea-9e53-6a4dc908c14e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:58.982293 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1323/2688] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:26:58 2022] POST /identity/v3/projects => generated 403 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:58.983401 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2154f5-d098-42d5-b6b4-daec7999184a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:58.998929 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2154f5-d098-42d5-b6b4-daec7999184a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:59.062818 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d50d1-887d-4cd9-9a33-cfefefb2af04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:59.063741 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d50d1-887d-4cd9-9a33-cfefefb2af04 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:59.064127 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d50d1-887d-4cd9-9a33-cfefefb2af04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:59.064469 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d50d1-887d-4cd9-9a33-cfefefb2af04 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:59.065260 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d50d1-887d-4cd9-9a33-cfefefb2af04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:59.067426 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d50d1-887d-4cd9-9a33-cfefefb2af04 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:59.149077 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1366/2689] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:26:58 2022] POST /identity/v3/users => generated 302 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:26:59.153241 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed1e65-e81e-4aea-9e53-6a4dc908c14e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:59.163898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed1e65-e81e-4aea-9e53-6a4dc908c14e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:59.170049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc47a0-40b3-4da7-bdec-4c5331f2fdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:59.170716 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc47a0-40b3-4da7-bdec-4c5331f2fdae admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:59.171247 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc47a0-40b3-4da7-bdec-4c5331f2fdae admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:59.171520 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc47a0-40b3-4da7-bdec-4c5331f2fdae admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:59.172284 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc47a0-40b3-4da7-bdec-4c5331f2fdae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:59.173868 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc47a0-40b3-4da7-bdec-4c5331f2fdae admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:59.185618 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1324/2690] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:59.189861 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d50d1-887d-4cd9-9a33-cfefefb2af04 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:59.200763 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d50d1-887d-4cd9-9a33-cfefefb2af04 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:59.205884 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5487c2-379a-4fe2-b4a4-e644ba6edc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:59.206547 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5487c2-379a-4fe2-b4a4-e644ba6edc93 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:59.206826 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5487c2-379a-4fe2-b4a4-e644ba6edc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:59.207103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5487c2-379a-4fe2-b4a4-e644ba6edc93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:59.207870 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5487c2-379a-4fe2-b4a4-e644ba6edc93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:59.209587 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5487c2-379a-4fe2-b4a4-e644ba6edc93 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:59.219920 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1367/2691] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:59.224025 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc47a0-40b3-4da7-bdec-4c5331f2fdae admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:59.234897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc47a0-40b3-4da7-bdec-4c5331f2fdae admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:59.239815 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9285b9-c646-46ac-bb11-7bbf85fcf74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:59.240730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9285b9-c646-46ac-bb11-7bbf85fcf74a admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:59.241103 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9285b9-c646-46ac-bb11-7bbf85fcf74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:59.241396 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9285b9-c646-46ac-bb11-7bbf85fcf74a admin admin] PATH_INFO: `/v3/projects/c4695ed7784d461aa412f618a47afd04/users/c1611adcb275456a9e71b473bacc61d4/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:59.256858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9285b9-c646-46ac-bb11-7bbf85fcf74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4695ed7784d461aa412f618a47afd04, user_id=c1611adcb275456a9e71b473bacc61d4, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:59.259498 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9285b9-c646-46ac-bb11-7bbf85fcf74a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:59.345018 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1325/2692] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:59 2022] PUT /identity/v3/projects/c4695ed7784d461aa412f618a47afd04/users/c1611adcb275456a9e71b473bacc61d4/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:26:59.360442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a16dbd-6227-486c-93ae-d30084e84f90 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:59.360442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a16dbd-6227-486c-93ae-d30084e84f90 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:59.360442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a16dbd-6227-486c-93ae-d30084e84f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:59.392740 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-82a16dbd-6227-486c-93ae-d30084e84f90 None None] MFA Rules not processed for user `c1611adcb275456a9e71b473bacc61d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:26:59.393977 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-82a16dbd-6227-486c-93ae-d30084e84f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:26:59.466730 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1368/2693] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:26:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:26:59.472655 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9285b9-c646-46ac-bb11-7bbf85fcf74a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:59.543047 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9285b9-c646-46ac-bb11-7bbf85fcf74a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:59.548333 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa20a9-82c1-422a-9cb7-4f7deed2b226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:59.549224 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa20a9-82c1-422a-9cb7-4f7deed2b226 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:59.549506 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa20a9-82c1-422a-9cb7-4f7deed2b226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:59.549790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa20a9-82c1-422a-9cb7-4f7deed2b226 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:59.550513 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa20a9-82c1-422a-9cb7-4f7deed2b226 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:59.552580 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa20a9-82c1-422a-9cb7-4f7deed2b226 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:59.643250 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1326/2694] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:26:59 2022] POST /identity/v3/projects => generated 409 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:59.645917 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a16dbd-6227-486c-93ae-d30084e84f90 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:59.658471 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a16dbd-6227-486c-93ae-d30084e84f90 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:59.716696 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee2f9e-4a89-4809-9148-79e9130a6ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:59.717387 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee2f9e-4a89-4809-9148-79e9130a6ded admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:59.717666 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee2f9e-4a89-4809-9148-79e9130a6ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:59.717950 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee2f9e-4a89-4809-9148-79e9130a6ded admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:59.718664 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee2f9e-4a89-4809-9148-79e9130a6ded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:59.720857 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee2f9e-4a89-4809-9148-79e9130a6ded admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:59.887002 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1369/2695] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:26:59 2022] POST /identity/v3/users => generated 311 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:26:59.890892 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa20a9-82c1-422a-9cb7-4f7deed2b226 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:59.901358 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa20a9-82c1-422a-9cb7-4f7deed2b226 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:59.908004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16146f30-77c7-4f06-bce8-63e8bba00d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:59.908843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16146f30-77c7-4f06-bce8-63e8bba00d4e admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:59.909200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16146f30-77c7-4f06-bce8-63e8bba00d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:59.909475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16146f30-77c7-4f06-bce8-63e8bba00d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:59.910381 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16146f30-77c7-4f06-bce8-63e8bba00d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:59.912367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16146f30-77c7-4f06-bce8-63e8bba00d4e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:26:59.926003 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1327/2696] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:26:59.930462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee2f9e-4a89-4809-9148-79e9130a6ded admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:26:59.940669 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee2f9e-4a89-4809-9148-79e9130a6ded admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:26:59.945765 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7e945-b304-49b0-b0ff-fb97ade4eca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:26:59.949448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7e945-b304-49b0-b0ff-fb97ade4eca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:26:59.949448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7e945-b304-49b0-b0ff-fb97ade4eca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:26:59.949448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7e945-b304-49b0-b0ff-fb97ade4eca6 admin admin] PATH_INFO: `/v3/projects/3ef4eb4e2d6e479687d6c34f957338e5/users/a14b2f7c394f428aa30fb601d9b20ddc/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:26:59.963163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7e945-b304-49b0-b0ff-fb97ade4eca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef4eb4e2d6e479687d6c34f957338e5, user_id=a14b2f7c394f428aa30fb601d9b20ddc, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:26:59.966460 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7e945-b304-49b0-b0ff-fb97ade4eca6 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:00.036253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1370/2697] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:26:59 2022] PUT /identity/v3/projects/3ef4eb4e2d6e479687d6c34f957338e5/users/a14b2f7c394f428aa30fb601d9b20ddc/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:27:00.040424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16146f30-77c7-4f06-bce8-63e8bba00d4e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:00.050839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16146f30-77c7-4f06-bce8-63e8bba00d4e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:00.119275 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe516221-ba4c-4fa4-bb56-b309fde12bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:00.120001 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe516221-ba4c-4fa4-bb56-b309fde12bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:00.120285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe516221-ba4c-4fa4-bb56-b309fde12bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:00.120567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe516221-ba4c-4fa4-bb56-b309fde12bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:00.121306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe516221-ba4c-4fa4-bb56-b309fde12bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:00.122905 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe516221-ba4c-4fa4-bb56-b309fde12bb3 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:00.133576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1328/2698] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:27:00.138423 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7e945-b304-49b0-b0ff-fb97ade4eca6 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:00.148951 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7e945-b304-49b0-b0ff-fb97ade4eca6 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:00.154644 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ddc64-525c-4a6f-92a7-ee377ce10e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:00.155567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ddc64-525c-4a6f-92a7-ee377ce10e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:00.155883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ddc64-525c-4a6f-92a7-ee377ce10e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:00.156159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ddc64-525c-4a6f-92a7-ee377ce10e7f admin admin] PATH_INFO: `/v3/projects/3ef4eb4e2d6e479687d6c34f957338e5/users/a14b2f7c394f428aa30fb601d9b20ddc/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:00.158123 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ddc64-525c-4a6f-92a7-ee377ce10e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef4eb4e2d6e479687d6c34f957338e5, user_id=a14b2f7c394f428aa30fb601d9b20ddc, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:00.160780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ddc64-525c-4a6f-92a7-ee377ce10e7f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:00.171592 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1371/2699] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:27:00 2022] PUT /identity/v3/projects/3ef4eb4e2d6e479687d6c34f957338e5/users/a14b2f7c394f428aa30fb601d9b20ddc/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:00.233753 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cfda0-f2ef-4fbd-b19b-c2485d21e0f1 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:00.234350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cfda0-f2ef-4fbd-b19b-c2485d21e0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:00.234464 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cfda0-f2ef-4fbd-b19b-c2485d21e0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:00.265250 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b48cfda0-f2ef-4fbd-b19b-c2485d21e0f1 None None] MFA Rules not processed for user `a14b2f7c394f428aa30fb601d9b20ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:00.266611 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b48cfda0-f2ef-4fbd-b19b-c2485d21e0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:00.358361 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1329/2700] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:00 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:00.369226 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ddc64-525c-4a6f-92a7-ee377ce10e7f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:00.371611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b04ddc64-525c-4a6f-92a7-ee377ce10e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:00.429586 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ddc64-525c-4a6f-92a7-ee377ce10e7f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:00.433898 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8c749-d922-4deb-a48c-e685915336ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:00.434541 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8c749-d922-4deb-a48c-e685915336ed service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:00.434820 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8c749-d922-4deb-a48c-e685915336ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:00.435093 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8c749-d922-4deb-a48c-e685915336ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:00.444953 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8c749-d922-4deb-a48c-e685915336ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:00.446413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8c749-d922-4deb-a48c-e685915336ed service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:00.456979 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1372/2701] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:27:00 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:27:00.862268 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cfda0-f2ef-4fbd-b19b-c2485d21e0f1 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:00.873360 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cfda0-f2ef-4fbd-b19b-c2485d21e0f1 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:00.877188 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a19d98-01cb-491d-a042-290656479d37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:00.877943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a19d98-01cb-491d-a042-290656479d37 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:00.878225 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a19d98-01cb-491d-a042-290656479d37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:00.878552 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a19d98-01cb-491d-a042-290656479d37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:00.944571 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a19d98-01cb-491d-a042-290656479d37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:00.946427 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a19d98-01cb-491d-a042-290656479d37 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:00.956588 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1330/2702] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:27:00 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:27:01.307348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b849c62-11ae-4329-a2d8-e1b83f2bd674 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:01.307884 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b849c62-11ae-4329-a2d8-e1b83f2bd674 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:01.307999 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b849c62-11ae-4329-a2d8-e1b83f2bd674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:01.366354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-2b849c62-11ae-4329-a2d8-e1b83f2bd674 None None] MFA Rules not processed for user `7a25a3f2c9a148a1ae73e519070b190b`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:01.367784 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2b849c62-11ae-4329-a2d8-e1b83f2bd674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:01.434030 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1373/2703] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 12 07:27:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:01.444476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a19d98-01cb-491d-a042-290656479d37 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:01.445302 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f2a19d98-01cb-491d-a042-290656479d37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:01.457002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a19d98-01cb-491d-a042-290656479d37 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:01.460765 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df2686-e137-44f7-b1aa-77da55511a44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:01.461587 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df2686-e137-44f7-b1aa-77da55511a44 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:01.461901 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df2686-e137-44f7-b1aa-77da55511a44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:01.462002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df2686-e137-44f7-b1aa-77da55511a44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:01.463843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-42df2686-e137-44f7-b1aa-77da55511a44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:01.526105 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df2686-e137-44f7-b1aa-77da55511a44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:01.528292 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df2686-e137-44f7-b1aa-77da55511a44 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:01.537905 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1331/2704] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:27:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:27:01.564998 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b849c62-11ae-4329-a2d8-e1b83f2bd674 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:01.566232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2b849c62-11ae-4329-a2d8-e1b83f2bd674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:01.660682 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b849c62-11ae-4329-a2d8-e1b83f2bd674 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:01.665952 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cc4db-3bbc-4640-8c9e-cba7bff0edb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9882820f88349cb8fa2e3d457b19959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:01.666662 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cc4db-3bbc-4640-8c9e-cba7bff0edb3 service swift] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:01.666906 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cc4db-3bbc-4640-8c9e-cba7bff0edb3 service swift] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:01.667184 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cc4db-3bbc-4640-8c9e-cba7bff0edb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:01.675660 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cc4db-3bbc-4640-8c9e-cba7bff0edb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:01.677297 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cc4db-3bbc-4640-8c9e-cba7bff0edb3 service swift] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:01.685359 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1374/2705] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 12 07:27:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 07:27:02.660656 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e59dd5-618f-445e-a8d4-94e4ca520fed None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:02.661135 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e59dd5-618f-445e-a8d4-94e4ca520fed None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:02.661259 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e59dd5-618f-445e-a8d4-94e4ca520fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:02.679665 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-20e59dd5-618f-445e-a8d4-94e4ca520fed None None] MFA Rules not processed for user `7a25a3f2c9a148a1ae73e519070b190b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:02.680916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-20e59dd5-618f-445e-a8d4-94e4ca520fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:02.688615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1332/2706] 10.222.0.25 () {58 vars in 967 bytes} [Thu May 12 07:27:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:02.701351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cc4db-3bbc-4640-8c9e-cba7bff0edb3 service swift] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:02.711865 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cc4db-3bbc-4640-8c9e-cba7bff0edb3 service swift] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:02.717888 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223e5f4-82bc-4798-b88d-c873873865fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9882820f88349cb8fa2e3d457b19959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:02.718643 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223e5f4-82bc-4798-b88d-c873873865fd service swift] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:02.718971 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223e5f4-82bc-4798-b88d-c873873865fd service swift] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:02.719323 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223e5f4-82bc-4798-b88d-c873873865fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:02.728324 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223e5f4-82bc-4798-b88d-c873873865fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:02.730641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223e5f4-82bc-4798-b88d-c873873865fd service swift] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:02.738970 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1375/2707] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 12 07:27:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 07:27:03.392419 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eeac0-1455-4810-bc2d-bc21b591600b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:03.392756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eeac0-1455-4810-bc2d-bc21b591600b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:03.393033 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eeac0-1455-4810-bc2d-bc21b591600b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:03.411569 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b47eeac0-1455-4810-bc2d-bc21b591600b None None] MFA Rules not processed for user `7a25a3f2c9a148a1ae73e519070b190b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:03.412784 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b47eeac0-1455-4810-bc2d-bc21b591600b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:03.419982 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1333/2708] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 12 07:27:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:03.432140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223e5f4-82bc-4798-b88d-c873873865fd service swift] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:03.442383 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223e5f4-82bc-4798-b88d-c873873865fd service swift] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:03.447424 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18d7b2-9eb1-487a-8912-0905320da95b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9882820f88349cb8fa2e3d457b19959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:03.448093 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18d7b2-9eb1-487a-8912-0905320da95b service swift] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:03.448382 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18d7b2-9eb1-487a-8912-0905320da95b service swift] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:03.448658 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18d7b2-9eb1-487a-8912-0905320da95b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:03.456987 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18d7b2-9eb1-487a-8912-0905320da95b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:03.458538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18d7b2-9eb1-487a-8912-0905320da95b service swift] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:03.467098 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1376/2709] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 12 07:27:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 07:27:04.163012 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01998e3-8079-47a1-abe6-2fa8ca7d7869 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:04.163509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01998e3-8079-47a1-abe6-2fa8ca7d7869 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:04.163973 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01998e3-8079-47a1-abe6-2fa8ca7d7869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:04.182478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a01998e3-8079-47a1-abe6-2fa8ca7d7869 None None] MFA Rules not processed for user `7a25a3f2c9a148a1ae73e519070b190b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:04.183829 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a01998e3-8079-47a1-abe6-2fa8ca7d7869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:04.191596 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1334/2710] 10.222.0.25 () {58 vars in 967 bytes} [Thu May 12 07:27:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:04.203766 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18d7b2-9eb1-487a-8912-0905320da95b service swift] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:04.214349 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18d7b2-9eb1-487a-8912-0905320da95b service swift] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:04.219495 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15045834-0a31-44b1-9d59-3e4f3b958036 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9882820f88349cb8fa2e3d457b19959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:04.220170 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15045834-0a31-44b1-9d59-3e4f3b958036 service swift] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:04.220457 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15045834-0a31-44b1-9d59-3e4f3b958036 service swift] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:04.220736 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15045834-0a31-44b1-9d59-3e4f3b958036 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:04.229686 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15045834-0a31-44b1-9d59-3e4f3b958036 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:04.231733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15045834-0a31-44b1-9d59-3e4f3b958036 service swift] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:04.240317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1377/2711] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 12 07:27:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 07:27:07.931207 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01998e3-8079-47a1-abe6-2fa8ca7d7869 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:07.933581 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a01998e3-8079-47a1-abe6-2fa8ca7d7869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:08.006559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01998e3-8079-47a1-abe6-2fa8ca7d7869 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:08.011655 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316d6cf-8101-416e-bf4f-fb79d5438341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:08.013131 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316d6cf-8101-416e-bf4f-fb79d5438341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:08.013408 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316d6cf-8101-416e-bf4f-fb79d5438341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:08.013790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316d6cf-8101-416e-bf4f-fb79d5438341 admin admin] PATH_INFO: `/v3/users/4761df768dea4a90a1ae831cebf0f95f` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:08.015073 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316d6cf-8101-416e-bf4f-fb79d5438341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4761df768dea4a90a1ae831cebf0f95f)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:08.017059 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316d6cf-8101-416e-bf4f-fb79d5438341 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:08.213675 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7316d6cf-8101-416e-bf4f-fb79d5438341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4761df768dea4a90a1ae831cebf0f95f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:08.214249 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7316d6cf-8101-416e-bf4f-fb79d5438341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4761df768dea4a90a1ae831cebf0f95f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:08.226277 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7316d6cf-8101-416e-bf4f-fb79d5438341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4761df768dea4a90a1ae831cebf0f95f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:08.226914 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7316d6cf-8101-416e-bf4f-fb79d5438341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4761df768dea4a90a1ae831cebf0f95f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:08.236351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7316d6cf-8101-416e-bf4f-fb79d5438341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4761df768dea4a90a1ae831cebf0f95f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:08.303668 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1335/2712] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:27:07 2022] DELETE /identity/v3/users/4761df768dea4a90a1ae831cebf0f95f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:08.309263 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b394c-9c7d-46de-aaf7-4e1daf1ea70c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:08.309740 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b394c-9c7d-46de-aaf7-4e1daf1ea70c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:08.309844 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b394c-9c7d-46de-aaf7-4e1daf1ea70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:08.327323 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-700b394c-9c7d-46de-aaf7-4e1daf1ea70c None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:08.331886 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-700b394c-9c7d-46de-aaf7-4e1daf1ea70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:08.392057 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1378/2713] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:08.401532 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316d6cf-8101-416e-bf4f-fb79d5438341 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:08.412348 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7316d6cf-8101-416e-bf4f-fb79d5438341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:08.460056 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316d6cf-8101-416e-bf4f-fb79d5438341 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:08.470511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad86bb-b38b-444e-a745-212325dd3acb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:08.470511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad86bb-b38b-444e-a745-212325dd3acb service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:08.470511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad86bb-b38b-444e-a745-212325dd3acb service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:08.470511 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad86bb-b38b-444e-a745-212325dd3acb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:08.474368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad86bb-b38b-444e-a745-212325dd3acb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:08.475798 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad86bb-b38b-444e-a745-212325dd3acb service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:08.485775 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1336/2714] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:27:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:27:08.705296 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b394c-9c7d-46de-aaf7-4e1daf1ea70c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:08.706889 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-700b394c-9c7d-46de-aaf7-4e1daf1ea70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:08.720328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b394c-9c7d-46de-aaf7-4e1daf1ea70c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:08.725491 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d2d0c-35d0-471f-b04c-fdc0283a95f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:08.726293 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d2d0c-35d0-471f-b04c-fdc0283a95f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:08.726575 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d2d0c-35d0-471f-b04c-fdc0283a95f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:08.726849 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d2d0c-35d0-471f-b04c-fdc0283a95f0 admin admin] PATH_INFO: `/v3/projects/5ae3a88827a548a3814d29074421ad90` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:08.728086 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d2d0c-35d0-471f-b04c-fdc0283a95f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ae3a88827a548a3814d29074421ad90)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:08.730159 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d2d0c-35d0-471f-b04c-fdc0283a95f0 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:08.904714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-284d2d0c-35d0-471f-b04c-fdc0283a95f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ae3a88827a548a3814d29074421ad90', 'request_id': 'req-284d2d0c-35d0-471f-b04c-fdc0283a95f0'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:08.988597 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-284d2d0c-35d0-471f-b04c-fdc0283a95f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ae3a88827a548a3814d29074421ad90', 'request_id': 'req-284d2d0c-35d0-471f-b04c-fdc0283a95f0'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:09.000788 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-284d2d0c-35d0-471f-b04c-fdc0283a95f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ae3a88827a548a3814d29074421ad90', 'request_id': 'req-284d2d0c-35d0-471f-b04c-fdc0283a95f0'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:09.007386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-284d2d0c-35d0-471f-b04c-fdc0283a95f0 admin admin] The token cache is being invalidate because project 5ae3a88827a548a3814d29074421ad90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:27:09.007548 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-284d2d0c-35d0-471f-b04c-fdc0283a95f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:09.008235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-284d2d0c-35d0-471f-b04c-fdc0283a95f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:09.009875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1379/2715] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:27:08 2022] DELETE /identity/v3/projects/5ae3a88827a548a3814d29074421ad90 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:09.015432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91bef6-a2f6-4a97-8b25-0bbf7688bd68 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:09.015954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91bef6-a2f6-4a97-8b25-0bbf7688bd68 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:09.015954 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91bef6-a2f6-4a97-8b25-0bbf7688bd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:09.033100 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-aa91bef6-a2f6-4a97-8b25-0bbf7688bd68 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:09.034291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-aa91bef6-a2f6-4a97-8b25-0bbf7688bd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:09.103847 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1337/2716] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:09.106528 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6df589-f82b-4669-ab9e-1f9fcd3ed57e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:09.106815 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6df589-f82b-4669-ab9e-1f9fcd3ed57e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:09.107087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6df589-f82b-4669-ab9e-1f9fcd3ed57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:09.125434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-bf6df589-f82b-4669-ab9e-1f9fcd3ed57e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:09.126625 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-bf6df589-f82b-4669-ab9e-1f9fcd3ed57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:09.134552 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1380/2717] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:09.139547 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91bef6-a2f6-4a97-8b25-0bbf7688bd68 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:09.149170 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91bef6-a2f6-4a97-8b25-0bbf7688bd68 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:09.154103 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842555d-bd5a-4b3c-99ff-2fe464390f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:09.154830 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842555d-bd5a-4b3c-99ff-2fe464390f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:09.155117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842555d-bd5a-4b3c-99ff-2fe464390f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:09.155392 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842555d-bd5a-4b3c-99ff-2fe464390f39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:09.156249 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842555d-bd5a-4b3c-99ff-2fe464390f39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:27:09.156559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842555d-bd5a-4b3c-99ff-2fe464390f39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:09.158211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842555d-bd5a-4b3c-99ff-2fe464390f39 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:09.169434 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1338/2718] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:27:09.173923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6df589-f82b-4669-ab9e-1f9fcd3ed57e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:09.184350 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6df589-f82b-4669-ab9e-1f9fcd3ed57e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:09.190272 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9e77b-9f7d-4460-b943-72d402fa7bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:09.191000 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9e77b-9f7d-4460-b943-72d402fa7bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:09.191289 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9e77b-9f7d-4460-b943-72d402fa7bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:09.191625 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9e77b-9f7d-4460-b943-72d402fa7bb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:09.192386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9e77b-9f7d-4460-b943-72d402fa7bb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:09.194326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9e77b-9f7d-4460-b943-72d402fa7bb6 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:09.307769 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1381/2719] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:27:09 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:27:09.312336 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842555d-bd5a-4b3c-99ff-2fe464390f39 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:09.323160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842555d-bd5a-4b3c-99ff-2fe464390f39 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:09.381861 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb987a4-ee02-481a-b208-0e0126241d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:09.382937 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb987a4-ee02-481a-b208-0e0126241d38 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:09.383286 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb987a4-ee02-481a-b208-0e0126241d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:09.383541 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb987a4-ee02-481a-b208-0e0126241d38 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:09.384268 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb987a4-ee02-481a-b208-0e0126241d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:09.386254 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb987a4-ee02-481a-b208-0e0126241d38 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:09.532820 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1339/2720] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:27:09 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:27:09.536813 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9e77b-9f7d-4460-b943-72d402fa7bb6 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:09.548047 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9e77b-9f7d-4460-b943-72d402fa7bb6 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:09.553038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec03a9-a947-42a6-b957-b4564c20dd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:09.553761 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec03a9-a947-42a6-b957-b4564c20dd18 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:09.554064 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec03a9-a947-42a6-b957-b4564c20dd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:09.554407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec03a9-a947-42a6-b957-b4564c20dd18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:09.555117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec03a9-a947-42a6-b957-b4564c20dd18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:09.556745 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec03a9-a947-42a6-b957-b4564c20dd18 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:09.568013 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1382/2721] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:27:09.579384 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb987a4-ee02-481a-b208-0e0126241d38 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:09.590042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb987a4-ee02-481a-b208-0e0126241d38 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:09.597437 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d79673-fe48-492e-9843-b852b2f5ddd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:09.598143 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d79673-fe48-492e-9843-b852b2f5ddd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:09.598429 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d79673-fe48-492e-9843-b852b2f5ddd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:09.598817 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d79673-fe48-492e-9843-b852b2f5ddd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:09.599674 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d79673-fe48-492e-9843-b852b2f5ddd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:09.601389 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d79673-fe48-492e-9843-b852b2f5ddd8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:09.616359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1340/2722] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:27:09.618520 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec03a9-a947-42a6-b957-b4564c20dd18 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:09.629567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec03a9-a947-42a6-b957-b4564c20dd18 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:09.634277 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45feac-fabc-4ef3-a868-8420dee614a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:09.635222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45feac-fabc-4ef3-a868-8420dee614a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:09.635503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45feac-fabc-4ef3-a868-8420dee614a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:09.635801 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45feac-fabc-4ef3-a868-8420dee614a3 admin admin] PATH_INFO: `/v3/projects/b0d0d48c1db3496da28cdc39061b3d70/users/d64b5396be8944ce9fafc9034f54d55f/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:09.650028 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45feac-fabc-4ef3-a868-8420dee614a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d0d48c1db3496da28cdc39061b3d70, user_id=d64b5396be8944ce9fafc9034f54d55f, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:09.652806 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45feac-fabc-4ef3-a868-8420dee614a3 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:09.715561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1383/2723] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:27:09 2022] PUT /identity/v3/projects/b0d0d48c1db3496da28cdc39061b3d70/users/d64b5396be8944ce9fafc9034f54d55f/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:09.721027 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f2c4d-94a0-4b10-979c-56803b533798 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:09.721411 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f2c4d-94a0-4b10-979c-56803b533798 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:09.721690 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f2c4d-94a0-4b10-979c-56803b533798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:09.740586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3d3f2c4d-94a0-4b10-979c-56803b533798 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:09.741911 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3d3f2c4d-94a0-4b10-979c-56803b533798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:09.808088 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1341/2724] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:09.817998 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45feac-fabc-4ef3-a868-8420dee614a3 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:09.819811 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6c45feac-fabc-4ef3-a868-8420dee614a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:09.875041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45feac-fabc-4ef3-a868-8420dee614a3 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:09.878703 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b1a5b-67f6-4b2d-af22-dc6fddea121f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:09.879395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b1a5b-67f6-4b2d-af22-dc6fddea121f service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:09.879678 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b1a5b-67f6-4b2d-af22-dc6fddea121f service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:09.879999 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b1a5b-67f6-4b2d-af22-dc6fddea121f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:09.892287 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b1a5b-67f6-4b2d-af22-dc6fddea121f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:09.893995 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b1a5b-67f6-4b2d-af22-dc6fddea121f service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:09.904633 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1384/2725] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:27:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:27:10.128333 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f2c4d-94a0-4b10-979c-56803b533798 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:10.129738 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3d3f2c4d-94a0-4b10-979c-56803b533798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:10.142130 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f2c4d-94a0-4b10-979c-56803b533798 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:10.147164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff27b6-2b21-4d8d-81ae-6b0fb41f16b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:10.148059 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff27b6-2b21-4d8d-81ae-6b0fb41f16b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:10.148340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff27b6-2b21-4d8d-81ae-6b0fb41f16b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:10.148610 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff27b6-2b21-4d8d-81ae-6b0fb41f16b3 admin admin] PATH_INFO: `/v3/users/4f9e52c8ff3f47dcaa8771dd3665fdda` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:10.149807 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff27b6-2b21-4d8d-81ae-6b0fb41f16b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f9e52c8ff3f47dcaa8771dd3665fdda)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:10.151748 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff27b6-2b21-4d8d-81ae-6b0fb41f16b3 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:10.373786 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a3ff27b6-2b21-4d8d-81ae-6b0fb41f16b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f9e52c8ff3f47dcaa8771dd3665fdda'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:10.374453 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a3ff27b6-2b21-4d8d-81ae-6b0fb41f16b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f9e52c8ff3f47dcaa8771dd3665fdda'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:10.386709 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a3ff27b6-2b21-4d8d-81ae-6b0fb41f16b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f9e52c8ff3f47dcaa8771dd3665fdda'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:10.387973 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a3ff27b6-2b21-4d8d-81ae-6b0fb41f16b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f9e52c8ff3f47dcaa8771dd3665fdda'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:10.394823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a3ff27b6-2b21-4d8d-81ae-6b0fb41f16b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f9e52c8ff3f47dcaa8771dd3665fdda'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:10.501364 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1342/2726] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:27:10 2022] DELETE /identity/v3/users/4f9e52c8ff3f47dcaa8771dd3665fdda => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:10.505677 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ab4f5-632f-4a3c-a5e7-4753c57258b6 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:10.505967 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ab4f5-632f-4a3c-a5e7-4753c57258b6 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:10.506242 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ab4f5-632f-4a3c-a5e7-4753c57258b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:10.524266 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4c1ab4f5-632f-4a3c-a5e7-4753c57258b6 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:10.525462 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4c1ab4f5-632f-4a3c-a5e7-4753c57258b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:10.583499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1385/2727] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:10.593408 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff27b6-2b21-4d8d-81ae-6b0fb41f16b3 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:10.601634 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a3ff27b6-2b21-4d8d-81ae-6b0fb41f16b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:10.668091 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff27b6-2b21-4d8d-81ae-6b0fb41f16b3 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:10.672940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16093c-f60a-4770-8aff-51f598218bb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:10.673720 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16093c-f60a-4770-8aff-51f598218bb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:10.674070 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16093c-f60a-4770-8aff-51f598218bb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:10.674421 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16093c-f60a-4770-8aff-51f598218bb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:10.685221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16093c-f60a-4770-8aff-51f598218bb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:10.686678 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16093c-f60a-4770-8aff-51f598218bb0 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:10.698351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1343/2728] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:27:11.276041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ab4f5-632f-4a3c-a5e7-4753c57258b6 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:11.276041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4c1ab4f5-632f-4a3c-a5e7-4753c57258b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:11.279843 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ab4f5-632f-4a3c-a5e7-4753c57258b6 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:11.284610 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77570b91-ea82-4b50-bf36-bdb986a5b10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:11.285480 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77570b91-ea82-4b50-bf36-bdb986a5b10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:11.285764 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77570b91-ea82-4b50-bf36-bdb986a5b10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:11.286042 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77570b91-ea82-4b50-bf36-bdb986a5b10b admin admin] PATH_INFO: `/v3/users/c1611adcb275456a9e71b473bacc61d4` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:11.287244 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77570b91-ea82-4b50-bf36-bdb986a5b10b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1611adcb275456a9e71b473bacc61d4)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:11.289192 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77570b91-ea82-4b50-bf36-bdb986a5b10b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:11.427801 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16093c-f60a-4770-8aff-51f598218bb0 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:11.430610 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0a16093c-f60a-4770-8aff-51f598218bb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:11.450359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16093c-f60a-4770-8aff-51f598218bb0 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:11.454671 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53315ce-7511-4aab-8d5b-39d85367f8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:11.455522 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53315ce-7511-4aab-8d5b-39d85367f8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:11.455839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53315ce-7511-4aab-8d5b-39d85367f8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:11.456116 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53315ce-7511-4aab-8d5b-39d85367f8d8 admin admin] PATH_INFO: `/v3/projects/50a42179a9d141648bec8b5232d1038b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:11.457371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53315ce-7511-4aab-8d5b-39d85367f8d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50a42179a9d141648bec8b5232d1038b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:11.459489 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53315ce-7511-4aab-8d5b-39d85367f8d8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:11.527467 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-77570b91-ea82-4b50-bf36-bdb986a5b10b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1611adcb275456a9e71b473bacc61d4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:11.528432 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-77570b91-ea82-4b50-bf36-bdb986a5b10b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1611adcb275456a9e71b473bacc61d4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:11.529510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-77570b91-ea82-4b50-bf36-bdb986a5b10b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1611adcb275456a9e71b473bacc61d4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:11.545217 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-77570b91-ea82-4b50-bf36-bdb986a5b10b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1611adcb275456a9e71b473bacc61d4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:11.554969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-77570b91-ea82-4b50-bf36-bdb986a5b10b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1611adcb275456a9e71b473bacc61d4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:11.600824 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f53315ce-7511-4aab-8d5b-39d85367f8d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50a42179a9d141648bec8b5232d1038b', 'request_id': 'req-f53315ce-7511-4aab-8d5b-39d85367f8d8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:11.681848 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1386/2729] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:27:11 2022] DELETE /identity/v3/users/c1611adcb275456a9e71b473bacc61d4 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:11.686758 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93038ac-d5c7-48a5-a33f-15f42b37501b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:11.687044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93038ac-d5c7-48a5-a33f-15f42b37501b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:11.687318 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93038ac-d5c7-48a5-a33f-15f42b37501b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:11.704310 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e93038ac-d5c7-48a5-a33f-15f42b37501b None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:11.709053 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e93038ac-d5c7-48a5-a33f-15f42b37501b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:11.765741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f53315ce-7511-4aab-8d5b-39d85367f8d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50a42179a9d141648bec8b5232d1038b', 'request_id': 'req-f53315ce-7511-4aab-8d5b-39d85367f8d8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:11.767905 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1387/2730] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:27:11.772281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f53315ce-7511-4aab-8d5b-39d85367f8d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50a42179a9d141648bec8b5232d1038b', 'request_id': 'req-f53315ce-7511-4aab-8d5b-39d85367f8d8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:11.778030 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93038ac-d5c7-48a5-a33f-15f42b37501b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:11.779562 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e93038ac-d5c7-48a5-a33f-15f42b37501b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:11.785117 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f53315ce-7511-4aab-8d5b-39d85367f8d8 admin admin] The token cache is being invalidate because project 50a42179a9d141648bec8b5232d1038b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:27:11.785581 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f53315ce-7511-4aab-8d5b-39d85367f8d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:11.786242 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f53315ce-7511-4aab-8d5b-39d85367f8d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:11.791366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1344/2731] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:27:11 2022] DELETE /identity/v3/projects/50a42179a9d141648bec8b5232d1038b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:11.792499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53315ce-7511-4aab-8d5b-39d85367f8d8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:11.794526 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f53315ce-7511-4aab-8d5b-39d85367f8d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:11.842510 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93038ac-d5c7-48a5-a33f-15f42b37501b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:11.847813 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dbada-1d45-4d6b-8e1a-45edb90c7898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:11.848472 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dbada-1d45-4d6b-8e1a-45edb90c7898 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:11.848854 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dbada-1d45-4d6b-8e1a-45edb90c7898 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:11.849309 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dbada-1d45-4d6b-8e1a-45edb90c7898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:11.852695 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b21dbada-1d45-4d6b-8e1a-45edb90c7898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:11.864281 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53315ce-7511-4aab-8d5b-39d85367f8d8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:11.867610 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21dbada-1d45-4d6b-8e1a-45edb90c7898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:11.869094 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21dbada-1d45-4d6b-8e1a-45edb90c7898 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:11.869582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e66e5-ef87-467e-b404-9ca4feaeb6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:11.870614 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e66e5-ef87-467e-b404-9ca4feaeb6be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:11.870902 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e66e5-ef87-467e-b404-9ca4feaeb6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:11.871176 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e66e5-ef87-467e-b404-9ca4feaeb6be admin admin] PATH_INFO: `/v3/users/d7f031e76c8b49fc9baf32124cc957c5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:11.873472 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e66e5-ef87-467e-b404-9ca4feaeb6be admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f031e76c8b49fc9baf32124cc957c5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:11.877839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e66e5-ef87-467e-b404-9ca4feaeb6be admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:11.880556 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1388/2732] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:27:12.135913 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ce7e66e5-ef87-467e-b404-9ca4feaeb6be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f031e76c8b49fc9baf32124cc957c5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:12.136676 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ce7e66e5-ef87-467e-b404-9ca4feaeb6be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f031e76c8b49fc9baf32124cc957c5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:12.150035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ce7e66e5-ef87-467e-b404-9ca4feaeb6be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f031e76c8b49fc9baf32124cc957c5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:12.150872 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ce7e66e5-ef87-467e-b404-9ca4feaeb6be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f031e76c8b49fc9baf32124cc957c5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:12.158872 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ce7e66e5-ef87-467e-b404-9ca4feaeb6be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f031e76c8b49fc9baf32124cc957c5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:12.219174 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1345/2733] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:27:11 2022] DELETE /identity/v3/users/d7f031e76c8b49fc9baf32124cc957c5 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:27:12.352635 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dbada-1d45-4d6b-8e1a-45edb90c7898 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:12.354251 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b21dbada-1d45-4d6b-8e1a-45edb90c7898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:12.366675 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dbada-1d45-4d6b-8e1a-45edb90c7898 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:12.452277 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389878c-b066-4d43-8634-5991d8dea9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:12.453293 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389878c-b066-4d43-8634-5991d8dea9ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:12.453668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389878c-b066-4d43-8634-5991d8dea9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:12.454035 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389878c-b066-4d43-8634-5991d8dea9ad admin admin] PATH_INFO: `/v3/projects/c4695ed7784d461aa412f618a47afd04` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:12.455556 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389878c-b066-4d43-8634-5991d8dea9ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4695ed7784d461aa412f618a47afd04)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:12.459209 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389878c-b066-4d43-8634-5991d8dea9ad admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:12.631711 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c389878c-b066-4d43-8634-5991d8dea9ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4695ed7784d461aa412f618a47afd04', 'request_id': 'req-c389878c-b066-4d43-8634-5991d8dea9ad'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:12.707472 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c389878c-b066-4d43-8634-5991d8dea9ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4695ed7784d461aa412f618a47afd04', 'request_id': 'req-c389878c-b066-4d43-8634-5991d8dea9ad'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:12.711185 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c389878c-b066-4d43-8634-5991d8dea9ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4695ed7784d461aa412f618a47afd04', 'request_id': 'req-c389878c-b066-4d43-8634-5991d8dea9ad'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:12.724184 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c389878c-b066-4d43-8634-5991d8dea9ad admin admin] The token cache is being invalidate because project c4695ed7784d461aa412f618a47afd04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:27:12.724473 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c389878c-b066-4d43-8634-5991d8dea9ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:12.725361 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c389878c-b066-4d43-8634-5991d8dea9ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:12.726893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1389/2734] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:27:12 2022] DELETE /identity/v3/projects/c4695ed7784d461aa412f618a47afd04 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:12.733306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e66e5-ef87-467e-b404-9ca4feaeb6be admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:12.735351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ce7e66e5-ef87-467e-b404-9ca4feaeb6be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:12.748934 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e66e5-ef87-467e-b404-9ca4feaeb6be admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:12.817726 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716d547-07da-47f3-9315-fcd068edaa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:12.819074 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716d547-07da-47f3-9315-fcd068edaa18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:12.822948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716d547-07da-47f3-9315-fcd068edaa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:12.822948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716d547-07da-47f3-9315-fcd068edaa18 admin admin] PATH_INFO: `/v3/users/a14b2f7c394f428aa30fb601d9b20ddc` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:12.822948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716d547-07da-47f3-9315-fcd068edaa18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a14b2f7c394f428aa30fb601d9b20ddc)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:12.826228 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389878c-b066-4d43-8634-5991d8dea9ad admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:12.827036 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716d547-07da-47f3-9315-fcd068edaa18 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:12.828869 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c389878c-b066-4d43-8634-5991d8dea9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:12.845567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389878c-b066-4d43-8634-5991d8dea9ad admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:12.851994 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721221a1-90d6-456a-9636-6fab26fc0915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:12.853513 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721221a1-90d6-456a-9636-6fab26fc0915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:12.854134 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721221a1-90d6-456a-9636-6fab26fc0915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:12.854421 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721221a1-90d6-456a-9636-6fab26fc0915 admin admin] PATH_INFO: `/v3/projects/e802fca7baae42bba62cc6993947dd92` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:12.855779 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721221a1-90d6-456a-9636-6fab26fc0915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e802fca7baae42bba62cc6993947dd92)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:12.857927 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721221a1-90d6-456a-9636-6fab26fc0915 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:13.014567 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-721221a1-90d6-456a-9636-6fab26fc0915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e802fca7baae42bba62cc6993947dd92', 'request_id': 'req-721221a1-90d6-456a-9636-6fab26fc0915'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:13.015532 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8716d547-07da-47f3-9315-fcd068edaa18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a14b2f7c394f428aa30fb601d9b20ddc'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:13.016350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8716d547-07da-47f3-9315-fcd068edaa18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a14b2f7c394f428aa30fb601d9b20ddc'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:13.030218 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8716d547-07da-47f3-9315-fcd068edaa18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a14b2f7c394f428aa30fb601d9b20ddc'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:13.031049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8716d547-07da-47f3-9315-fcd068edaa18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a14b2f7c394f428aa30fb601d9b20ddc'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:13.038594 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8716d547-07da-47f3-9315-fcd068edaa18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a14b2f7c394f428aa30fb601d9b20ddc'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:13.064395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-721221a1-90d6-456a-9636-6fab26fc0915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e802fca7baae42bba62cc6993947dd92', 'request_id': 'req-721221a1-90d6-456a-9636-6fab26fc0915'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:13.072176 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-721221a1-90d6-456a-9636-6fab26fc0915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e802fca7baae42bba62cc6993947dd92', 'request_id': 'req-721221a1-90d6-456a-9636-6fab26fc0915'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:13.086825 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-721221a1-90d6-456a-9636-6fab26fc0915 admin admin] The token cache is being invalidate because project e802fca7baae42bba62cc6993947dd92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:27:13.087411 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-721221a1-90d6-456a-9636-6fab26fc0915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:13.088136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-721221a1-90d6-456a-9636-6fab26fc0915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:13.094389 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1390/2735] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:27:12 2022] DELETE /identity/v3/projects/e802fca7baae42bba62cc6993947dd92 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:27:13.096239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811a500-58a0-4b90-a50e-f94b9a15af0a None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:13.096583 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811a500-58a0-4b90-a50e-f94b9a15af0a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:13.096806 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811a500-58a0-4b90-a50e-f94b9a15af0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:13.117467 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-b811a500-58a0-4b90-a50e-f94b9a15af0a None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:13.118794 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b811a500-58a0-4b90-a50e-f94b9a15af0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:13.151606 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1346/2736] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:27:12 2022] DELETE /identity/v3/users/a14b2f7c394f428aa30fb601d9b20ddc => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:13.197552 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1391/2737] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:13.200011 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dee53-39b0-47d3-8162-fa3ef981f090 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:13.200299 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dee53-39b0-47d3-8162-fa3ef981f090 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:13.200574 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dee53-39b0-47d3-8162-fa3ef981f090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:13.222731 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-832dee53-39b0-47d3-8162-fa3ef981f090 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:13.224010 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-832dee53-39b0-47d3-8162-fa3ef981f090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:13.305015 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1347/2738] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:13.309802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811a500-58a0-4b90-a50e-f94b9a15af0a None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:13.320794 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811a500-58a0-4b90-a50e-f94b9a15af0a None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:13.325901 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0aa63-9f44-45e8-b7bc-c2850619c20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:13.326581 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0aa63-9f44-45e8-b7bc-c2850619c20a admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:13.326860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0aa63-9f44-45e8-b7bc-c2850619c20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:13.327161 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0aa63-9f44-45e8-b7bc-c2850619c20a admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:13.327926 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0aa63-9f44-45e8-b7bc-c2850619c20a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:27:13.328233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0aa63-9f44-45e8-b7bc-c2850619c20a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:13.329833 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0aa63-9f44-45e8-b7bc-c2850619c20a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:13.345426 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1392/2739] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:27:13.348139 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dee53-39b0-47d3-8162-fa3ef981f090 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:13.358349 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dee53-39b0-47d3-8162-fa3ef981f090 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:13.368422 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5b300-cfad-40c8-a98a-0b3e76d40d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:13.369116 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5b300-cfad-40c8-a98a-0b3e76d40d02 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:13.369401 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5b300-cfad-40c8-a98a-0b3e76d40d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:13.369677 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5b300-cfad-40c8-a98a-0b3e76d40d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:13.370473 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5b300-cfad-40c8-a98a-0b3e76d40d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:13.373319 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5b300-cfad-40c8-a98a-0b3e76d40d02 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:13.534298 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1348/2740] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:27:13 2022] POST /identity/v3/projects => generated 367 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:27:13.536456 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0aa63-9f44-45e8-b7bc-c2850619c20a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:13.547887 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0aa63-9f44-45e8-b7bc-c2850619c20a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:13.613537 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5b300-cfad-40c8-a98a-0b3e76d40d02 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:13.617431 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d8c5b300-cfad-40c8-a98a-0b3e76d40d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:13.617691 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb08bb-a460-489d-abd9-3b27995b870f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:13.618582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb08bb-a460-489d-abd9-3b27995b870f admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:13.619054 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb08bb-a460-489d-abd9-3b27995b870f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:13.619514 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb08bb-a460-489d-abd9-3b27995b870f admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:13.620234 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb08bb-a460-489d-abd9-3b27995b870f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:13.622379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb08bb-a460-489d-abd9-3b27995b870f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:13.644915 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5b300-cfad-40c8-a98a-0b3e76d40d02 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:13.655552 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbc810-ee1d-4bda-85ce-1f1508049584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:13.656495 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbc810-ee1d-4bda-85ce-1f1508049584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:13.656846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbc810-ee1d-4bda-85ce-1f1508049584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:13.657123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbc810-ee1d-4bda-85ce-1f1508049584 admin admin] PATH_INFO: `/v3/projects/3ef4eb4e2d6e479687d6c34f957338e5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:13.658424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbc810-ee1d-4bda-85ce-1f1508049584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ef4eb4e2d6e479687d6c34f957338e5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:13.661599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbc810-ee1d-4bda-85ce-1f1508049584 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:13.734941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1393/2741] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:27:13 2022] POST /identity/v3/users => generated 284 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:27:13.736563 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb08bb-a460-489d-abd9-3b27995b870f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:13.749993 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb08bb-a460-489d-abd9-3b27995b870f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:13.757073 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89df7f-d31e-47e9-9758-9a5e7e7a339d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:13.758179 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89df7f-d31e-47e9-9758-9a5e7e7a339d admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:13.758715 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89df7f-d31e-47e9-9758-9a5e7e7a339d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:13.759182 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89df7f-d31e-47e9-9758-9a5e7e7a339d admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:13.760256 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89df7f-d31e-47e9-9758-9a5e7e7a339d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:13.772724 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89df7f-d31e-47e9-9758-9a5e7e7a339d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:13.781868 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1394/2742] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:27:13.783130 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89df7f-d31e-47e9-9758-9a5e7e7a339d admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:13.795237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89df7f-d31e-47e9-9758-9a5e7e7a339d admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:13.801235 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b3583-4668-4913-97a7-aafe2d8e5021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:13.802315 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b3583-4668-4913-97a7-aafe2d8e5021 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:13.802794 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b3583-4668-4913-97a7-aafe2d8e5021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:13.803313 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b3583-4668-4913-97a7-aafe2d8e5021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:13.804351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b3583-4668-4913-97a7-aafe2d8e5021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:13.806330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b3583-4668-4913-97a7-aafe2d8e5021 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:13.839384 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1395/2743] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:27:13.842256 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b3583-4668-4913-97a7-aafe2d8e5021 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:13.860711 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f7fbc810-ee1d-4bda-85ce-1f1508049584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ef4eb4e2d6e479687d6c34f957338e5', 'request_id': 'req-f7fbc810-ee1d-4bda-85ce-1f1508049584'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:13.872213 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b3583-4668-4913-97a7-aafe2d8e5021 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:13.942630 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cee9a-957b-4b82-a397-bf3fc1a59a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:13.943851 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cee9a-957b-4b82-a397-bf3fc1a59a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:13.948440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cee9a-957b-4b82-a397-bf3fc1a59a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:13.948440 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cee9a-957b-4b82-a397-bf3fc1a59a0c admin admin] PATH_INFO: `/v3/projects/499e0fc59a4d498090bfc5e5f7c38de4/users/ef86e4e4600949e09fae8d4b929305ad/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:13.969741 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cee9a-957b-4b82-a397-bf3fc1a59a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=499e0fc59a4d498090bfc5e5f7c38de4, user_id=ef86e4e4600949e09fae8d4b929305ad, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:13.972027 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f7fbc810-ee1d-4bda-85ce-1f1508049584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ef4eb4e2d6e479687d6c34f957338e5', 'request_id': 'req-f7fbc810-ee1d-4bda-85ce-1f1508049584'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:13.973223 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cee9a-957b-4b82-a397-bf3fc1a59a0c admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:13.978408 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f7fbc810-ee1d-4bda-85ce-1f1508049584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ef4eb4e2d6e479687d6c34f957338e5', 'request_id': 'req-f7fbc810-ee1d-4bda-85ce-1f1508049584'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:14.001202 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f7fbc810-ee1d-4bda-85ce-1f1508049584 admin admin] The token cache is being invalidate because project 3ef4eb4e2d6e479687d6c34f957338e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:27:14.001685 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f7fbc810-ee1d-4bda-85ce-1f1508049584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:14.002496 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f7fbc810-ee1d-4bda-85ce-1f1508049584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:14.005023 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1349/2744] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:27:13 2022] DELETE /identity/v3/projects/3ef4eb4e2d6e479687d6c34f957338e5 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:14.009730 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612a0c4-f450-4733-826d-cb21e745dda7 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:14.010133 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612a0c4-f450-4733-826d-cb21e745dda7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:14.010673 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612a0c4-f450-4733-826d-cb21e745dda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:14.035675 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b612a0c4-f450-4733-826d-cb21e745dda7 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:14.037594 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b612a0c4-f450-4733-826d-cb21e745dda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:14.048366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1350/2745] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:14.057319 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d3985-3a69-43d8-bbe1-909ab1c921e9 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:14.057677 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d3985-3a69-43d8-bbe1-909ab1c921e9 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:14.058026 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d3985-3a69-43d8-bbe1-909ab1c921e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:14.085404 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-450d3985-3a69-43d8-bbe1-909ab1c921e9 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:14.085609 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1396/2746] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:27:13 2022] PUT /identity/v3/projects/499e0fc59a4d498090bfc5e5f7c38de4/users/ef86e4e4600949e09fae8d4b929305ad/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:14.098340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-450d3985-3a69-43d8-bbe1-909ab1c921e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:14.175546 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1de16a-b8e1-4afa-b119-229ad73c4a91 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:14.175863 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1de16a-b8e1-4afa-b119-229ad73c4a91 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:14.176229 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1de16a-b8e1-4afa-b119-229ad73c4a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:14.227512 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-7a1de16a-b8e1-4afa-b119-229ad73c4a91 None None] MFA Rules not processed for user `ef86e4e4600949e09fae8d4b929305ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:14.229844 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7a1de16a-b8e1-4afa-b119-229ad73c4a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:14.247002 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1351/2747] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:14.248016 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d3985-3a69-43d8-bbe1-909ab1c921e9 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:14.257501 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d3985-3a69-43d8-bbe1-909ab1c921e9 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:14.263599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1ef9b-451d-487c-9faf-13c7d438e719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:14.264576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1ef9b-451d-487c-9faf-13c7d438e719 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:14.264858 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1ef9b-451d-487c-9faf-13c7d438e719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:14.265132 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1ef9b-451d-487c-9faf-13c7d438e719 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:14.265916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1ef9b-451d-487c-9faf-13c7d438e719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:27:14.266854 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1ef9b-451d-487c-9faf-13c7d438e719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:14.268587 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1ef9b-451d-487c-9faf-13c7d438e719 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:14.285592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1352/2748] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:27:14.293932 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1ef9b-451d-487c-9faf-13c7d438e719 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:14.310898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1ef9b-451d-487c-9faf-13c7d438e719 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:14.318450 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945fbe8-3a54-475d-8ca4-9748570e5c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:14.319194 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945fbe8-3a54-475d-8ca4-9748570e5c99 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:14.319573 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945fbe8-3a54-475d-8ca4-9748570e5c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:14.320523 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945fbe8-3a54-475d-8ca4-9748570e5c99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:14.321920 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945fbe8-3a54-475d-8ca4-9748570e5c99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:14.324181 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1397/2749] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:27:14.331053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945fbe8-3a54-475d-8ca4-9748570e5c99 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:14.339452 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1de16a-b8e1-4afa-b119-229ad73c4a91 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:14.341785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7a1de16a-b8e1-4afa-b119-229ad73c4a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:14.425030 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1353/2750] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:27:14 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:27:14.429330 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945fbe8-3a54-475d-8ca4-9748570e5c99 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:14.445908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1de16a-b8e1-4afa-b119-229ad73c4a91 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:14.513220 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddea66-3e57-4c8b-a4ed-4d7040d387b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a08d8e39f6f42bc9b93dd6d2311bcbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:14.514211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945fbe8-3a54-475d-8ca4-9748570e5c99 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:14.514389 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddea66-3e57-4c8b-a4ed-4d7040d387b3 service glance] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:14.514583 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddea66-3e57-4c8b-a4ed-4d7040d387b3 service glance] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:14.514861 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddea66-3e57-4c8b-a4ed-4d7040d387b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:14.522835 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bea7cf-9cff-4a29-91ae-7e6631f225b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:14.523933 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bea7cf-9cff-4a29-91ae-7e6631f225b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:14.524403 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bea7cf-9cff-4a29-91ae-7e6631f225b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:14.524978 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bea7cf-9cff-4a29-91ae-7e6631f225b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:14.526221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bea7cf-9cff-4a29-91ae-7e6631f225b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:14.529250 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bea7cf-9cff-4a29-91ae-7e6631f225b5 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:14.585781 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddea66-3e57-4c8b-a4ed-4d7040d387b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:14.587119 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddea66-3e57-4c8b-a4ed-4d7040d387b3 service glance] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:14.598555 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1398/2751] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:27:14 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:27:14.643225 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1354/2752] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:27:14 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:27:14.647626 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddea66-3e57-4c8b-a4ed-4d7040d387b3 service glance] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:14.661691 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddea66-3e57-4c8b-a4ed-4d7040d387b3 service glance] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:14.673350 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967f183-dc53-445a-b1cd-14fbe4d3cd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:14.674144 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967f183-dc53-445a-b1cd-14fbe4d3cd39 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:14.674434 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967f183-dc53-445a-b1cd-14fbe4d3cd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:14.674799 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967f183-dc53-445a-b1cd-14fbe4d3cd39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:14.675444 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967f183-dc53-445a-b1cd-14fbe4d3cd39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:14.677076 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967f183-dc53-445a-b1cd-14fbe4d3cd39 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:14.698546 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1399/2753] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:27:14.703108 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bea7cf-9cff-4a29-91ae-7e6631f225b5 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:14.713504 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bea7cf-9cff-4a29-91ae-7e6631f225b5 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:14.724522 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c9253-81d5-4904-b9eb-80e8e8307a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:14.725285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c9253-81d5-4904-b9eb-80e8e8307a24 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:14.725554 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c9253-81d5-4904-b9eb-80e8e8307a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:14.725819 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c9253-81d5-4904-b9eb-80e8e8307a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:14.726559 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c9253-81d5-4904-b9eb-80e8e8307a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:14.728303 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c9253-81d5-4904-b9eb-80e8e8307a24 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:14.743286 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1355/2754] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:27:14.747786 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967f183-dc53-445a-b1cd-14fbe4d3cd39 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:14.758351 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967f183-dc53-445a-b1cd-14fbe4d3cd39 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:14.763923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdd274-399a-46a3-97df-8e45541ecc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:14.765080 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdd274-399a-46a3-97df-8e45541ecc88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:14.765527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdd274-399a-46a3-97df-8e45541ecc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:14.765961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdd274-399a-46a3-97df-8e45541ecc88 admin admin] PATH_INFO: `/v3/projects/582ef540754c43c79825443b3c2203dc/users/2e8890e8949d4a73a607d36ec7a902a5/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:14.785775 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdd274-399a-46a3-97df-8e45541ecc88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=582ef540754c43c79825443b3c2203dc, user_id=2e8890e8949d4a73a607d36ec7a902a5, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:14.787611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdd274-399a-46a3-97df-8e45541ecc88 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:14.863526 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1400/2755] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:27:14 2022] PUT /identity/v3/projects/582ef540754c43c79825443b3c2203dc/users/2e8890e8949d4a73a607d36ec7a902a5/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:14.874850 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ddcc9-5c82-4fd6-917e-39e5e02cf599 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:14.875378 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ddcc9-5c82-4fd6-917e-39e5e02cf599 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:14.875378 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ddcc9-5c82-4fd6-917e-39e5e02cf599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:14.911759 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-706ddcc9-5c82-4fd6-917e-39e5e02cf599 None None] MFA Rules not processed for user `2e8890e8949d4a73a607d36ec7a902a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:14.913171 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-706ddcc9-5c82-4fd6-917e-39e5e02cf599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:15.005970 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1356/2756] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:15.010380 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdd274-399a-46a3-97df-8e45541ecc88 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:15.089220 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdd274-399a-46a3-97df-8e45541ecc88 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:15.094380 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5469525-53b6-4b09-ae4a-f7024fab9185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:15.095144 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5469525-53b6-4b09-ae4a-f7024fab9185 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:15.095498 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5469525-53b6-4b09-ae4a-f7024fab9185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:15.095872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5469525-53b6-4b09-ae4a-f7024fab9185 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:15.096981 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5469525-53b6-4b09-ae4a-f7024fab9185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:15.098947 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5469525-53b6-4b09-ae4a-f7024fab9185 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:15.197757 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1401/2757] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:27:15 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:27:15.202767 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ddcc9-5c82-4fd6-917e-39e5e02cf599 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:15.221376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ddcc9-5c82-4fd6-917e-39e5e02cf599 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:15.299122 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b11dbd-e777-45b5-959f-e571830e44d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:15.300124 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b11dbd-e777-45b5-959f-e571830e44d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:15.300896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b11dbd-e777-45b5-959f-e571830e44d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:15.301673 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b11dbd-e777-45b5-959f-e571830e44d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:15.302371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b11dbd-e777-45b5-959f-e571830e44d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:15.304424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b11dbd-e777-45b5-959f-e571830e44d2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:15.384661 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1357/2758] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:27:15 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:27:15.388353 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5469525-53b6-4b09-ae4a-f7024fab9185 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:15.400054 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5469525-53b6-4b09-ae4a-f7024fab9185 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:15.405954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af1c7b-aab3-4336-81b3-6f8c6a454664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:15.406536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af1c7b-aab3-4336-81b3-6f8c6a454664 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:15.406957 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af1c7b-aab3-4336-81b3-6f8c6a454664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:15.407204 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af1c7b-aab3-4336-81b3-6f8c6a454664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:15.409900 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af1c7b-aab3-4336-81b3-6f8c6a454664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:15.410243 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af1c7b-aab3-4336-81b3-6f8c6a454664 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:15.425215 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1402/2759] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:27:15.429423 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b11dbd-e777-45b5-959f-e571830e44d2 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:15.443165 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b11dbd-e777-45b5-959f-e571830e44d2 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:15.451593 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e728f84-22ec-4acc-bed4-e98d59b62c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:15.453271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e728f84-22ec-4acc-bed4-e98d59b62c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:15.453523 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e728f84-22ec-4acc-bed4-e98d59b62c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:15.453874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e728f84-22ec-4acc-bed4-e98d59b62c1a admin admin] PATH_INFO: `/v3/projects/ebc1713542d5437aa8efb564cc2f19da/users/b4f697416534417bb751bd1f78482e64/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:15.486454 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e728f84-22ec-4acc-bed4-e98d59b62c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc1713542d5437aa8efb564cc2f19da, user_id=b4f697416534417bb751bd1f78482e64, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:15.489626 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e728f84-22ec-4acc-bed4-e98d59b62c1a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:15.570390 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1358/2760] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:27:15 2022] PUT /identity/v3/projects/ebc1713542d5437aa8efb564cc2f19da/users/b4f697416534417bb751bd1f78482e64/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:15.580696 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af1c7b-aab3-4336-81b3-6f8c6a454664 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:15.587400 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af1c7b-aab3-4336-81b3-6f8c6a454664 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:15.698631 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ab3d1-e962-4bc5-902b-1af81243553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:15.700000 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ab3d1-e962-4bc5-902b-1af81243553f admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:15.700476 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ab3d1-e962-4bc5-902b-1af81243553f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:15.700910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ab3d1-e962-4bc5-902b-1af81243553f admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:15.703335 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ab3d1-e962-4bc5-902b-1af81243553f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:15.705399 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ab3d1-e962-4bc5-902b-1af81243553f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:15.743494 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1403/2761] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:27:15.744740 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e728f84-22ec-4acc-bed4-e98d59b62c1a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:15.759579 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e728f84-22ec-4acc-bed4-e98d59b62c1a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:15.771824 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509da783-07cb-43ae-b6e2-6b8d7a11d254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:15.772789 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509da783-07cb-43ae-b6e2-6b8d7a11d254 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:15.775796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509da783-07cb-43ae-b6e2-6b8d7a11d254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:15.775796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509da783-07cb-43ae-b6e2-6b8d7a11d254 admin admin] PATH_INFO: `/v3/projects/ebc1713542d5437aa8efb564cc2f19da/users/b4f697416534417bb751bd1f78482e64/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:15.776187 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509da783-07cb-43ae-b6e2-6b8d7a11d254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc1713542d5437aa8efb564cc2f19da, user_id=b4f697416534417bb751bd1f78482e64, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:15.779512 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509da783-07cb-43ae-b6e2-6b8d7a11d254 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:15.797106 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1359/2762] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:27:15 2022] PUT /identity/v3/projects/ebc1713542d5437aa8efb564cc2f19da/users/b4f697416534417bb751bd1f78482e64/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:27:15.814250 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d233bc-fa61-49e4-b9b2-e394793b667e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:15.814250 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d233bc-fa61-49e4-b9b2-e394793b667e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:15.814250 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d233bc-fa61-49e4-b9b2-e394793b667e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:15.839389 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-80d233bc-fa61-49e4-b9b2-e394793b667e None None] MFA Rules not processed for user `b4f697416534417bb751bd1f78482e64`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:15.841956 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-80d233bc-fa61-49e4-b9b2-e394793b667e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:16.049011 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1404/2763] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:16.058109 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509da783-07cb-43ae-b6e2-6b8d7a11d254 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:16.059397 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-509da783-07cb-43ae-b6e2-6b8d7a11d254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:16.160961 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509da783-07cb-43ae-b6e2-6b8d7a11d254 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:16.166556 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1904d-d768-4361-a541-915fabdf817c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:16.167370 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1904d-d768-4361-a541-915fabdf817c service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:16.167752 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1904d-d768-4361-a541-915fabdf817c service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:16.168086 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1904d-d768-4361-a541-915fabdf817c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:16.188901 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1904d-d768-4361-a541-915fabdf817c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:16.190644 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1904d-d768-4361-a541-915fabdf817c service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:16.210832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1360/2764] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:27:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:27:16.292743 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d9e39-6f1c-4586-8776-ff12dbd0f349 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:16.293485 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d9e39-6f1c-4586-8776-ff12dbd0f349 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:16.293979 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d9e39-6f1c-4586-8776-ff12dbd0f349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:16.331223 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-295d9e39-6f1c-4586-8776-ff12dbd0f349 None None] MFA Rules not processed for user `d64b5396be8944ce9fafc9034f54d55f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:16.335293 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-295d9e39-6f1c-4586-8776-ff12dbd0f349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:16.414064 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1405/2765] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:16.418871 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1904d-d768-4361-a541-915fabdf817c service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:16.420532 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b1a1904d-d768-4361-a541-915fabdf817c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:16.506234 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1904d-d768-4361-a541-915fabdf817c service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:16.511224 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc6ceb-614c-4676-ac14-3b92ec5ecea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:16.511960 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc6ceb-614c-4676-ac14-3b92ec5ecea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:16.513057 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc6ceb-614c-4676-ac14-3b92ec5ecea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:16.513235 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc6ceb-614c-4676-ac14-3b92ec5ecea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:16.513996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc6ceb-614c-4676-ac14-3b92ec5ecea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:16.518073 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc6ceb-614c-4676-ac14-3b92ec5ecea8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:16.618790 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d9e39-6f1c-4586-8776-ff12dbd0f349 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:16.619232 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1361/2766] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:27:16 2022] POST /identity/v3/projects => generated 381 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:27:16.632134 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d9e39-6f1c-4586-8776-ff12dbd0f349 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:16.700621 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69871f-95f0-444a-af62-36a0bd33b7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:16.701306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69871f-95f0-444a-af62-36a0bd33b7c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:16.701590 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69871f-95f0-444a-af62-36a0bd33b7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:16.701862 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69871f-95f0-444a-af62-36a0bd33b7c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:16.705933 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69871f-95f0-444a-af62-36a0bd33b7c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:16.708104 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69871f-95f0-444a-af62-36a0bd33b7c4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:16.850708 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1406/2767] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:27:16 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:27:16.851892 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc6ceb-614c-4676-ac14-3b92ec5ecea8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:16.863903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc6ceb-614c-4676-ac14-3b92ec5ecea8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:16.868627 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60917bc1-909b-47f8-9423-efe350f7ce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:16.869293 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60917bc1-909b-47f8-9423-efe350f7ce87 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:16.869576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60917bc1-909b-47f8-9423-efe350f7ce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:16.869872 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60917bc1-909b-47f8-9423-efe350f7ce87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:16.870604 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60917bc1-909b-47f8-9423-efe350f7ce87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:16.872242 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60917bc1-909b-47f8-9423-efe350f7ce87 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:16.883067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1362/2768] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:27:16.888310 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69871f-95f0-444a-af62-36a0bd33b7c4 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:16.898622 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69871f-95f0-444a-af62-36a0bd33b7c4 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:16.904252 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97fa42-b389-4417-98e8-aae3abd52164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:16.905373 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97fa42-b389-4417-98e8-aae3abd52164 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:16.905597 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97fa42-b389-4417-98e8-aae3abd52164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:16.905872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97fa42-b389-4417-98e8-aae3abd52164 admin admin] PATH_INFO: `/v3/projects/63ab4123b3ae45ac99e14cc4ce2c9b6b/users/636a4b020cfb491eb59b1a051e5e9404/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:16.920637 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97fa42-b389-4417-98e8-aae3abd52164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ab4123b3ae45ac99e14cc4ce2c9b6b, user_id=636a4b020cfb491eb59b1a051e5e9404, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:16.923543 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97fa42-b389-4417-98e8-aae3abd52164 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:17.007954 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1407/2769] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:27:16 2022] PUT /identity/v3/projects/63ab4123b3ae45ac99e14cc4ce2c9b6b/users/636a4b020cfb491eb59b1a051e5e9404/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:17.012782 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60917bc1-909b-47f8-9423-efe350f7ce87 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:17.022750 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60917bc1-909b-47f8-9423-efe350f7ce87 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:17.091741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d3541-3a3a-4190-ade2-34fe81567602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:17.092598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d3541-3a3a-4190-ade2-34fe81567602 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:17.092757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d3541-3a3a-4190-ade2-34fe81567602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:17.093014 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d3541-3a3a-4190-ade2-34fe81567602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:17.093718 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d3541-3a3a-4190-ade2-34fe81567602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:17.095885 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d3541-3a3a-4190-ade2-34fe81567602 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:17.106807 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1363/2770] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:27:17.112560 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97fa42-b389-4417-98e8-aae3abd52164 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:17.126325 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97fa42-b389-4417-98e8-aae3abd52164 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:17.133922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e41b8f-acb5-479b-be16-c696c48fdfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:17.135871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e41b8f-acb5-479b-be16-c696c48fdfe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:17.139372 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e41b8f-acb5-479b-be16-c696c48fdfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:17.139372 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e41b8f-acb5-479b-be16-c696c48fdfe1 admin admin] PATH_INFO: `/v3/projects/63ab4123b3ae45ac99e14cc4ce2c9b6b/users/636a4b020cfb491eb59b1a051e5e9404/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:17.141328 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e41b8f-acb5-479b-be16-c696c48fdfe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ab4123b3ae45ac99e14cc4ce2c9b6b, user_id=636a4b020cfb491eb59b1a051e5e9404, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:17.145003 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e41b8f-acb5-479b-be16-c696c48fdfe1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:17.167812 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1408/2771] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:27:17 2022] PUT /identity/v3/projects/63ab4123b3ae45ac99e14cc4ce2c9b6b/users/636a4b020cfb491eb59b1a051e5e9404/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:17.431675 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d3541-3a3a-4190-ade2-34fe81567602 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:17.443988 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d3541-3a3a-4190-ade2-34fe81567602 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:17.518047 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066c17b-0762-4a77-8cc4-082b15643d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:17.519285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066c17b-0762-4a77-8cc4-082b15643d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:17.519638 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066c17b-0762-4a77-8cc4-082b15643d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:17.520193 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066c17b-0762-4a77-8cc4-082b15643d84 admin admin] PATH_INFO: `/v3/users/2e8890e8949d4a73a607d36ec7a902a5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:17.521880 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066c17b-0762-4a77-8cc4-082b15643d84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e8890e8949d4a73a607d36ec7a902a5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:17.524674 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066c17b-0762-4a77-8cc4-082b15643d84 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:17.788674 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e066c17b-0762-4a77-8cc4-082b15643d84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e8890e8949d4a73a607d36ec7a902a5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:17.789607 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e066c17b-0762-4a77-8cc4-082b15643d84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e8890e8949d4a73a607d36ec7a902a5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:17.803490 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e066c17b-0762-4a77-8cc4-082b15643d84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e8890e8949d4a73a607d36ec7a902a5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:17.804442 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e066c17b-0762-4a77-8cc4-082b15643d84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e8890e8949d4a73a607d36ec7a902a5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:17.814889 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e066c17b-0762-4a77-8cc4-082b15643d84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e8890e8949d4a73a607d36ec7a902a5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:17.924831 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1364/2772] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:27:17 2022] DELETE /identity/v3/users/2e8890e8949d4a73a607d36ec7a902a5 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:17.935641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3c97d-bfbb-441a-af04-c9886c373264 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:17.936354 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3c97d-bfbb-441a-af04-c9886c373264 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:17.937139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3c97d-bfbb-441a-af04-c9886c373264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:17.966424 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3df3c97d-bfbb-441a-af04-c9886c373264 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:17.967668 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3df3c97d-bfbb-441a-af04-c9886c373264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:18.040950 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1409/2773] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:18.052445 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066c17b-0762-4a77-8cc4-082b15643d84 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:18.054073 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e066c17b-0762-4a77-8cc4-082b15643d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:18.130012 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066c17b-0762-4a77-8cc4-082b15643d84 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:18.136583 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6674cb-2912-4926-97b3-7264eb3b5718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:18.137340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6674cb-2912-4926-97b3-7264eb3b5718 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:18.137631 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6674cb-2912-4926-97b3-7264eb3b5718 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:18.137910 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6674cb-2912-4926-97b3-7264eb3b5718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:18.149626 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6674cb-2912-4926-97b3-7264eb3b5718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:18.151196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6674cb-2912-4926-97b3-7264eb3b5718 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:18.171584 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1365/2774] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:27:18.700684 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3c97d-bfbb-441a-af04-c9886c373264 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:18.702305 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3df3c97d-bfbb-441a-af04-c9886c373264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:18.716583 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3c97d-bfbb-441a-af04-c9886c373264 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:18.723286 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd117da-ec96-4802-b526-1b1727fc7035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:18.725873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd117da-ec96-4802-b526-1b1727fc7035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:18.726362 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd117da-ec96-4802-b526-1b1727fc7035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:18.727152 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd117da-ec96-4802-b526-1b1727fc7035 admin admin] PATH_INFO: `/v3/users/1ce7d2803edc437ab6a34416ae3a985d` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:18.731137 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd117da-ec96-4802-b526-1b1727fc7035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ce7d2803edc437ab6a34416ae3a985d)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:18.734500 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd117da-ec96-4802-b526-1b1727fc7035 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:18.752096 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6674cb-2912-4926-97b3-7264eb3b5718 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:18.752096 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8d6674cb-2912-4926-97b3-7264eb3b5718 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:18.773546 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6674cb-2912-4926-97b3-7264eb3b5718 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:18.792359 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba825b-936b-4843-ad7a-bf95d49ed105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:18.793505 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba825b-936b-4843-ad7a-bf95d49ed105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:18.793955 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba825b-936b-4843-ad7a-bf95d49ed105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:18.794399 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba825b-936b-4843-ad7a-bf95d49ed105 admin admin] PATH_INFO: `/v3/projects/582ef540754c43c79825443b3c2203dc` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:18.797598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba825b-936b-4843-ad7a-bf95d49ed105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=582ef540754c43c79825443b3c2203dc)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:18.799626 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba825b-936b-4843-ad7a-bf95d49ed105 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:19.036614 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-71ba825b-936b-4843-ad7a-bf95d49ed105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '582ef540754c43c79825443b3c2203dc', 'request_id': 'req-71ba825b-936b-4843-ad7a-bf95d49ed105'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:19.043033 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ccd117da-ec96-4802-b526-1b1727fc7035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ce7d2803edc437ab6a34416ae3a985d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:19.046501 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ccd117da-ec96-4802-b526-1b1727fc7035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ce7d2803edc437ab6a34416ae3a985d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:19.046501 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ccd117da-ec96-4802-b526-1b1727fc7035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ce7d2803edc437ab6a34416ae3a985d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:19.063363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ccd117da-ec96-4802-b526-1b1727fc7035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ce7d2803edc437ab6a34416ae3a985d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:19.073097 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ccd117da-ec96-4802-b526-1b1727fc7035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ce7d2803edc437ab6a34416ae3a985d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:19.122635 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-71ba825b-936b-4843-ad7a-bf95d49ed105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '582ef540754c43c79825443b3c2203dc', 'request_id': 'req-71ba825b-936b-4843-ad7a-bf95d49ed105'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:19.130893 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-71ba825b-936b-4843-ad7a-bf95d49ed105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '582ef540754c43c79825443b3c2203dc', 'request_id': 'req-71ba825b-936b-4843-ad7a-bf95d49ed105'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:19.145798 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-71ba825b-936b-4843-ad7a-bf95d49ed105 admin admin] The token cache is being invalidate because project 582ef540754c43c79825443b3c2203dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:27:19.145798 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-71ba825b-936b-4843-ad7a-bf95d49ed105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:19.146715 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-71ba825b-936b-4843-ad7a-bf95d49ed105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:19.148448 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1366/2775] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:27:18 2022] DELETE /identity/v3/projects/582ef540754c43c79825443b3c2203dc => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:27:19.152553 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba825b-936b-4843-ad7a-bf95d49ed105 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:19.154776 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-71ba825b-936b-4843-ad7a-bf95d49ed105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:19.228596 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1410/2776] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:27:18 2022] DELETE /identity/v3/users/1ce7d2803edc437ab6a34416ae3a985d => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:19.233785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1355850-dd8c-42f4-9253-ca4c4dc8a7e5 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:19.233969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1355850-dd8c-42f4-9253-ca4c4dc8a7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:19.234326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1355850-dd8c-42f4-9253-ca4c4dc8a7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:19.271550 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f1355850-dd8c-42f4-9253-ca4c4dc8a7e5 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:19.273145 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f1355850-dd8c-42f4-9253-ca4c4dc8a7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:19.279585 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba825b-936b-4843-ad7a-bf95d49ed105 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:19.380373 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1411/2777] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:27:19.393312 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1355850-dd8c-42f4-9253-ca4c4dc8a7e5 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:19.395199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f1355850-dd8c-42f4-9253-ca4c4dc8a7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:19.442744 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732aaf3-44f6-49ca-9d08-b99ae77cde93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:19.444778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732aaf3-44f6-49ca-9d08-b99ae77cde93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:19.445230 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732aaf3-44f6-49ca-9d08-b99ae77cde93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:19.445693 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732aaf3-44f6-49ca-9d08-b99ae77cde93 admin admin] PATH_INFO: `/v3/users/b4f697416534417bb751bd1f78482e64` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:19.449247 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732aaf3-44f6-49ca-9d08-b99ae77cde93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f697416534417bb751bd1f78482e64)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:19.451340 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732aaf3-44f6-49ca-9d08-b99ae77cde93 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:19.508614 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1355850-dd8c-42f4-9253-ca4c4dc8a7e5 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:19.515491 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c5819-7784-4c3a-8997-6d93625a9268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:19.517089 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c5819-7784-4c3a-8997-6d93625a9268 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:19.518271 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c5819-7784-4c3a-8997-6d93625a9268 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:19.518730 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c5819-7784-4c3a-8997-6d93625a9268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:19.530882 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c5819-7784-4c3a-8997-6d93625a9268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:19.532703 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c5819-7784-4c3a-8997-6d93625a9268 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:19.547742 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1412/2778] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:27:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:27:19.675021 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4732aaf3-44f6-49ca-9d08-b99ae77cde93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f697416534417bb751bd1f78482e64'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:19.676046 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4732aaf3-44f6-49ca-9d08-b99ae77cde93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f697416534417bb751bd1f78482e64'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:19.698400 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4732aaf3-44f6-49ca-9d08-b99ae77cde93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f697416534417bb751bd1f78482e64'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:19.699290 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4732aaf3-44f6-49ca-9d08-b99ae77cde93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f697416534417bb751bd1f78482e64'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:19.717893 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4732aaf3-44f6-49ca-9d08-b99ae77cde93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f697416534417bb751bd1f78482e64'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:19.794844 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1367/2779] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:27:19 2022] DELETE /identity/v3/users/b4f697416534417bb751bd1f78482e64 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:27:20.136538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c5819-7784-4c3a-8997-6d93625a9268 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:20.144870 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ea8c5819-7784-4c3a-8997-6d93625a9268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:20.163765 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c5819-7784-4c3a-8997-6d93625a9268 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:20.289785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cecd4-050b-4643-ad8f-de6e25d512b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:20.289785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cecd4-050b-4643-ad8f-de6e25d512b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:20.289785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cecd4-050b-4643-ad8f-de6e25d512b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:20.289785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cecd4-050b-4643-ad8f-de6e25d512b3 admin admin] PATH_INFO: `/v3/projects/c1820ed2841245d29c46dc84a110838d` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:20.294536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cecd4-050b-4643-ad8f-de6e25d512b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1820ed2841245d29c46dc84a110838d)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:20.294536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cecd4-050b-4643-ad8f-de6e25d512b3 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:20.429199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ef8cecd4-050b-4643-ad8f-de6e25d512b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1820ed2841245d29c46dc84a110838d', 'request_id': 'req-ef8cecd4-050b-4643-ad8f-de6e25d512b3'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:20.514556 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ef8cecd4-050b-4643-ad8f-de6e25d512b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1820ed2841245d29c46dc84a110838d', 'request_id': 'req-ef8cecd4-050b-4643-ad8f-de6e25d512b3'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:20.522762 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ef8cecd4-050b-4643-ad8f-de6e25d512b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1820ed2841245d29c46dc84a110838d', 'request_id': 'req-ef8cecd4-050b-4643-ad8f-de6e25d512b3'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:20.561035 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ef8cecd4-050b-4643-ad8f-de6e25d512b3 admin admin] The token cache is being invalidate because project c1820ed2841245d29c46dc84a110838d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:27:20.561416 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ef8cecd4-050b-4643-ad8f-de6e25d512b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:20.562357 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ef8cecd4-050b-4643-ad8f-de6e25d512b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:20.567002 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1413/2780] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:27:20 2022] DELETE /identity/v3/projects/c1820ed2841245d29c46dc84a110838d => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:20.569108 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732aaf3-44f6-49ca-9d08-b99ae77cde93 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:20.571265 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4732aaf3-44f6-49ca-9d08-b99ae77cde93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:20.587167 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732aaf3-44f6-49ca-9d08-b99ae77cde93 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:20.638643 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cecd4-050b-4643-ad8f-de6e25d512b3 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:20.638643 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ef8cecd4-050b-4643-ad8f-de6e25d512b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:20.664586 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656d764-6854-4e60-ab85-2e9dd5799bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:20.665700 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656d764-6854-4e60-ab85-2e9dd5799bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:20.666209 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656d764-6854-4e60-ab85-2e9dd5799bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:20.666871 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656d764-6854-4e60-ab85-2e9dd5799bb0 admin admin] PATH_INFO: `/v3/users/9761de197ce34c52ac17929d159d9553` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:20.673802 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656d764-6854-4e60-ab85-2e9dd5799bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9761de197ce34c52ac17929d159d9553)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:20.676462 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656d764-6854-4e60-ab85-2e9dd5799bb0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:20.775992 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cecd4-050b-4643-ad8f-de6e25d512b3 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:20.793209 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7881c5-d425-4710-a18b-8b5b9556fbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:20.794281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7881c5-d425-4710-a18b-8b5b9556fbee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:20.794563 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7881c5-d425-4710-a18b-8b5b9556fbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:20.794842 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7881c5-d425-4710-a18b-8b5b9556fbee admin admin] PATH_INFO: `/v3/projects/ebc1713542d5437aa8efb564cc2f19da` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:20.796888 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7881c5-d425-4710-a18b-8b5b9556fbee admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebc1713542d5437aa8efb564cc2f19da)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:20.799641 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7881c5-d425-4710-a18b-8b5b9556fbee admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:20.920191 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4656d764-6854-4e60-ab85-2e9dd5799bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9761de197ce34c52ac17929d159d9553'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:20.922621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4656d764-6854-4e60-ab85-2e9dd5799bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9761de197ce34c52ac17929d159d9553'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:20.966689 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5f7881c5-d425-4710-a18b-8b5b9556fbee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebc1713542d5437aa8efb564cc2f19da', 'request_id': 'req-5f7881c5-d425-4710-a18b-8b5b9556fbee'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:20.972990 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4656d764-6854-4e60-ab85-2e9dd5799bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9761de197ce34c52ac17929d159d9553'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:20.978935 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4656d764-6854-4e60-ab85-2e9dd5799bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9761de197ce34c52ac17929d159d9553'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:20.984881 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4656d764-6854-4e60-ab85-2e9dd5799bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9761de197ce34c52ac17929d159d9553'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:21.053819 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5f7881c5-d425-4710-a18b-8b5b9556fbee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebc1713542d5437aa8efb564cc2f19da', 'request_id': 'req-5f7881c5-d425-4710-a18b-8b5b9556fbee'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:21.060660 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5f7881c5-d425-4710-a18b-8b5b9556fbee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebc1713542d5437aa8efb564cc2f19da', 'request_id': 'req-5f7881c5-d425-4710-a18b-8b5b9556fbee'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:21.071804 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5f7881c5-d425-4710-a18b-8b5b9556fbee admin admin] The token cache is being invalidate because project ebc1713542d5437aa8efb564cc2f19da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:27:21.072098 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5f7881c5-d425-4710-a18b-8b5b9556fbee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:21.072776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5f7881c5-d425-4710-a18b-8b5b9556fbee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:21.074528 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1414/2781] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:27:20 2022] DELETE /identity/v3/projects/ebc1713542d5437aa8efb564cc2f19da => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:27:21.079436 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2ba88-71e5-4d39-afdf-2f5356ae005e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:21.079857 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2ba88-71e5-4d39-afdf-2f5356ae005e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:21.080212 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2ba88-71e5-4d39-afdf-2f5356ae005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:21.098867 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-72a2ba88-71e5-4d39-afdf-2f5356ae005e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:21.100114 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-72a2ba88-71e5-4d39-afdf-2f5356ae005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:21.119382 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1368/2782] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:27:20 2022] DELETE /identity/v3/users/9761de197ce34c52ac17929d159d9553 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:21.181069 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1415/2783] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:27:21.190758 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68761b9b-0164-4c1b-8ff0-322f3f1e689d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:21.191028 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68761b9b-0164-4c1b-8ff0-322f3f1e689d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:21.191274 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68761b9b-0164-4c1b-8ff0-322f3f1e689d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:21.222069 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-68761b9b-0164-4c1b-8ff0-322f3f1e689d None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:21.224192 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-68761b9b-0164-4c1b-8ff0-322f3f1e689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:21.296470 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1369/2784] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:27:21.300873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2ba88-71e5-4d39-afdf-2f5356ae005e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:21.323883 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2ba88-71e5-4d39-afdf-2f5356ae005e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:21.349238 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5def26-cbbc-43eb-82d4-69b6547e2ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:21.350300 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5def26-cbbc-43eb-82d4-69b6547e2ffa admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:21.350924 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5def26-cbbc-43eb-82d4-69b6547e2ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:21.357010 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5def26-cbbc-43eb-82d4-69b6547e2ffa admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:21.364413 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5def26-cbbc-43eb-82d4-69b6547e2ffa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:27:21.365636 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5def26-cbbc-43eb-82d4-69b6547e2ffa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:21.367881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5def26-cbbc-43eb-82d4-69b6547e2ffa admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:21.386708 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1416/2785] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:27:21.391294 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68761b9b-0164-4c1b-8ff0-322f3f1e689d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:21.401083 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68761b9b-0164-4c1b-8ff0-322f3f1e689d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:21.409806 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283518a4-8153-4d1c-8418-4aa498888874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:21.410766 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283518a4-8153-4d1c-8418-4aa498888874 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:21.411039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283518a4-8153-4d1c-8418-4aa498888874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:21.411314 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283518a4-8153-4d1c-8418-4aa498888874 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:21.412072 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283518a4-8153-4d1c-8418-4aa498888874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:21.414599 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283518a4-8153-4d1c-8418-4aa498888874 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:21.504892 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1370/2786] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:27:21 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:27:21.508965 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5def26-cbbc-43eb-82d4-69b6547e2ffa admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:21.523100 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5def26-cbbc-43eb-82d4-69b6547e2ffa admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:21.620739 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab058f-116b-427b-9a1a-6cadbb2b5cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:21.621399 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab058f-116b-427b-9a1a-6cadbb2b5cea admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:21.621780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab058f-116b-427b-9a1a-6cadbb2b5cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:21.622220 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab058f-116b-427b-9a1a-6cadbb2b5cea admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:21.623044 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab058f-116b-427b-9a1a-6cadbb2b5cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:21.626682 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab058f-116b-427b-9a1a-6cadbb2b5cea admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:21.757732 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1417/2787] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:27:21 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:27:21.763172 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283518a4-8153-4d1c-8418-4aa498888874 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:21.777314 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283518a4-8153-4d1c-8418-4aa498888874 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:21.782479 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a1423-64d6-4be4-9ed7-2a0b88d24639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:21.783145 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a1423-64d6-4be4-9ed7-2a0b88d24639 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:21.783628 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a1423-64d6-4be4-9ed7-2a0b88d24639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:21.784097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a1423-64d6-4be4-9ed7-2a0b88d24639 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:21.785945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a1423-64d6-4be4-9ed7-2a0b88d24639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:21.789461 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a1423-64d6-4be4-9ed7-2a0b88d24639 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:21.790245 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab058f-116b-427b-9a1a-6cadbb2b5cea admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:21.793001 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-37ab058f-116b-427b-9a1a-6cadbb2b5cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:21.814765 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab058f-116b-427b-9a1a-6cadbb2b5cea admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:21.822729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1371/2788] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:27:21.827450 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a1423-64d6-4be4-9ed7-2a0b88d24639 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:21.829483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f7d45-ff07-415f-b04e-aba7e3ac5f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:21.830690 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f7d45-ff07-415f-b04e-aba7e3ac5f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:21.831041 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f7d45-ff07-415f-b04e-aba7e3ac5f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:21.831389 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f7d45-ff07-415f-b04e-aba7e3ac5f99 admin admin] PATH_INFO: `/v3/projects/fcbd9fc4e09e4996a6549d59b7b12540` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:21.832756 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f7d45-ff07-415f-b04e-aba7e3ac5f99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcbd9fc4e09e4996a6549d59b7b12540)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:21.834813 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f7d45-ff07-415f-b04e-aba7e3ac5f99 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:21.837962 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a1423-64d6-4be4-9ed7-2a0b88d24639 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:21.843913 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a3db7-475a-48cd-97d0-049fec7fa7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:21.844819 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a3db7-475a-48cd-97d0-049fec7fa7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:21.845097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a3db7-475a-48cd-97d0-049fec7fa7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:21.845548 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a3db7-475a-48cd-97d0-049fec7fa7f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:21.847538 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a3db7-475a-48cd-97d0-049fec7fa7f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:21.850577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a3db7-475a-48cd-97d0-049fec7fa7f3 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:21.866926 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1372/2789] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:27:21.868127 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a3db7-475a-48cd-97d0-049fec7fa7f3 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:21.881104 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a3db7-475a-48cd-97d0-049fec7fa7f3 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:21.889257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eddb07-30d6-498a-9d72-90ef58f9f78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:21.890667 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eddb07-30d6-498a-9d72-90ef58f9f78d admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:21.891025 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eddb07-30d6-498a-9d72-90ef58f9f78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:21.891367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eddb07-30d6-498a-9d72-90ef58f9f78d admin admin] PATH_INFO: `/v3/projects/8a33299083d6419fae430dbb76ebef37/users/67bc5d2efbfa4ff49936e353ee0d1179/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:21.908498 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eddb07-30d6-498a-9d72-90ef58f9f78d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a33299083d6419fae430dbb76ebef37, user_id=67bc5d2efbfa4ff49936e353ee0d1179, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:21.911206 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eddb07-30d6-498a-9d72-90ef58f9f78d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:21.995959 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1373/2790] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:27:21 2022] PUT /identity/v3/projects/8a33299083d6419fae430dbb76ebef37/users/67bc5d2efbfa4ff49936e353ee0d1179/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:27:22.001768 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ea6f7d45-ff07-415f-b04e-aba7e3ac5f99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcbd9fc4e09e4996a6549d59b7b12540', 'request_id': 'req-ea6f7d45-ff07-415f-b04e-aba7e3ac5f99'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:22.008481 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386409bb-373a-4df9-92e6-d19e75423d47 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:22.008884 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386409bb-373a-4df9-92e6-d19e75423d47 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:22.009167 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386409bb-373a-4df9-92e6-d19e75423d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:22.071084 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-386409bb-373a-4df9-92e6-d19e75423d47 None None] MFA Rules not processed for user `67bc5d2efbfa4ff49936e353ee0d1179`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:22.072421 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-386409bb-373a-4df9-92e6-d19e75423d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:22.076261 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ea6f7d45-ff07-415f-b04e-aba7e3ac5f99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcbd9fc4e09e4996a6549d59b7b12540', 'request_id': 'req-ea6f7d45-ff07-415f-b04e-aba7e3ac5f99'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:22.084374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ea6f7d45-ff07-415f-b04e-aba7e3ac5f99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcbd9fc4e09e4996a6549d59b7b12540', 'request_id': 'req-ea6f7d45-ff07-415f-b04e-aba7e3ac5f99'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:22.105605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ea6f7d45-ff07-415f-b04e-aba7e3ac5f99 admin admin] The token cache is being invalidate because project fcbd9fc4e09e4996a6549d59b7b12540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:27:22.107913 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ea6f7d45-ff07-415f-b04e-aba7e3ac5f99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:22.109492 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ea6f7d45-ff07-415f-b04e-aba7e3ac5f99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:27:22.112047 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1418/2791] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:27:21 2022] DELETE /identity/v3/projects/fcbd9fc4e09e4996a6549d59b7b12540 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:27:22.117971 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42d4be-9b66-48e6-b60a-d47e1875ce16 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:22.118361 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42d4be-9b66-48e6-b60a-d47e1875ce16 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:22.118744 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42d4be-9b66-48e6-b60a-d47e1875ce16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:22.148518 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6b42d4be-9b66-48e6-b60a-d47e1875ce16 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:22.150248 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6b42d4be-9b66-48e6-b60a-d47e1875ce16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:22.233493 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1374/2792] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:27:22.239735 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1419/2793] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:22.247350 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50e9ff-9f12-4666-a377-ff2ebe7d3255 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:22.247778 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50e9ff-9f12-4666-a377-ff2ebe7d3255 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:22.248200 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50e9ff-9f12-4666-a377-ff2ebe7d3255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:22.255014 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42d4be-9b66-48e6-b60a-d47e1875ce16 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:22.256653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6b42d4be-9b66-48e6-b60a-d47e1875ce16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:22.272724 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7e50e9ff-9f12-4666-a377-ff2ebe7d3255 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:22.275415 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7e50e9ff-9f12-4666-a377-ff2ebe7d3255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:22.289589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1375/2794] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:22.294262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50e9ff-9f12-4666-a377-ff2ebe7d3255 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:22.312161 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50e9ff-9f12-4666-a377-ff2ebe7d3255 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:22.331549 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365461ea-78e9-47ac-824e-c9ee6424ca6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:22.332489 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365461ea-78e9-47ac-824e-c9ee6424ca6a admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:22.333043 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365461ea-78e9-47ac-824e-c9ee6424ca6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:22.334920 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365461ea-78e9-47ac-824e-c9ee6424ca6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:22.336444 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365461ea-78e9-47ac-824e-c9ee6424ca6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:27:22.336811 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365461ea-78e9-47ac-824e-c9ee6424ca6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:22.339589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365461ea-78e9-47ac-824e-c9ee6424ca6a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:22.351506 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42d4be-9b66-48e6-b60a-d47e1875ce16 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:22.355579 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1376/2795] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 07:27:22.359289 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda32120-4947-4e69-b619-54f9eea2343c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:22.361102 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda32120-4947-4e69-b619-54f9eea2343c service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:22.361383 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda32120-4947-4e69-b619-54f9eea2343c service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:22.361653 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda32120-4947-4e69-b619-54f9eea2343c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:22.362439 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365461ea-78e9-47ac-824e-c9ee6424ca6a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:22.379194 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365461ea-78e9-47ac-824e-c9ee6424ca6a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:22.380789 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda32120-4947-4e69-b619-54f9eea2343c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:22.383962 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda32120-4947-4e69-b619-54f9eea2343c service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:22.402910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1420/2796] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:27:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:27:22.419485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4c38f-81fb-4531-a1e7-8512c1a7e71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:22.421729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4c38f-81fb-4531-a1e7-8512c1a7e71c admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:22.422020 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4c38f-81fb-4531-a1e7-8512c1a7e71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:22.422556 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4c38f-81fb-4531-a1e7-8512c1a7e71c admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:22.423362 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4c38f-81fb-4531-a1e7-8512c1a7e71c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:22.429847 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4c38f-81fb-4531-a1e7-8512c1a7e71c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:22.534146 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1377/2797] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:27:22 2022] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:27:22.538423 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda32120-4947-4e69-b619-54f9eea2343c service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:22.551799 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda32120-4947-4e69-b619-54f9eea2343c service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:22.620288 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad16a2-12b2-4212-8b70-7d98de472e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:22.620539 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad16a2-12b2-4212-8b70-7d98de472e13 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:22.620664 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad16a2-12b2-4212-8b70-7d98de472e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:22.620944 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad16a2-12b2-4212-8b70-7d98de472e13 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:22.621614 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad16a2-12b2-4212-8b70-7d98de472e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:22.623748 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad16a2-12b2-4212-8b70-7d98de472e13 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:22.716070 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1421/2798] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:27:22 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:27:22.720746 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4c38f-81fb-4531-a1e7-8512c1a7e71c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:22.735510 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4c38f-81fb-4531-a1e7-8512c1a7e71c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:22.740306 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267aea3d-6a6b-4d2c-af81-b2757260b996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:22.740993 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267aea3d-6a6b-4d2c-af81-b2757260b996 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:22.741276 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267aea3d-6a6b-4d2c-af81-b2757260b996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:22.741881 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267aea3d-6a6b-4d2c-af81-b2757260b996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:22.742691 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267aea3d-6a6b-4d2c-af81-b2757260b996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:22.744388 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267aea3d-6a6b-4d2c-af81-b2757260b996 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:22.758526 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1378/2799] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:27:22.763721 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad16a2-12b2-4212-8b70-7d98de472e13 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:22.789152 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad16a2-12b2-4212-8b70-7d98de472e13 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:22.795130 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0006838-1275-478a-a9de-a19cbd6f0ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:22.796527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006838-1275-478a-a9de-a19cbd6f0ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:22.797031 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006838-1275-478a-a9de-a19cbd6f0ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:22.798001 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006838-1275-478a-a9de-a19cbd6f0ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:22.799448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0006838-1275-478a-a9de-a19cbd6f0ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:22.801304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0006838-1275-478a-a9de-a19cbd6f0ff3 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:22.819755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1422/2800] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:27:22.821072 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267aea3d-6a6b-4d2c-af81-b2757260b996 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:22.837217 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267aea3d-6a6b-4d2c-af81-b2757260b996 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:22.842854 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc76f40-6723-45a3-a300-3a67a5bc374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:22.844027 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc76f40-6723-45a3-a300-3a67a5bc374b admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:22.844633 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc76f40-6723-45a3-a300-3a67a5bc374b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:22.845121 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc76f40-6723-45a3-a300-3a67a5bc374b admin admin] PATH_INFO: `/v3/projects/c5ab814a0414466c99939c24f905a10b/users/64ae02a426734c149594b9048510ee12/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:22.876509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc76f40-6723-45a3-a300-3a67a5bc374b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ab814a0414466c99939c24f905a10b, user_id=64ae02a426734c149594b9048510ee12, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:22.881097 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc76f40-6723-45a3-a300-3a67a5bc374b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:22.963764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1379/2801] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:27:22 2022] PUT /identity/v3/projects/c5ab814a0414466c99939c24f905a10b/users/64ae02a426734c149594b9048510ee12/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:22.976833 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21356da-e9aa-4567-8ad9-8909294e00ad None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:22.977306 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21356da-e9aa-4567-8ad9-8909294e00ad None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:22.977594 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21356da-e9aa-4567-8ad9-8909294e00ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:23.015282 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d21356da-e9aa-4567-8ad9-8909294e00ad None None] MFA Rules not processed for user `64ae02a426734c149594b9048510ee12`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:23.016734 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d21356da-e9aa-4567-8ad9-8909294e00ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:23.104707 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1423/2802] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:23.109917 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc76f40-6723-45a3-a300-3a67a5bc374b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:23.189918 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc76f40-6723-45a3-a300-3a67a5bc374b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:23.195262 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb9f63-a46d-447c-a73e-dea17ae766bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:23.196171 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb9f63-a46d-447c-a73e-dea17ae766bb admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:23.200115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb9f63-a46d-447c-a73e-dea17ae766bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:23.200115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb9f63-a46d-447c-a73e-dea17ae766bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:23.200115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb9f63-a46d-447c-a73e-dea17ae766bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:23.200115 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb9f63-a46d-447c-a73e-dea17ae766bb admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:23.312469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1380/2803] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:27:23 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:27:23.312590 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21356da-e9aa-4567-8ad9-8909294e00ad None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:23.323142 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21356da-e9aa-4567-8ad9-8909294e00ad None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:23.394451 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307b0dd-3870-4402-ad0f-e67bbf330ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:23.401084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307b0dd-3870-4402-ad0f-e67bbf330ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:23.401084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307b0dd-3870-4402-ad0f-e67bbf330ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:23.401084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307b0dd-3870-4402-ad0f-e67bbf330ca0 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:23.401084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307b0dd-3870-4402-ad0f-e67bbf330ca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:23.401084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307b0dd-3870-4402-ad0f-e67bbf330ca0 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:23.481904 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1424/2804] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:27:23 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:27:23.486136 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb9f63-a46d-447c-a73e-dea17ae766bb admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:23.501442 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb9f63-a46d-447c-a73e-dea17ae766bb admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:23.514589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ae6ef-4812-4cc4-a28c-584e2a5d2c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:23.515274 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ae6ef-4812-4cc4-a28c-584e2a5d2c17 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:23.523268 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ae6ef-4812-4cc4-a28c-584e2a5d2c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:23.523268 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ae6ef-4812-4cc4-a28c-584e2a5d2c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:23.523268 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ae6ef-4812-4cc4-a28c-584e2a5d2c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:23.523268 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ae6ef-4812-4cc4-a28c-584e2a5d2c17 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:23.532476 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1381/2805] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:27:23.536856 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307b0dd-3870-4402-ad0f-e67bbf330ca0 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:23.549374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307b0dd-3870-4402-ad0f-e67bbf330ca0 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:23.554658 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2a62f-6120-4a09-821c-3bf2089ed057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:23.555755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2a62f-6120-4a09-821c-3bf2089ed057 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:23.556229 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2a62f-6120-4a09-821c-3bf2089ed057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:23.556503 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2a62f-6120-4a09-821c-3bf2089ed057 admin admin] PATH_INFO: `/v3/projects/69dd630bcd414636b568f8cfc1c9f061/users/5c2a376631ba49a28ca327977f3c3c64/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:23.579748 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2a62f-6120-4a09-821c-3bf2089ed057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69dd630bcd414636b568f8cfc1c9f061, user_id=5c2a376631ba49a28ca327977f3c3c64, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:23.582387 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2a62f-6120-4a09-821c-3bf2089ed057 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:23.656769 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1425/2806] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:27:23 2022] PUT /identity/v3/projects/69dd630bcd414636b568f8cfc1c9f061/users/5c2a376631ba49a28ca327977f3c3c64/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:23.657698 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ae6ef-4812-4cc4-a28c-584e2a5d2c17 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:23.671863 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ae6ef-4812-4cc4-a28c-584e2a5d2c17 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:23.751349 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75746d3-05a7-4b53-b3cb-ad7fb5655400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:23.752137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75746d3-05a7-4b53-b3cb-ad7fb5655400 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:23.753050 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75746d3-05a7-4b53-b3cb-ad7fb5655400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:23.753487 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75746d3-05a7-4b53-b3cb-ad7fb5655400 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:23.754303 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75746d3-05a7-4b53-b3cb-ad7fb5655400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:23.756481 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75746d3-05a7-4b53-b3cb-ad7fb5655400 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:23.770527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1382/2807] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:27:23.775406 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2a62f-6120-4a09-821c-3bf2089ed057 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:23.788158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2a62f-6120-4a09-821c-3bf2089ed057 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:23.793340 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebce06-f7e3-4f7c-a79d-cf90e87c64ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:23.794748 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebce06-f7e3-4f7c-a79d-cf90e87c64ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:23.795174 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebce06-f7e3-4f7c-a79d-cf90e87c64ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:23.795544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebce06-f7e3-4f7c-a79d-cf90e87c64ec admin admin] PATH_INFO: `/v3/projects/69dd630bcd414636b568f8cfc1c9f061/users/5c2a376631ba49a28ca327977f3c3c64/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:23.798931 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebce06-f7e3-4f7c-a79d-cf90e87c64ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=69dd630bcd414636b568f8cfc1c9f061, user_id=5c2a376631ba49a28ca327977f3c3c64, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:23.801976 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebce06-f7e3-4f7c-a79d-cf90e87c64ec admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:23.822757 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1426/2808] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:27:23 2022] PUT /identity/v3/projects/69dd630bcd414636b568f8cfc1c9f061/users/5c2a376631ba49a28ca327977f3c3c64/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:27:23.825486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a009e27-9c55-466b-b44c-10464868163d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:23.826455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a009e27-9c55-466b-b44c-10464868163d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:23.826740 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a009e27-9c55-466b-b44c-10464868163d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:23.864119 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0a009e27-9c55-466b-b44c-10464868163d None None] MFA Rules not processed for user `5c2a376631ba49a28ca327977f3c3c64`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:23.865664 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0a009e27-9c55-466b-b44c-10464868163d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:23.943674 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1383/2809] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:27:23.958026 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebce06-f7e3-4f7c-a79d-cf90e87c64ec admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:23.969246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7cebce06-f7e3-4f7c-a79d-cf90e87c64ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:24.066359 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebce06-f7e3-4f7c-a79d-cf90e87c64ec admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:24.071484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad23df9-0bbf-481f-b48a-0048869a54ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:24.072259 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad23df9-0bbf-481f-b48a-0048869a54ad service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:24.072647 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad23df9-0bbf-481f-b48a-0048869a54ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:24.073027 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad23df9-0bbf-481f-b48a-0048869a54ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:24.141049 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad23df9-0bbf-481f-b48a-0048869a54ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:24.142617 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad23df9-0bbf-481f-b48a-0048869a54ad service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:24.154565 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1427/2810] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:27:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:27:24.490873 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dcdb6-d235-4204-a05b-8201e3e9d362 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:24.491256 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dcdb6-d235-4204-a05b-8201e3e9d362 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:24.491878 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dcdb6-d235-4204-a05b-8201e3e9d362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:24.526368 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7d8dcdb6-d235-4204-a05b-8201e3e9d362 None None] MFA Rules not processed for user `636a4b020cfb491eb59b1a051e5e9404`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:24.528371 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7d8dcdb6-d235-4204-a05b-8201e3e9d362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:24.609731 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1384/2811] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:24.622502 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad23df9-0bbf-481f-b48a-0048869a54ad service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:24.624693 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7ad23df9-0bbf-481f-b48a-0048869a54ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:24.691880 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad23df9-0bbf-481f-b48a-0048869a54ad service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:24.695437 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c44cf-54ba-4704-9683-35660c6149f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a08d8e39f6f42bc9b93dd6d2311bcbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:24.696146 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c44cf-54ba-4704-9683-35660c6149f3 service glance] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:24.696428 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c44cf-54ba-4704-9683-35660c6149f3 service glance] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:24.696694 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c44cf-54ba-4704-9683-35660c6149f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:24.699062 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7d4c44cf-54ba-4704-9683-35660c6149f3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:24.771025 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c44cf-54ba-4704-9683-35660c6149f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:24.772701 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c44cf-54ba-4704-9683-35660c6149f3 service glance] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:24.787144 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1428/2812] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:27:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:27:25.130824 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed7d3e-8595-4564-a7fb-4c70e40bef11 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:25.131300 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed7d3e-8595-4564-a7fb-4c70e40bef11 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:25.133297 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed7d3e-8595-4564-a7fb-4c70e40bef11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:25.160904 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-75ed7d3e-8595-4564-a7fb-4c70e40bef11 None None] MFA Rules not processed for user `7a25a3f2c9a148a1ae73e519070b190b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:25.162124 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-75ed7d3e-8595-4564-a7fb-4c70e40bef11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:25.231388 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1385/2813] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 12 07:27:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:25.245160 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c44cf-54ba-4704-9683-35660c6149f3 service glance] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:25.247592 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7d4c44cf-54ba-4704-9683-35660c6149f3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:25.324107 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c44cf-54ba-4704-9683-35660c6149f3 service glance] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:25.329138 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af297d11-335d-4d12-a169-e8cd1ec6563e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9882820f88349cb8fa2e3d457b19959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:25.329805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af297d11-335d-4d12-a169-e8cd1ec6563e service swift] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:25.330094 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af297d11-335d-4d12-a169-e8cd1ec6563e service swift] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:25.330370 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af297d11-335d-4d12-a169-e8cd1ec6563e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:25.338350 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af297d11-335d-4d12-a169-e8cd1ec6563e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:25.339972 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af297d11-335d-4d12-a169-e8cd1ec6563e service swift] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:25.348129 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1429/2814] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 12 07:27:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 07:27:35.496872 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f16e7-ebc9-4f24-9e25-7d19c4838746 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:35.497487 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f16e7-ebc9-4f24-9e25-7d19c4838746 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:35.497487 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f16e7-ebc9-4f24-9e25-7d19c4838746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:35.515123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-612f16e7-ebc9-4f24-9e25-7d19c4838746 None None] MFA Rules not processed for user `d64b5396be8944ce9fafc9034f54d55f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:35.516367 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-612f16e7-ebc9-4f24-9e25-7d19c4838746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:35.523376 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1386/2815] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:27:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:35.561762 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af297d11-335d-4d12-a169-e8cd1ec6563e service swift] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:35.571134 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af297d11-335d-4d12-a169-e8cd1ec6563e service swift] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:35.581424 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1d53a-8101-4563-b8c7-803f0134b34c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a08d8e39f6f42bc9b93dd6d2311bcbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:35.581424 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1d53a-8101-4563-b8c7-803f0134b34c service glance] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:35.581424 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1d53a-8101-4563-b8c7-803f0134b34c service glance] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:35.581424 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1d53a-8101-4563-b8c7-803f0134b34c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:35.581839 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-07e1d53a-8101-4563-b8c7-803f0134b34c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:35.662009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1d53a-8101-4563-b8c7-803f0134b34c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:35.663350 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1d53a-8101-4563-b8c7-803f0134b34c service glance] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:35.684331 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1430/2816] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:27:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:27:35.906558 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f16e7-ebc9-4f24-9e25-7d19c4838746 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:35.908076 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-612f16e7-ebc9-4f24-9e25-7d19c4838746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:35.975093 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f16e7-ebc9-4f24-9e25-7d19c4838746 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:35.978790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaefb4-0e8a-4488-ad8a-aa5cd06f1c49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:35.979837 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaefb4-0e8a-4488-ad8a-aa5cd06f1c49 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:35.980119 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaefb4-0e8a-4488-ad8a-aa5cd06f1c49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:35.980388 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaefb4-0e8a-4488-ad8a-aa5cd06f1c49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:35.982536 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ecaaefb4-0e8a-4488-ad8a-aa5cd06f1c49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:35.992242 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaaefb4-0e8a-4488-ad8a-aa5cd06f1c49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:35.993721 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaaefb4-0e8a-4488-ad8a-aa5cd06f1c49 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:36.002524 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1387/2817] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:27:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:27:36.363675 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1d53a-8101-4563-b8c7-803f0134b34c service glance] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:36.373527 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1d53a-8101-4563-b8c7-803f0134b34c service glance] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:36.377386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de531b01-0ac6-4ed8-a1ba-5e9410b4cc0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:36.378087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de531b01-0ac6-4ed8-a1ba-5e9410b4cc0c service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:36.378373 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de531b01-0ac6-4ed8-a1ba-5e9410b4cc0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:36.378808 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de531b01-0ac6-4ed8-a1ba-5e9410b4cc0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:36.380623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-de531b01-0ac6-4ed8-a1ba-5e9410b4cc0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:36.394327 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de531b01-0ac6-4ed8-a1ba-5e9410b4cc0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:36.395787 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de531b01-0ac6-4ed8-a1ba-5e9410b4cc0c service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:36.406853 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1431/2818] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:27:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:27:38.195141 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaefb4-0e8a-4488-ad8a-aa5cd06f1c49 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:38.204528 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaefb4-0e8a-4488-ad8a-aa5cd06f1c49 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:38.208351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0837b-738e-4939-b903-893697fed04b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:38.209094 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0837b-738e-4939-b903-893697fed04b service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:38.209377 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0837b-738e-4939-b903-893697fed04b service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:38.209679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0837b-738e-4939-b903-893697fed04b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:38.219138 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0837b-738e-4939-b903-893697fed04b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:38.220610 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0837b-738e-4939-b903-893697fed04b service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:38.230149 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1388/2819] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:27:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:27:39.125277 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cec6d0-bd71-49fd-884b-f313a9a2cd33 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:39.126293 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cec6d0-bd71-49fd-884b-f313a9a2cd33 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:39.126633 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cec6d0-bd71-49fd-884b-f313a9a2cd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:39.147237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-07cec6d0-bd71-49fd-884b-f313a9a2cd33 None None] MFA Rules not processed for user `7a25a3f2c9a148a1ae73e519070b190b`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:27:39.148687 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-07cec6d0-bd71-49fd-884b-f313a9a2cd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:27:39.156893 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1432/2820] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 12 07:27:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:27:39.172196 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0837b-738e-4939-b903-893697fed04b service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:27:39.184820 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0837b-738e-4939-b903-893697fed04b service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:27:39.191729 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03ab4f-6206-4d3f-88b8-8d92f32954f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9882820f88349cb8fa2e3d457b19959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:27:39.192673 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03ab4f-6206-4d3f-88b8-8d92f32954f0 service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:27:39.193213 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03ab4f-6206-4d3f-88b8-8d92f32954f0 service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:27:39.193486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03ab4f-6206-4d3f-88b8-8d92f32954f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:27:39.206567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03ab4f-6206-4d3f-88b8-8d92f32954f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:27:39.208282 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03ab4f-6206-4d3f-88b8-8d92f32954f0 service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:27:39.217144 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1389/2821] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 12 07:27:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 07:28:07.396096 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cec6d0-bd71-49fd-884b-f313a9a2cd33 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:07.397528 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-07cec6d0-bd71-49fd-884b-f313a9a2cd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:07.461315 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cec6d0-bd71-49fd-884b-f313a9a2cd33 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:07.465879 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f2c41-9104-4545-9304-f75fe6acbf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:07.466755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f2c41-9104-4545-9304-f75fe6acbf75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:07.467038 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f2c41-9104-4545-9304-f75fe6acbf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:07.467311 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f2c41-9104-4545-9304-f75fe6acbf75 admin admin] PATH_INFO: `/v3/users/67bc5d2efbfa4ff49936e353ee0d1179` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:07.468583 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f2c41-9104-4545-9304-f75fe6acbf75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67bc5d2efbfa4ff49936e353ee0d1179)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:07.470491 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f2c41-9104-4545-9304-f75fe6acbf75 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:07.661032 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-4b5f2c41-9104-4545-9304-f75fe6acbf75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67bc5d2efbfa4ff49936e353ee0d1179'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:07.661681 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-4b5f2c41-9104-4545-9304-f75fe6acbf75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67bc5d2efbfa4ff49936e353ee0d1179'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:07.662277 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-4b5f2c41-9104-4545-9304-f75fe6acbf75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67bc5d2efbfa4ff49936e353ee0d1179'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:07.673545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-4b5f2c41-9104-4545-9304-f75fe6acbf75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67bc5d2efbfa4ff49936e353ee0d1179'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:07.680273 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-4b5f2c41-9104-4545-9304-f75fe6acbf75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67bc5d2efbfa4ff49936e353ee0d1179'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:07.732633 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1433/2822] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:28:07 2022] DELETE /identity/v3/users/67bc5d2efbfa4ff49936e353ee0d1179 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:28:07.737582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d6293-1de9-459b-a783-d3d9a8f6745e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:07.738164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d6293-1de9-459b-a783-d3d9a8f6745e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:07.738164 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d6293-1de9-459b-a783-d3d9a8f6745e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:07.755171 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-236d6293-1de9-459b-a783-d3d9a8f6745e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:07.756393 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-236d6293-1de9-459b-a783-d3d9a8f6745e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:07.811183 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1390/2823] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:28:07.821276 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f2c41-9104-4545-9304-f75fe6acbf75 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:07.822693 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4b5f2c41-9104-4545-9304-f75fe6acbf75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:07.879956 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f2c41-9104-4545-9304-f75fe6acbf75 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:07.883866 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7487f4-a69f-4aba-9c1d-7891b4fbb9ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:07.884513 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7487f4-a69f-4aba-9c1d-7891b4fbb9ee service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:07.884805 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7487f4-a69f-4aba-9c1d-7891b4fbb9ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:07.885077 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7487f4-a69f-4aba-9c1d-7891b4fbb9ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:07.894608 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7487f4-a69f-4aba-9c1d-7891b4fbb9ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:07.896071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7487f4-a69f-4aba-9c1d-7891b4fbb9ee service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:07.905569 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1434/2824] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:28:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:28:08.311650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d6293-1de9-459b-a783-d3d9a8f6745e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:08.313135 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-236d6293-1de9-459b-a783-d3d9a8f6745e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:08.327416 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d6293-1de9-459b-a783-d3d9a8f6745e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:08.336059 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb5a20-7171-4a01-8932-287924e6ee48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:08.337039 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb5a20-7171-4a01-8932-287924e6ee48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:08.337243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb5a20-7171-4a01-8932-287924e6ee48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:08.337474 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb5a20-7171-4a01-8932-287924e6ee48 admin admin] PATH_INFO: `/v3/projects/8a33299083d6419fae430dbb76ebef37` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:08.338673 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb5a20-7171-4a01-8932-287924e6ee48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a33299083d6419fae430dbb76ebef37)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:08.340622 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb5a20-7171-4a01-8932-287924e6ee48 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:08.464987 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-60cb5a20-7171-4a01-8932-287924e6ee48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a33299083d6419fae430dbb76ebef37', 'request_id': 'req-60cb5a20-7171-4a01-8932-287924e6ee48'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:08.522137 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-60cb5a20-7171-4a01-8932-287924e6ee48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a33299083d6419fae430dbb76ebef37', 'request_id': 'req-60cb5a20-7171-4a01-8932-287924e6ee48'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:08.527869 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-60cb5a20-7171-4a01-8932-287924e6ee48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a33299083d6419fae430dbb76ebef37', 'request_id': 'req-60cb5a20-7171-4a01-8932-287924e6ee48'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:08.539305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-60cb5a20-7171-4a01-8932-287924e6ee48 admin admin] The token cache is being invalidate because project 8a33299083d6419fae430dbb76ebef37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:28:08.539593 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-60cb5a20-7171-4a01-8932-287924e6ee48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:08.540289 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-60cb5a20-7171-4a01-8932-287924e6ee48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:08.542263 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1391/2825] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:28:08 2022] DELETE /identity/v3/projects/8a33299083d6419fae430dbb76ebef37 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:28:08.546684 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97460f04-b38f-4915-b4e1-9b0d59de29a1 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:08.547085 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97460f04-b38f-4915-b4e1-9b0d59de29a1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:08.547251 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97460f04-b38f-4915-b4e1-9b0d59de29a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:08.564606 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-97460f04-b38f-4915-b4e1-9b0d59de29a1 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:08.565811 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-97460f04-b38f-4915-b4e1-9b0d59de29a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:08.624378 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1435/2826] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:28:08.632436 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c36fcd-d9bf-4fbd-a7eb-4ad6c9c0250f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:08.632727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c36fcd-d9bf-4fbd-a7eb-4ad6c9c0250f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:08.633007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c36fcd-d9bf-4fbd-a7eb-4ad6c9c0250f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:08.652060 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-05c36fcd-d9bf-4fbd-a7eb-4ad6c9c0250f None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:08.653425 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-05c36fcd-d9bf-4fbd-a7eb-4ad6c9c0250f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:08.662187 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1392/2827] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:28:08.666379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97460f04-b38f-4915-b4e1-9b0d59de29a1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:08.676705 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97460f04-b38f-4915-b4e1-9b0d59de29a1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:08.681304 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f8e3f-db15-4250-83b1-e8599a1dba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:08.681952 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f8e3f-db15-4250-83b1-e8599a1dba4f admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:08.682236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f8e3f-db15-4250-83b1-e8599a1dba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:08.682508 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f8e3f-db15-4250-83b1-e8599a1dba4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:08.683292 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f8e3f-db15-4250-83b1-e8599a1dba4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:28:08.683595 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f8e3f-db15-4250-83b1-e8599a1dba4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:08.685205 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f8e3f-db15-4250-83b1-e8599a1dba4f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:08.696496 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1436/2828] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:28:08.700848 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c36fcd-d9bf-4fbd-a7eb-4ad6c9c0250f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:08.710624 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c36fcd-d9bf-4fbd-a7eb-4ad6c9c0250f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:08.715341 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa951e0e-f587-4900-80e7-0a4eb0548733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:08.716024 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa951e0e-f587-4900-80e7-0a4eb0548733 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:08.716303 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa951e0e-f587-4900-80e7-0a4eb0548733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:08.716577 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa951e0e-f587-4900-80e7-0a4eb0548733 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:08.717263 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa951e0e-f587-4900-80e7-0a4eb0548733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:08.719149 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa951e0e-f587-4900-80e7-0a4eb0548733 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:08.809035 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1393/2829] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:28:08 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:28:08.813117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f8e3f-db15-4250-83b1-e8599a1dba4f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:08.822717 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f8e3f-db15-4250-83b1-e8599a1dba4f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:08.877264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b81de-aadb-4b71-ad80-62723e4a8d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:08.878161 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b81de-aadb-4b71-ad80-62723e4a8d1e admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:08.878587 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b81de-aadb-4b71-ad80-62723e4a8d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:08.878933 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b81de-aadb-4b71-ad80-62723e4a8d1e admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:08.879620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b81de-aadb-4b71-ad80-62723e4a8d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:08.881546 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b81de-aadb-4b71-ad80-62723e4a8d1e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:08.974098 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1437/2830] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:28:08 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:28:08.978169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa951e0e-f587-4900-80e7-0a4eb0548733 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:08.988662 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa951e0e-f587-4900-80e7-0a4eb0548733 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:08.993658 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec8008-0b0e-4f31-b155-ddefad61903f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:08.994315 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec8008-0b0e-4f31-b155-ddefad61903f admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:08.994727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec8008-0b0e-4f31-b155-ddefad61903f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:08.995007 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec8008-0b0e-4f31-b155-ddefad61903f admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:08.995762 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec8008-0b0e-4f31-b155-ddefad61903f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:08.997389 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec8008-0b0e-4f31-b155-ddefad61903f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:09.008235 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1394/2831] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:28:09.012422 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b81de-aadb-4b71-ad80-62723e4a8d1e admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:09.022910 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b81de-aadb-4b71-ad80-62723e4a8d1e admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:09.027474 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ce189-ed07-40e5-bee0-ca12bbd537ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:09.029952 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ce189-ed07-40e5-bee0-ca12bbd537ae admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:09.029952 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ce189-ed07-40e5-bee0-ca12bbd537ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:09.029952 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ce189-ed07-40e5-bee0-ca12bbd537ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:09.029952 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ce189-ed07-40e5-bee0-ca12bbd537ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:09.031001 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ce189-ed07-40e5-bee0-ca12bbd537ae admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:09.040685 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1438/2832] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:28:09.044592 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec8008-0b0e-4f31-b155-ddefad61903f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:09.054524 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec8008-0b0e-4f31-b155-ddefad61903f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:09.059086 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdaadc-99b8-425e-909b-17f1a9d6577e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:09.059948 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdaadc-99b8-425e-909b-17f1a9d6577e admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:09.060227 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdaadc-99b8-425e-909b-17f1a9d6577e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:09.060492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdaadc-99b8-425e-909b-17f1a9d6577e admin admin] PATH_INFO: `/v3/projects/649c886a95da45f6aed9539af216d44c/users/291e58f8b0d7468ca15571bddb1b21db/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:09.075225 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdaadc-99b8-425e-909b-17f1a9d6577e admin admin] RBAC: Authorizing `identity:create_grant(project_id=649c886a95da45f6aed9539af216d44c, user_id=291e58f8b0d7468ca15571bddb1b21db, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:09.077891 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdaadc-99b8-425e-909b-17f1a9d6577e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:09.127456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1395/2833] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:28:09 2022] PUT /identity/v3/projects/649c886a95da45f6aed9539af216d44c/users/291e58f8b0d7468ca15571bddb1b21db/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:28:09.138091 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3f761-ae2e-484a-9c35-9b32d64987b7 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:09.138377 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3f761-ae2e-484a-9c35-9b32d64987b7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:09.138706 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3f761-ae2e-484a-9c35-9b32d64987b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:09.165141 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-0cf3f761-ae2e-484a-9c35-9b32d64987b7 None None] MFA Rules not processed for user `291e58f8b0d7468ca15571bddb1b21db`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:09.166333 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0cf3f761-ae2e-484a-9c35-9b32d64987b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:09.228236 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1439/2834] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:28:09.239411 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdaadc-99b8-425e-909b-17f1a9d6577e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:09.241222 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-63bdaadc-99b8-425e-909b-17f1a9d6577e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:09.297536 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdaadc-99b8-425e-909b-17f1a9d6577e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:09.302271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b45af-acfb-491f-b52d-69e208141580 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:09.303081 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b45af-acfb-491f-b52d-69e208141580 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:09.303406 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b45af-acfb-491f-b52d-69e208141580 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:09.303676 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b45af-acfb-491f-b52d-69e208141580 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:09.312432 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b45af-acfb-491f-b52d-69e208141580 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:09.314573 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b45af-acfb-491f-b52d-69e208141580 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:09.323349 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1396/2835] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:28:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:28:13.274179 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3f761-ae2e-484a-9c35-9b32d64987b7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:13.338039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3f761-ae2e-484a-9c35-9b32d64987b7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:13.342839 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8dfd63-13a8-4dd4-9b42-93d6d3fb4158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:13.343776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dfd63-13a8-4dd4-9b42-93d6d3fb4158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:13.344059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dfd63-13a8-4dd4-9b42-93d6d3fb4158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:13.344348 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dfd63-13a8-4dd4-9b42-93d6d3fb4158 admin admin] PATH_INFO: `/v3/users/291e58f8b0d7468ca15571bddb1b21db` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:13.346202 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8dfd63-13a8-4dd4-9b42-93d6d3fb4158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=291e58f8b0d7468ca15571bddb1b21db)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:13.350833 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8dfd63-13a8-4dd4-9b42-93d6d3fb4158 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:13.518303 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-1c8dfd63-13a8-4dd4-9b42-93d6d3fb4158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '291e58f8b0d7468ca15571bddb1b21db'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:13.518962 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-1c8dfd63-13a8-4dd4-9b42-93d6d3fb4158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '291e58f8b0d7468ca15571bddb1b21db'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:13.519564 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-1c8dfd63-13a8-4dd4-9b42-93d6d3fb4158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '291e58f8b0d7468ca15571bddb1b21db'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:13.531246 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-1c8dfd63-13a8-4dd4-9b42-93d6d3fb4158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '291e58f8b0d7468ca15571bddb1b21db'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:13.538445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-1c8dfd63-13a8-4dd4-9b42-93d6d3fb4158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '291e58f8b0d7468ca15571bddb1b21db'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:13.596617 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1440/2836] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:28:13 2022] DELETE /identity/v3/users/291e58f8b0d7468ca15571bddb1b21db => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:28:13.601166 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc0b22-9cfb-4dbb-a239-c50fa8c0b9fd None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:13.601621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc0b22-9cfb-4dbb-a239-c50fa8c0b9fd None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:13.601773 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc0b22-9cfb-4dbb-a239-c50fa8c0b9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:13.619157 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-55bc0b22-9cfb-4dbb-a239-c50fa8c0b9fd None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:13.620401 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-55bc0b22-9cfb-4dbb-a239-c50fa8c0b9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:13.678391 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1397/2837] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:28:13.687911 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8dfd63-13a8-4dd4-9b42-93d6d3fb4158 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:13.689359 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1c8dfd63-13a8-4dd4-9b42-93d6d3fb4158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:13.755634 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8dfd63-13a8-4dd4-9b42-93d6d3fb4158 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:13.759361 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec64fe6-eeeb-422b-ab9e-1a0331e3270b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:13.760039 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec64fe6-eeeb-422b-ab9e-1a0331e3270b service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:13.760324 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec64fe6-eeeb-422b-ab9e-1a0331e3270b service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:13.760597 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec64fe6-eeeb-422b-ab9e-1a0331e3270b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:13.769916 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec64fe6-eeeb-422b-ab9e-1a0331e3270b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:13.771333 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec64fe6-eeeb-422b-ab9e-1a0331e3270b service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:13.780597 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1441/2838] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:28:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:28:13.880204 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc0b22-9cfb-4dbb-a239-c50fa8c0b9fd None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:13.881598 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-55bc0b22-9cfb-4dbb-a239-c50fa8c0b9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:13.893742 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc0b22-9cfb-4dbb-a239-c50fa8c0b9fd None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:13.898333 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ac4ed-3571-4d9e-ad50-0dd1efa2ca1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:13.899186 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ac4ed-3571-4d9e-ad50-0dd1efa2ca1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:13.899469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ac4ed-3571-4d9e-ad50-0dd1efa2ca1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:13.899776 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ac4ed-3571-4d9e-ad50-0dd1efa2ca1b admin admin] PATH_INFO: `/v3/users/ef86e4e4600949e09fae8d4b929305ad` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:13.900975 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ac4ed-3571-4d9e-ad50-0dd1efa2ca1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef86e4e4600949e09fae8d4b929305ad)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:13.902898 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ac4ed-3571-4d9e-ad50-0dd1efa2ca1b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:14.107653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3d5ac4ed-3571-4d9e-ad50-0dd1efa2ca1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef86e4e4600949e09fae8d4b929305ad'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:14.108424 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3d5ac4ed-3571-4d9e-ad50-0dd1efa2ca1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef86e4e4600949e09fae8d4b929305ad'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:14.119928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3d5ac4ed-3571-4d9e-ad50-0dd1efa2ca1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef86e4e4600949e09fae8d4b929305ad'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:14.120600 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3d5ac4ed-3571-4d9e-ad50-0dd1efa2ca1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef86e4e4600949e09fae8d4b929305ad'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:14.127660 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3d5ac4ed-3571-4d9e-ad50-0dd1efa2ca1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef86e4e4600949e09fae8d4b929305ad'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:14.181036 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec64fe6-eeeb-422b-ab9e-1a0331e3270b service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:14.182380 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5ec64fe6-eeeb-422b-ab9e-1a0331e3270b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:14.195499 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec64fe6-eeeb-422b-ab9e-1a0331e3270b service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:14.200442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42deb9e8-0fb6-433f-b43c-ac84eea6bc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:14.201327 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42deb9e8-0fb6-433f-b43c-ac84eea6bc8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:14.201607 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42deb9e8-0fb6-433f-b43c-ac84eea6bc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:14.201881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42deb9e8-0fb6-433f-b43c-ac84eea6bc8e admin admin] PATH_INFO: `/v3/projects/649c886a95da45f6aed9539af216d44c` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:14.203087 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42deb9e8-0fb6-433f-b43c-ac84eea6bc8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=649c886a95da45f6aed9539af216d44c)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:14.207112 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1398/2839] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:28:13 2022] DELETE /identity/v3/users/ef86e4e4600949e09fae8d4b929305ad => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:28:14.207264 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42deb9e8-0fb6-433f-b43c-ac84eea6bc8e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:14.216001 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b27d6-2a61-4948-8b74-485472573e5a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:14.216300 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b27d6-2a61-4948-8b74-485472573e5a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:14.216582 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b27d6-2a61-4948-8b74-485472573e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:14.234205 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-540b27d6-2a61-4948-8b74-485472573e5a None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:14.235500 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-540b27d6-2a61-4948-8b74-485472573e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:14.292206 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1399/2840] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:28:14.301945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b27d6-2a61-4948-8b74-485472573e5a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:14.303275 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-540b27d6-2a61-4948-8b74-485472573e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:14.318012 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-42deb9e8-0fb6-433f-b43c-ac84eea6bc8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '649c886a95da45f6aed9539af216d44c', 'request_id': 'req-42deb9e8-0fb6-433f-b43c-ac84eea6bc8e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:14.359248 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b27d6-2a61-4948-8b74-485472573e5a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:14.402322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-42deb9e8-0fb6-433f-b43c-ac84eea6bc8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '649c886a95da45f6aed9539af216d44c', 'request_id': 'req-42deb9e8-0fb6-433f-b43c-ac84eea6bc8e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:14.404973 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910e85c-7804-4a09-9131-c0e0c7128605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:14.405616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910e85c-7804-4a09-9131-c0e0c7128605 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:14.405896 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910e85c-7804-4a09-9131-c0e0c7128605 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:14.406170 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910e85c-7804-4a09-9131-c0e0c7128605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:14.408966 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-42deb9e8-0fb6-433f-b43c-ac84eea6bc8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '649c886a95da45f6aed9539af216d44c', 'request_id': 'req-42deb9e8-0fb6-433f-b43c-ac84eea6bc8e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:14.420151 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-42deb9e8-0fb6-433f-b43c-ac84eea6bc8e admin admin] The token cache is being invalidate because project 649c886a95da45f6aed9539af216d44c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:28:14.421484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-42deb9e8-0fb6-433f-b43c-ac84eea6bc8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:14.421484 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-42deb9e8-0fb6-433f-b43c-ac84eea6bc8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:14.422699 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1442/2841] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:28:14 2022] DELETE /identity/v3/projects/649c886a95da45f6aed9539af216d44c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:28:14.423498 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42deb9e8-0fb6-433f-b43c-ac84eea6bc8e admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:14.424950 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-42deb9e8-0fb6-433f-b43c-ac84eea6bc8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:14.438631 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42deb9e8-0fb6-433f-b43c-ac84eea6bc8e admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:14.443804 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cc430-2088-4a50-993a-5a227a4754a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:14.446763 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cc430-2088-4a50-993a-5a227a4754a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:14.446763 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cc430-2088-4a50-993a-5a227a4754a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:14.446763 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cc430-2088-4a50-993a-5a227a4754a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:14.447158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f04cc430-2088-4a50-993a-5a227a4754a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:14.459000 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cc430-2088-4a50-993a-5a227a4754a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:14.460506 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cc430-2088-4a50-993a-5a227a4754a0 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:14.469623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1443/2842] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:28:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:28:14.483644 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910e85c-7804-4a09-9131-c0e0c7128605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:14.485364 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910e85c-7804-4a09-9131-c0e0c7128605 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:14.497067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1400/2843] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:28:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:28:15.023951 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cc430-2088-4a50-993a-5a227a4754a0 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:15.023951 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f04cc430-2088-4a50-993a-5a227a4754a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:15.039658 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cc430-2088-4a50-993a-5a227a4754a0 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:15.044913 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f3832-c242-4c81-8f2c-ef23bc3dd4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:15.045956 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f3832-c242-4c81-8f2c-ef23bc3dd4a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:15.046427 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f3832-c242-4c81-8f2c-ef23bc3dd4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:15.046812 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f3832-c242-4c81-8f2c-ef23bc3dd4a1 admin admin] PATH_INFO: `/v3/projects/499e0fc59a4d498090bfc5e5f7c38de4` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:15.049255 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f3832-c242-4c81-8f2c-ef23bc3dd4a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=499e0fc59a4d498090bfc5e5f7c38de4)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:15.052414 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f3832-c242-4c81-8f2c-ef23bc3dd4a1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:15.161737 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8a0f3832-c242-4c81-8f2c-ef23bc3dd4a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '499e0fc59a4d498090bfc5e5f7c38de4', 'request_id': 'req-8a0f3832-c242-4c81-8f2c-ef23bc3dd4a1'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:15.230549 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8a0f3832-c242-4c81-8f2c-ef23bc3dd4a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '499e0fc59a4d498090bfc5e5f7c38de4', 'request_id': 'req-8a0f3832-c242-4c81-8f2c-ef23bc3dd4a1'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:15.236888 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8a0f3832-c242-4c81-8f2c-ef23bc3dd4a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '499e0fc59a4d498090bfc5e5f7c38de4', 'request_id': 'req-8a0f3832-c242-4c81-8f2c-ef23bc3dd4a1'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:15.248431 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8a0f3832-c242-4c81-8f2c-ef23bc3dd4a1 admin admin] The token cache is being invalidate because project 499e0fc59a4d498090bfc5e5f7c38de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:28:15.248719 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8a0f3832-c242-4c81-8f2c-ef23bc3dd4a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:15.249430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8a0f3832-c242-4c81-8f2c-ef23bc3dd4a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:15.250905 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1444/2844] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:28:15 2022] DELETE /identity/v3/projects/499e0fc59a4d498090bfc5e5f7c38de4 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:28:15.256509 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef98cf-7eb9-429d-b708-655592a0bde5 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:15.256955 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef98cf-7eb9-429d-b708-655592a0bde5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:15.258917 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef98cf-7eb9-429d-b708-655592a0bde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:15.274459 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2aef98cf-7eb9-429d-b708-655592a0bde5 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:15.275763 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2aef98cf-7eb9-429d-b708-655592a0bde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:15.334741 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1401/2845] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:28:15.343084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014bc02-bff0-4873-b7ba-fc7365360e8b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:15.343583 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014bc02-bff0-4873-b7ba-fc7365360e8b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:15.343789 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014bc02-bff0-4873-b7ba-fc7365360e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:15.362079 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-8014bc02-bff0-4873-b7ba-fc7365360e8b None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:15.363262 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8014bc02-bff0-4873-b7ba-fc7365360e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:15.371056 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1445/2846] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:28:15.375071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef98cf-7eb9-429d-b708-655592a0bde5 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:15.385191 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef98cf-7eb9-429d-b708-655592a0bde5 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:15.389667 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f2e1c-ca14-4ecd-9aa8-fe01ba46eac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:15.390303 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f2e1c-ca14-4ecd-9aa8-fe01ba46eac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:15.390624 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f2e1c-ca14-4ecd-9aa8-fe01ba46eac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:15.390878 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f2e1c-ca14-4ecd-9aa8-fe01ba46eac7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:15.391595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f2e1c-ca14-4ecd-9aa8-fe01ba46eac7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:28:15.391929 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f2e1c-ca14-4ecd-9aa8-fe01ba46eac7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:15.393498 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f2e1c-ca14-4ecd-9aa8-fe01ba46eac7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:15.404419 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1402/2847] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:28:15.408500 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014bc02-bff0-4873-b7ba-fc7365360e8b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:15.417445 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014bc02-bff0-4873-b7ba-fc7365360e8b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:15.421989 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82145c-7733-41b8-b24b-5493dc426b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:15.422629 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82145c-7733-41b8-b24b-5493dc426b7c admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:15.422908 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82145c-7733-41b8-b24b-5493dc426b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:15.423178 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82145c-7733-41b8-b24b-5493dc426b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:15.424402 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82145c-7733-41b8-b24b-5493dc426b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:15.426545 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82145c-7733-41b8-b24b-5493dc426b7c admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:15.506709 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1446/2848] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:28:15 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:28:15.510591 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f2e1c-ca14-4ecd-9aa8-fe01ba46eac7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:15.520605 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f2e1c-ca14-4ecd-9aa8-fe01ba46eac7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:15.575220 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a5113-6ab4-4739-a49e-e08b7364d9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:15.575926 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a5113-6ab4-4739-a49e-e08b7364d9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:15.576211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a5113-6ab4-4739-a49e-e08b7364d9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:15.576485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a5113-6ab4-4739-a49e-e08b7364d9c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:15.577184 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a5113-6ab4-4739-a49e-e08b7364d9c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:15.579082 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a5113-6ab4-4739-a49e-e08b7364d9c9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:15.636483 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1403/2849] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:28:15 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:28:15.640637 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82145c-7733-41b8-b24b-5493dc426b7c admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:15.650772 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82145c-7733-41b8-b24b-5493dc426b7c admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:15.655393 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc5caa-cf51-4b36-982d-6b7c111e44da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:15.656088 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc5caa-cf51-4b36-982d-6b7c111e44da admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:15.656368 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc5caa-cf51-4b36-982d-6b7c111e44da admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:15.656639 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc5caa-cf51-4b36-982d-6b7c111e44da admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:15.657443 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc5caa-cf51-4b36-982d-6b7c111e44da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:15.659511 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc5caa-cf51-4b36-982d-6b7c111e44da admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:15.669603 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1447/2850] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:28:15.674210 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a5113-6ab4-4739-a49e-e08b7364d9c9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:15.684445 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a5113-6ab4-4739-a49e-e08b7364d9c9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:15.689029 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37f34e-1602-48ce-858c-cf963752ad29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:15.689685 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37f34e-1602-48ce-858c-cf963752ad29 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:15.690000 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37f34e-1602-48ce-858c-cf963752ad29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:15.690278 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37f34e-1602-48ce-858c-cf963752ad29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:15.691005 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37f34e-1602-48ce-858c-cf963752ad29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:15.692622 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37f34e-1602-48ce-858c-cf963752ad29 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:15.702192 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1404/2851] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:28:15.706269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc5caa-cf51-4b36-982d-6b7c111e44da admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:15.716042 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc5caa-cf51-4b36-982d-6b7c111e44da admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:15.721325 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2663c-6d26-4228-8c6e-61826e00a3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:15.722199 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2663c-6d26-4228-8c6e-61826e00a3c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:15.722481 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2663c-6d26-4228-8c6e-61826e00a3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:15.722755 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2663c-6d26-4228-8c6e-61826e00a3c6 admin admin] PATH_INFO: `/v3/projects/83f19978597e4c16ad7ebaf22b632a41/users/fa0fe3302b164d92b19d89ab201b0a06/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:15.737483 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2663c-6d26-4228-8c6e-61826e00a3c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f19978597e4c16ad7ebaf22b632a41, user_id=fa0fe3302b164d92b19d89ab201b0a06, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:15.740161 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2663c-6d26-4228-8c6e-61826e00a3c6 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:15.807594 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1448/2852] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:28:15 2022] PUT /identity/v3/projects/83f19978597e4c16ad7ebaf22b632a41/users/fa0fe3302b164d92b19d89ab201b0a06/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:28:15.817694 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddb444-78a2-4dbb-b4cc-268932f1ca22 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:15.817997 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddb444-78a2-4dbb-b4cc-268932f1ca22 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:15.818316 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddb444-78a2-4dbb-b4cc-268932f1ca22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:15.845111 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-16ddb444-78a2-4dbb-b4cc-268932f1ca22 None None] MFA Rules not processed for user `fa0fe3302b164d92b19d89ab201b0a06`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:15.847186 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-16ddb444-78a2-4dbb-b4cc-268932f1ca22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:15.848059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2663c-6d26-4228-8c6e-61826e00a3c6 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:15.849692 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-99e2663c-6d26-4228-8c6e-61826e00a3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:15.910242 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1405/2853] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:28:15.913043 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2663c-6d26-4228-8c6e-61826e00a3c6 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:15.918330 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf237f-ac2a-4094-a4e6-b6afaca66ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:15.919212 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf237f-ac2a-4094-a4e6-b6afaca66ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:15.919498 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf237f-ac2a-4094-a4e6-b6afaca66ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:15.920150 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf237f-ac2a-4094-a4e6-b6afaca66ce8 admin admin] PATH_INFO: `/v3/users/64ae02a426734c149594b9048510ee12` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:15.921210 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddb444-78a2-4dbb-b4cc-268932f1ca22 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:15.921384 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf237f-ac2a-4094-a4e6-b6afaca66ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64ae02a426734c149594b9048510ee12)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:15.922765 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-16ddb444-78a2-4dbb-b4cc-268932f1ca22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:15.924670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf237f-ac2a-4094-a4e6-b6afaca66ce8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:15.985369 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddb444-78a2-4dbb-b4cc-268932f1ca22 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:15.990470 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730e93e-23a2-4691-a5dd-d502a153f38f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:15.991119 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730e93e-23a2-4691-a5dd-d502a153f38f service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:15.991398 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730e93e-23a2-4691-a5dd-d502a153f38f service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:15.991668 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730e93e-23a2-4691-a5dd-d502a153f38f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:16.000267 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730e93e-23a2-4691-a5dd-d502a153f38f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:16.001714 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730e93e-23a2-4691-a5dd-d502a153f38f service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:16.010873 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1406/2854] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:28:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:28:16.096369 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d8bf237f-ac2a-4094-a4e6-b6afaca66ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64ae02a426734c149594b9048510ee12'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:16.097076 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d8bf237f-ac2a-4094-a4e6-b6afaca66ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64ae02a426734c149594b9048510ee12'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:16.097765 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d8bf237f-ac2a-4094-a4e6-b6afaca66ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64ae02a426734c149594b9048510ee12'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:16.109428 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d8bf237f-ac2a-4094-a4e6-b6afaca66ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64ae02a426734c149594b9048510ee12'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:16.116150 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d8bf237f-ac2a-4094-a4e6-b6afaca66ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64ae02a426734c149594b9048510ee12'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:16.202212 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1449/2855] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:28:15 2022] DELETE /identity/v3/users/64ae02a426734c149594b9048510ee12 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:28:16.207372 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddef12-d8d4-40e4-b548-9d63821a887d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:16.207667 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddef12-d8d4-40e4-b548-9d63821a887d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:16.207984 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddef12-d8d4-40e4-b548-9d63821a887d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:16.225448 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-22ddef12-d8d4-40e4-b548-9d63821a887d None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:16.227875 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-22ddef12-d8d4-40e4-b548-9d63821a887d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:16.282458 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1407/2856] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:28:16.292491 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf237f-ac2a-4094-a4e6-b6afaca66ce8 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:16.293948 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d8bf237f-ac2a-4094-a4e6-b6afaca66ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:16.350335 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf237f-ac2a-4094-a4e6-b6afaca66ce8 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:16.354075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ebaa1-b053-40e7-b7f3-5ecf4a5bbcf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:16.354776 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ebaa1-b053-40e7-b7f3-5ecf4a5bbcf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:16.355071 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ebaa1-b053-40e7-b7f3-5ecf4a5bbcf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:16.355349 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ebaa1-b053-40e7-b7f3-5ecf4a5bbcf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:16.364397 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ebaa1-b053-40e7-b7f3-5ecf4a5bbcf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:16.365812 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ebaa1-b053-40e7-b7f3-5ecf4a5bbcf7 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:16.375187 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1450/2857] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:28:16.781109 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ddef12-d8d4-40e4-b548-9d63821a887d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:16.782662 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-22ddef12-d8d4-40e4-b548-9d63821a887d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:16.794585 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ddef12-d8d4-40e4-b548-9d63821a887d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:16.799996 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbdc09-3678-4814-9ba2-a15459053ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:16.801169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbdc09-3678-4814-9ba2-a15459053ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:16.801443 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbdc09-3678-4814-9ba2-a15459053ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:16.801708 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbdc09-3678-4814-9ba2-a15459053ed0 admin admin] PATH_INFO: `/v3/projects/c5ab814a0414466c99939c24f905a10b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:16.802885 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbdc09-3678-4814-9ba2-a15459053ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5ab814a0414466c99939c24f905a10b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:16.804874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbdc09-3678-4814-9ba2-a15459053ed0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:16.898680 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-12cbdc09-3678-4814-9ba2-a15459053ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ab814a0414466c99939c24f905a10b', 'request_id': 'req-12cbdc09-3678-4814-9ba2-a15459053ed0'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:16.950517 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-12cbdc09-3678-4814-9ba2-a15459053ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ab814a0414466c99939c24f905a10b', 'request_id': 'req-12cbdc09-3678-4814-9ba2-a15459053ed0'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:16.961956 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-12cbdc09-3678-4814-9ba2-a15459053ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ab814a0414466c99939c24f905a10b', 'request_id': 'req-12cbdc09-3678-4814-9ba2-a15459053ed0'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:16.971243 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-12cbdc09-3678-4814-9ba2-a15459053ed0 admin admin] The token cache is being invalidate because project c5ab814a0414466c99939c24f905a10b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:28:16.971534 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-12cbdc09-3678-4814-9ba2-a15459053ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:16.972354 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-12cbdc09-3678-4814-9ba2-a15459053ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:16.973993 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1408/2858] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:28:16 2022] DELETE /identity/v3/projects/c5ab814a0414466c99939c24f905a10b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:28:16.977989 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ebaa1-b053-40e7-b7f3-5ecf4a5bbcf7 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:16.988064 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ebaa1-b053-40e7-b7f3-5ecf4a5bbcf7 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:17.046807 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb03416-130f-4f2e-aa92-0e3ba9ff662a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:17.047656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb03416-130f-4f2e-aa92-0e3ba9ff662a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:17.047985 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb03416-130f-4f2e-aa92-0e3ba9ff662a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:17.048257 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb03416-130f-4f2e-aa92-0e3ba9ff662a admin admin] PATH_INFO: `/v3/users/5c2a376631ba49a28ca327977f3c3c64` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:17.049448 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb03416-130f-4f2e-aa92-0e3ba9ff662a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c2a376631ba49a28ca327977f3c3c64)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:17.052134 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb03416-130f-4f2e-aa92-0e3ba9ff662a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:17.266802 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-bcb03416-130f-4f2e-aa92-0e3ba9ff662a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c2a376631ba49a28ca327977f3c3c64'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:17.267444 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-bcb03416-130f-4f2e-aa92-0e3ba9ff662a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c2a376631ba49a28ca327977f3c3c64'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:17.268017 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-bcb03416-130f-4f2e-aa92-0e3ba9ff662a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c2a376631ba49a28ca327977f3c3c64'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:17.281363 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-bcb03416-130f-4f2e-aa92-0e3ba9ff662a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c2a376631ba49a28ca327977f3c3c64'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:17.288782 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-bcb03416-130f-4f2e-aa92-0e3ba9ff662a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c2a376631ba49a28ca327977f3c3c64'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:17.402833 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1451/2859] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:28:16 2022] DELETE /identity/v3/users/5c2a376631ba49a28ca327977f3c3c64 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:28:17.798567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbdc09-3678-4814-9ba2-a15459053ed0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:17.800843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-12cbdc09-3678-4814-9ba2-a15459053ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:17.814257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbdc09-3678-4814-9ba2-a15459053ed0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:17.881093 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1208998-aedb-4d75-9286-3aaeec441d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:17.882044 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1208998-aedb-4d75-9286-3aaeec441d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:17.882532 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1208998-aedb-4d75-9286-3aaeec441d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:17.882813 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1208998-aedb-4d75-9286-3aaeec441d20 admin admin] PATH_INFO: `/v3/projects/69dd630bcd414636b568f8cfc1c9f061` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:17.884058 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1208998-aedb-4d75-9286-3aaeec441d20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69dd630bcd414636b568f8cfc1c9f061)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:17.886004 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1208998-aedb-4d75-9286-3aaeec441d20 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:18.025595 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1208998-aedb-4d75-9286-3aaeec441d20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69dd630bcd414636b568f8cfc1c9f061', 'request_id': 'req-f1208998-aedb-4d75-9286-3aaeec441d20'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:18.082871 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1208998-aedb-4d75-9286-3aaeec441d20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69dd630bcd414636b568f8cfc1c9f061', 'request_id': 'req-f1208998-aedb-4d75-9286-3aaeec441d20'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:18.090191 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1208998-aedb-4d75-9286-3aaeec441d20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69dd630bcd414636b568f8cfc1c9f061', 'request_id': 'req-f1208998-aedb-4d75-9286-3aaeec441d20'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:18.101826 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1208998-aedb-4d75-9286-3aaeec441d20 admin admin] The token cache is being invalidate because project 69dd630bcd414636b568f8cfc1c9f061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:28:18.102109 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1208998-aedb-4d75-9286-3aaeec441d20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:18.102752 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1208998-aedb-4d75-9286-3aaeec441d20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:18.104352 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1409/2860] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:28:17 2022] DELETE /identity/v3/projects/69dd630bcd414636b568f8cfc1c9f061 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:28:18.109204 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e494cce-fd7b-4741-9e4e-6238061bc13e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:18.111988 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e494cce-fd7b-4741-9e4e-6238061bc13e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:18.111988 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e494cce-fd7b-4741-9e4e-6238061bc13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:18.128629 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-8e494cce-fd7b-4741-9e4e-6238061bc13e None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:18.129896 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8e494cce-fd7b-4741-9e4e-6238061bc13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:18.204834 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1452/2861] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:28:18.212580 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33f2af-5cec-4991-9b55-9b1c6e77e923 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:18.219740 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33f2af-5cec-4991-9b55-9b1c6e77e923 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:18.219740 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33f2af-5cec-4991-9b55-9b1c6e77e923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:18.234572 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-dc33f2af-5cec-4991-9b55-9b1c6e77e923 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:18.235888 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-dc33f2af-5cec-4991-9b55-9b1c6e77e923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:18.247498 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1410/2862] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:28:18.248941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e494cce-fd7b-4741-9e4e-6238061bc13e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:18.261519 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e494cce-fd7b-4741-9e4e-6238061bc13e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:18.276395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c754e9d-e892-4219-ae42-20f3d2a64a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:18.277111 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c754e9d-e892-4219-ae42-20f3d2a64a0b admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:18.277395 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c754e9d-e892-4219-ae42-20f3d2a64a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:18.277669 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c754e9d-e892-4219-ae42-20f3d2a64a0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:18.278405 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c754e9d-e892-4219-ae42-20f3d2a64a0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:28:18.278690 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c754e9d-e892-4219-ae42-20f3d2a64a0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:18.280329 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c754e9d-e892-4219-ae42-20f3d2a64a0b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:18.296467 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1453/2863] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:28:18.297975 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33f2af-5cec-4991-9b55-9b1c6e77e923 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:18.309067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33f2af-5cec-4991-9b55-9b1c6e77e923 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:18.313897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3720a1-3a6b-4536-b058-87b644b145ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:18.314560 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3720a1-3a6b-4536-b058-87b644b145ed admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:18.314839 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3720a1-3a6b-4536-b058-87b644b145ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:18.315103 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3720a1-3a6b-4536-b058-87b644b145ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:18.315897 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3720a1-3a6b-4536-b058-87b644b145ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:18.317782 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3720a1-3a6b-4536-b058-87b644b145ed admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:18.401945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1411/2864] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:28:18 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:28:18.403962 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c754e9d-e892-4219-ae42-20f3d2a64a0b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:18.414502 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c754e9d-e892-4219-ae42-20f3d2a64a0b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:18.459210 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3720a1-3a6b-4536-b058-87b644b145ed admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:18.460914 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fe3720a1-3a6b-4536-b058-87b644b145ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:18.470079 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763831e1-efec-4880-85e4-ec75242c9940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:18.471150 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763831e1-efec-4880-85e4-ec75242c9940 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:18.471150 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763831e1-efec-4880-85e4-ec75242c9940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:18.471385 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763831e1-efec-4880-85e4-ec75242c9940 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:18.472623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763831e1-efec-4880-85e4-ec75242c9940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:18.474516 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763831e1-efec-4880-85e4-ec75242c9940 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:18.517091 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3720a1-3a6b-4536-b058-87b644b145ed admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:18.521225 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788d33f-c150-4734-aaee-f39c396798d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:18.521862 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788d33f-c150-4734-aaee-f39c396798d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:18.522138 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788d33f-c150-4734-aaee-f39c396798d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:18.522408 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788d33f-c150-4734-aaee-f39c396798d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:18.524203 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1788d33f-c150-4734-aaee-f39c396798d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:18.557136 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1454/2865] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:28:18 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:28:18.561123 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763831e1-efec-4880-85e4-ec75242c9940 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:18.571103 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763831e1-efec-4880-85e4-ec75242c9940 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:18.576075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad3715-fbb0-4f4c-8b6d-e6693e8a0c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:18.576720 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad3715-fbb0-4f4c-8b6d-e6693e8a0c5c admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:18.576998 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad3715-fbb0-4f4c-8b6d-e6693e8a0c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:18.577273 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad3715-fbb0-4f4c-8b6d-e6693e8a0c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:18.577992 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad3715-fbb0-4f4c-8b6d-e6693e8a0c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:18.579553 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad3715-fbb0-4f4c-8b6d-e6693e8a0c5c admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:18.586628 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788d33f-c150-4734-aaee-f39c396798d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:18.588106 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788d33f-c150-4734-aaee-f39c396798d8 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:18.591761 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1455/2866] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:28:18.597864 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1412/2867] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:28:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 07:28:18.598584 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad3715-fbb0-4f4c-8b6d-e6693e8a0c5c admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:18.608444 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad3715-fbb0-4f4c-8b6d-e6693e8a0c5c admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:18.613255 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db170c-c984-4204-9e38-ac4392a1aeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:18.614602 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db170c-c984-4204-9e38-ac4392a1aeaf admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:18.614602 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db170c-c984-4204-9e38-ac4392a1aeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:18.614602 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db170c-c984-4204-9e38-ac4392a1aeaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:18.615294 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db170c-c984-4204-9e38-ac4392a1aeaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:18.616959 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db170c-c984-4204-9e38-ac4392a1aeaf admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:18.629476 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1456/2868] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 07:28:18.633671 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788d33f-c150-4734-aaee-f39c396798d8 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:18.647083 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788d33f-c150-4734-aaee-f39c396798d8 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:18.651879 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712512f3-688c-4e75-a500-68a35d1402de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:18.652764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712512f3-688c-4e75-a500-68a35d1402de admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:18.653075 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712512f3-688c-4e75-a500-68a35d1402de admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:18.653320 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712512f3-688c-4e75-a500-68a35d1402de admin admin] PATH_INFO: `/v3/projects/3135a9d0f1854a15875b9b8d9ff76923/users/24ddbc5e48b54a26ba5712f7cde7e340/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:18.668160 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712512f3-688c-4e75-a500-68a35d1402de admin admin] RBAC: Authorizing `identity:create_grant(project_id=3135a9d0f1854a15875b9b8d9ff76923, user_id=24ddbc5e48b54a26ba5712f7cde7e340, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:18.672318 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712512f3-688c-4e75-a500-68a35d1402de admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:18.751191 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1413/2869] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:28:18 2022] PUT /identity/v3/projects/3135a9d0f1854a15875b9b8d9ff76923/users/24ddbc5e48b54a26ba5712f7cde7e340/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:28:18.761914 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd649a8d-fa8c-46c0-826f-aa50915ed059 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:18.762204 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd649a8d-fa8c-46c0-826f-aa50915ed059 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:18.762482 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd649a8d-fa8c-46c0-826f-aa50915ed059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:18.789215 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-bd649a8d-fa8c-46c0-826f-aa50915ed059 None None] MFA Rules not processed for user `24ddbc5e48b54a26ba5712f7cde7e340`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:18.790428 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-bd649a8d-fa8c-46c0-826f-aa50915ed059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:18.854731 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1457/2870] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:28:18.859811 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712512f3-688c-4e75-a500-68a35d1402de admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:18.921546 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712512f3-688c-4e75-a500-68a35d1402de admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:18.926814 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a990e-21ca-45af-9337-8ad147bac90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:18.927474 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a990e-21ca-45af-9337-8ad147bac90a admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:18.927788 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a990e-21ca-45af-9337-8ad147bac90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:18.928063 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a990e-21ca-45af-9337-8ad147bac90a admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:18.928758 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a990e-21ca-45af-9337-8ad147bac90a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:18.930669 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a990e-21ca-45af-9337-8ad147bac90a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:19.027123 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1414/2871] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:28:18 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:28:19.031162 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd649a8d-fa8c-46c0-826f-aa50915ed059 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:19.042923 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd649a8d-fa8c-46c0-826f-aa50915ed059 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:19.098847 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056d725-b133-4048-8bc0-49cfcec03493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:19.099959 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056d725-b133-4048-8bc0-49cfcec03493 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:19.100338 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056d725-b133-4048-8bc0-49cfcec03493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:19.103400 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056d725-b133-4048-8bc0-49cfcec03493 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:19.103400 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056d725-b133-4048-8bc0-49cfcec03493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:19.104365 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056d725-b133-4048-8bc0-49cfcec03493 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:19.178163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1458/2872] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:28:19 2022] POST /identity/v3/users => generated 298 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 07:28:19.180581 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a990e-21ca-45af-9337-8ad147bac90a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:19.191441 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a990e-21ca-45af-9337-8ad147bac90a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:19.196077 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c3310-8f82-4ccb-ab04-1e9daa221d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:19.196757 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c3310-8f82-4ccb-ab04-1e9daa221d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:19.197015 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c3310-8f82-4ccb-ab04-1e9daa221d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:19.197285 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c3310-8f82-4ccb-ab04-1e9daa221d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:19.198011 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c3310-8f82-4ccb-ab04-1e9daa221d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:19.199589 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c3310-8f82-4ccb-ab04-1e9daa221d18 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:19.210483 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1415/2873] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:28:19.214558 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056d725-b133-4048-8bc0-49cfcec03493 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:19.224638 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056d725-b133-4048-8bc0-49cfcec03493 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:19.229444 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6e7a1-6cc6-4dcb-a66d-0f76717daa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:19.230534 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6e7a1-6cc6-4dcb-a66d-0f76717daa35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:19.230822 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6e7a1-6cc6-4dcb-a66d-0f76717daa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:19.231099 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6e7a1-6cc6-4dcb-a66d-0f76717daa35 admin admin] PATH_INFO: `/v3/projects/16d8d4bbec5442f78dc5776d5bf7be1f/users/bfc2fc4f9bb8434c971d666796d87f8e/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:19.246366 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6e7a1-6cc6-4dcb-a66d-0f76717daa35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d8d4bbec5442f78dc5776d5bf7be1f, user_id=bfc2fc4f9bb8434c971d666796d87f8e, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:19.249001 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6e7a1-6cc6-4dcb-a66d-0f76717daa35 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:19.340275 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1459/2874] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:28:19 2022] PUT /identity/v3/projects/16d8d4bbec5442f78dc5776d5bf7be1f/users/bfc2fc4f9bb8434c971d666796d87f8e/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:28:19.352442 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c3310-8f82-4ccb-ab04-1e9daa221d18 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:19.364517 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c3310-8f82-4ccb-ab04-1e9daa221d18 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:19.427420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984be44-538f-48fd-a93c-5cab0bcca0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:19.428715 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984be44-538f-48fd-a93c-5cab0bcca0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:19.428715 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984be44-538f-48fd-a93c-5cab0bcca0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:19.428966 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984be44-538f-48fd-a93c-5cab0bcca0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:19.429758 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984be44-538f-48fd-a93c-5cab0bcca0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:19.431495 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984be44-538f-48fd-a93c-5cab0bcca0e9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:19.442288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1416/2875] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:28:19.447376 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6e7a1-6cc6-4dcb-a66d-0f76717daa35 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:19.458374 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6e7a1-6cc6-4dcb-a66d-0f76717daa35 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:19.463162 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cb325-2620-46bc-ab70-22d6b1013c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:19.464160 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cb325-2620-46bc-ab70-22d6b1013c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:19.464516 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cb325-2620-46bc-ab70-22d6b1013c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:19.464871 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cb325-2620-46bc-ab70-22d6b1013c1e admin admin] PATH_INFO: `/v3/projects/16d8d4bbec5442f78dc5776d5bf7be1f/users/bfc2fc4f9bb8434c971d666796d87f8e/roles/5e6a73052f3b4ee7829ecb858925e5ca` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:19.466961 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cb325-2620-46bc-ab70-22d6b1013c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d8d4bbec5442f78dc5776d5bf7be1f, user_id=bfc2fc4f9bb8434c971d666796d87f8e, role_id=5e6a73052f3b4ee7829ecb858925e5ca)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:19.469785 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cb325-2620-46bc-ab70-22d6b1013c1e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:19.480559 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1460/2876] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:28:19 2022] PUT /identity/v3/projects/16d8d4bbec5442f78dc5776d5bf7be1f/users/bfc2fc4f9bb8434c971d666796d87f8e/roles/5e6a73052f3b4ee7829ecb858925e5ca => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:28:19.492245 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd464e2c-22a4-46bc-8123-6a854bd33a54 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:19.493220 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd464e2c-22a4-46bc-8123-6a854bd33a54 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:19.494047 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd464e2c-22a4-46bc-8123-6a854bd33a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:19.520420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-fd464e2c-22a4-46bc-8123-6a854bd33a54 None None] MFA Rules not processed for user `bfc2fc4f9bb8434c971d666796d87f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:19.521542 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fd464e2c-22a4-46bc-8123-6a854bd33a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:19.588979 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1417/2877] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:28:19.600172 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cb325-2620-46bc-ab70-22d6b1013c1e admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:19.602013 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-136cb325-2620-46bc-ab70-22d6b1013c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:19.658476 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cb325-2620-46bc-ab70-22d6b1013c1e admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:19.662695 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644e33a-ba6f-454a-b894-3583b51ad0cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:19.663337 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644e33a-ba6f-454a-b894-3583b51ad0cb service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:19.663623 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644e33a-ba6f-454a-b894-3583b51ad0cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:19.663926 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644e33a-ba6f-454a-b894-3583b51ad0cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:19.673066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644e33a-ba6f-454a-b894-3583b51ad0cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:19.675266 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644e33a-ba6f-454a-b894-3583b51ad0cb service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:19.686230 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1461/2878] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:28:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:28:19.785570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd464e2c-22a4-46bc-8123-6a854bd33a54 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:19.795562 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd464e2c-22a4-46bc-8123-6a854bd33a54 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:19.799211 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3efc60-0558-4804-8c76-ff40d5ad80da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:19.799903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3efc60-0558-4804-8c76-ff40d5ad80da service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:19.800182 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3efc60-0558-4804-8c76-ff40d5ad80da service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:19.800478 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3efc60-0558-4804-8c76-ff40d5ad80da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:19.859220 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3efc60-0558-4804-8c76-ff40d5ad80da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:19.860855 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3efc60-0558-4804-8c76-ff40d5ad80da service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:19.874051 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1418/2879] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:28:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:28:23.020312 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644e33a-ba6f-454a-b894-3583b51ad0cb service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:23.093554 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644e33a-ba6f-454a-b894-3583b51ad0cb service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:23.099232 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dc731-f027-4dd6-af4b-5c21893a14d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:23.100202 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dc731-f027-4dd6-af4b-5c21893a14d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:23.100488 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dc731-f027-4dd6-af4b-5c21893a14d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:23.100761 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dc731-f027-4dd6-af4b-5c21893a14d1 admin admin] PATH_INFO: `/v3/users/24ddbc5e48b54a26ba5712f7cde7e340` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:23.102156 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235dc731-f027-4dd6-af4b-5c21893a14d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24ddbc5e48b54a26ba5712f7cde7e340)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:23.104081 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235dc731-f027-4dd6-af4b-5c21893a14d1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:23.251774 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-235dc731-f027-4dd6-af4b-5c21893a14d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24ddbc5e48b54a26ba5712f7cde7e340'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:23.252538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-235dc731-f027-4dd6-af4b-5c21893a14d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24ddbc5e48b54a26ba5712f7cde7e340'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:23.253062 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-235dc731-f027-4dd6-af4b-5c21893a14d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24ddbc5e48b54a26ba5712f7cde7e340'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:23.265135 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-235dc731-f027-4dd6-af4b-5c21893a14d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24ddbc5e48b54a26ba5712f7cde7e340'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:23.273832 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-235dc731-f027-4dd6-af4b-5c21893a14d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24ddbc5e48b54a26ba5712f7cde7e340'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:23.339169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1462/2880] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:28:23 2022] DELETE /identity/v3/users/24ddbc5e48b54a26ba5712f7cde7e340 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:28:23.343517 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146347c-6e8b-4332-ae7f-50ae06e752cb None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:23.344078 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146347c-6e8b-4332-ae7f-50ae06e752cb None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:23.344369 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146347c-6e8b-4332-ae7f-50ae06e752cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:23.363517 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c146347c-6e8b-4332-ae7f-50ae06e752cb None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:23.364790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c146347c-6e8b-4332-ae7f-50ae06e752cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:23.436616 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1419/2881] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:28:23.446941 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dc731-f027-4dd6-af4b-5c21893a14d1 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:23.448624 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-235dc731-f027-4dd6-af4b-5c21893a14d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:23.508688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dc731-f027-4dd6-af4b-5c21893a14d1 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:23.512495 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b7e5a-93be-4477-9470-c0f36ac31019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:23.513148 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b7e5a-93be-4477-9470-c0f36ac31019 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:23.513442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b7e5a-93be-4477-9470-c0f36ac31019 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:23.513721 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b7e5a-93be-4477-9470-c0f36ac31019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:23.523514 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b7e5a-93be-4477-9470-c0f36ac31019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:23.524985 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b7e5a-93be-4477-9470-c0f36ac31019 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:23.535170 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1463/2882] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:28:24.142653 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146347c-6e8b-4332-ae7f-50ae06e752cb None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:24.144888 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c146347c-6e8b-4332-ae7f-50ae06e752cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:24.161049 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146347c-6e8b-4332-ae7f-50ae06e752cb None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:24.166103 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137151f8-d797-4147-bfab-861facf3d5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:24.167396 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137151f8-d797-4147-bfab-861facf3d5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:24.167679 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137151f8-d797-4147-bfab-861facf3d5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:24.168155 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137151f8-d797-4147-bfab-861facf3d5bf admin admin] PATH_INFO: `/v3/projects/3135a9d0f1854a15875b9b8d9ff76923` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:24.169615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137151f8-d797-4147-bfab-861facf3d5bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3135a9d0f1854a15875b9b8d9ff76923)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:24.171736 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137151f8-d797-4147-bfab-861facf3d5bf admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:24.293814 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-137151f8-d797-4147-bfab-861facf3d5bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3135a9d0f1854a15875b9b8d9ff76923', 'request_id': 'req-137151f8-d797-4147-bfab-861facf3d5bf'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:24.356672 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-137151f8-d797-4147-bfab-861facf3d5bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3135a9d0f1854a15875b9b8d9ff76923', 'request_id': 'req-137151f8-d797-4147-bfab-861facf3d5bf'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:24.364646 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-137151f8-d797-4147-bfab-861facf3d5bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3135a9d0f1854a15875b9b8d9ff76923', 'request_id': 'req-137151f8-d797-4147-bfab-861facf3d5bf'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:24.379860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-137151f8-d797-4147-bfab-861facf3d5bf admin admin] The token cache is being invalidate because project 3135a9d0f1854a15875b9b8d9ff76923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:28:24.379860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-137151f8-d797-4147-bfab-861facf3d5bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:24.379860 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-137151f8-d797-4147-bfab-861facf3d5bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:24.380846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1420/2883] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:28:24 2022] DELETE /identity/v3/projects/3135a9d0f1854a15875b9b8d9ff76923 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:28:24.384890 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b7e5a-93be-4477-9470-c0f36ac31019 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:24.394709 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b7e5a-93be-4477-9470-c0f36ac31019 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:24.456750 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b224c-0339-4b57-a6e4-177bcab2f9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:24.457634 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b224c-0339-4b57-a6e4-177bcab2f9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:24.457916 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b224c-0339-4b57-a6e4-177bcab2f9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:24.458196 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b224c-0339-4b57-a6e4-177bcab2f9ff admin admin] PATH_INFO: `/v3/users/bfc2fc4f9bb8434c971d666796d87f8e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:24.459407 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b224c-0339-4b57-a6e4-177bcab2f9ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfc2fc4f9bb8434c971d666796d87f8e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:24.461391 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b224c-0339-4b57-a6e4-177bcab2f9ff admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:24.632530 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-866b224c-0339-4b57-a6e4-177bcab2f9ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfc2fc4f9bb8434c971d666796d87f8e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:24.633100 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-866b224c-0339-4b57-a6e4-177bcab2f9ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfc2fc4f9bb8434c971d666796d87f8e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:24.633694 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-866b224c-0339-4b57-a6e4-177bcab2f9ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfc2fc4f9bb8434c971d666796d87f8e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:24.645157 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-866b224c-0339-4b57-a6e4-177bcab2f9ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfc2fc4f9bb8434c971d666796d87f8e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:24.651922 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-866b224c-0339-4b57-a6e4-177bcab2f9ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfc2fc4f9bb8434c971d666796d87f8e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:24.739974 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1464/2884] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:28:24 2022] DELETE /identity/v3/users/bfc2fc4f9bb8434c971d666796d87f8e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:28:25.209291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137151f8-d797-4147-bfab-861facf3d5bf admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:25.210727 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-137151f8-d797-4147-bfab-861facf3d5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:25.224644 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137151f8-d797-4147-bfab-861facf3d5bf admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:25.280578 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34802d3-bebb-4997-8c59-4f083135e3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:25.281474 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34802d3-bebb-4997-8c59-4f083135e3bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:25.281754 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34802d3-bebb-4997-8c59-4f083135e3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:25.282157 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34802d3-bebb-4997-8c59-4f083135e3bf admin admin] PATH_INFO: `/v3/projects/16d8d4bbec5442f78dc5776d5bf7be1f` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:25.283333 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34802d3-bebb-4997-8c59-4f083135e3bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d8d4bbec5442f78dc5776d5bf7be1f)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:25.285932 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34802d3-bebb-4997-8c59-4f083135e3bf admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:25.372527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a34802d3-bebb-4997-8c59-4f083135e3bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d8d4bbec5442f78dc5776d5bf7be1f', 'request_id': 'req-a34802d3-bebb-4997-8c59-4f083135e3bf'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:25.413519 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a34802d3-bebb-4997-8c59-4f083135e3bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d8d4bbec5442f78dc5776d5bf7be1f', 'request_id': 'req-a34802d3-bebb-4997-8c59-4f083135e3bf'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:25.419765 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a34802d3-bebb-4997-8c59-4f083135e3bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d8d4bbec5442f78dc5776d5bf7be1f', 'request_id': 'req-a34802d3-bebb-4997-8c59-4f083135e3bf'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:25.439288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a34802d3-bebb-4997-8c59-4f083135e3bf admin admin] The token cache is being invalidate because project 16d8d4bbec5442f78dc5776d5bf7be1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:28:25.439288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a34802d3-bebb-4997-8c59-4f083135e3bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:25.439288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a34802d3-bebb-4997-8c59-4f083135e3bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:25.439288 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1421/2885] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:28:25 2022] DELETE /identity/v3/projects/16d8d4bbec5442f78dc5776d5bf7be1f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:28:25.440132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1f0b5-0b2d-48ee-988c-534b46f124a8 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:25.440132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1f0b5-0b2d-48ee-988c-534b46f124a8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:25.440132 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1f0b5-0b2d-48ee-988c-534b46f124a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:25.458657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-cac1f0b5-0b2d-48ee-988c-534b46f124a8 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:25.460156 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-cac1f0b5-0b2d-48ee-988c-534b46f124a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:25.517857 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1465/2886] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:28:25.526853 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5c8f6-d0f7-431f-be00-83ba6bc3846a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:25.527144 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5c8f6-d0f7-431f-be00-83ba6bc3846a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:25.527420 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5c8f6-d0f7-431f-be00-83ba6bc3846a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:25.545835 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f9c5c8f6-d0f7-431f-be00-83ba6bc3846a None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:25.547023 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f9c5c8f6-d0f7-431f-be00-83ba6bc3846a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:25.555890 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1422/2887] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:28:25.560145 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1f0b5-0b2d-48ee-988c-534b46f124a8 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:25.570549 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1f0b5-0b2d-48ee-988c-534b46f124a8 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:25.575251 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652544db-ddab-4e9e-a18e-0330f2cce985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:25.575953 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652544db-ddab-4e9e-a18e-0330f2cce985 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:25.576237 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652544db-ddab-4e9e-a18e-0330f2cce985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:25.576515 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652544db-ddab-4e9e-a18e-0330f2cce985 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:25.577249 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652544db-ddab-4e9e-a18e-0330f2cce985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:28:25.577561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652544db-ddab-4e9e-a18e-0330f2cce985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:25.579146 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652544db-ddab-4e9e-a18e-0330f2cce985 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:25.590579 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1466/2888] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:28:25.599195 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5c8f6-d0f7-431f-be00-83ba6bc3846a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:25.604703 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5c8f6-d0f7-431f-be00-83ba6bc3846a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:25.609344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dce93-9e26-4171-8cfa-808c39de645d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:25.609993 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dce93-9e26-4171-8cfa-808c39de645d admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:25.610274 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dce93-9e26-4171-8cfa-808c39de645d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:25.610547 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dce93-9e26-4171-8cfa-808c39de645d admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:25.611230 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dce93-9e26-4171-8cfa-808c39de645d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:25.613878 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dce93-9e26-4171-8cfa-808c39de645d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:25.695338 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1423/2889] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:28:25 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:28:25.699369 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652544db-ddab-4e9e-a18e-0330f2cce985 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:25.710117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652544db-ddab-4e9e-a18e-0330f2cce985 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:25.767222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3b723-9376-490d-a63c-3bbfbab5759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:25.767917 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3b723-9376-490d-a63c-3bbfbab5759e admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:25.768200 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3b723-9376-490d-a63c-3bbfbab5759e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:25.768983 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3b723-9376-490d-a63c-3bbfbab5759e admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:25.769688 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3b723-9376-490d-a63c-3bbfbab5759e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:25.771672 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3b723-9376-490d-a63c-3bbfbab5759e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:25.858611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1467/2890] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:28:25 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:28:25.862629 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dce93-9e26-4171-8cfa-808c39de645d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:25.872651 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dce93-9e26-4171-8cfa-808c39de645d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:25.877330 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f405b-75ef-4154-bc87-71f0a503e185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:25.877976 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f405b-75ef-4154-bc87-71f0a503e185 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:25.878255 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f405b-75ef-4154-bc87-71f0a503e185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:25.878527 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f405b-75ef-4154-bc87-71f0a503e185 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:25.879251 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f405b-75ef-4154-bc87-71f0a503e185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:25.880942 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f405b-75ef-4154-bc87-71f0a503e185 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:25.890936 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1424/2891] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:28:25.899502 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3b723-9376-490d-a63c-3bbfbab5759e admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:25.910117 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3b723-9376-490d-a63c-3bbfbab5759e admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:25.914741 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4b993-cdcb-4ed6-bc9d-bed735e86487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:25.915442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4b993-cdcb-4ed6-bc9d-bed735e86487 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:25.915760 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4b993-cdcb-4ed6-bc9d-bed735e86487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:25.916040 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4b993-cdcb-4ed6-bc9d-bed735e86487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:25.916769 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4b993-cdcb-4ed6-bc9d-bed735e86487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:25.918332 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4b993-cdcb-4ed6-bc9d-bed735e86487 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:25.928269 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1468/2892] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:28:25.932251 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f405b-75ef-4154-bc87-71f0a503e185 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:25.941916 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f405b-75ef-4154-bc87-71f0a503e185 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:25.946530 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eba632-541b-45a3-8625-e4e219da25eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:25.947310 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eba632-541b-45a3-8625-e4e219da25eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:25.947583 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eba632-541b-45a3-8625-e4e219da25eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:25.947885 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eba632-541b-45a3-8625-e4e219da25eb admin admin] PATH_INFO: `/v3/projects/dbf96dc2d52140f6bde5f8e7f4e19e9b/users/ddca1533f5424fa3b1f90a1b901a2806/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:25.962352 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eba632-541b-45a3-8625-e4e219da25eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbf96dc2d52140f6bde5f8e7f4e19e9b, user_id=ddca1533f5424fa3b1f90a1b901a2806, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:25.965087 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eba632-541b-45a3-8625-e4e219da25eb admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:26.031305 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1425/2893] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:28:25 2022] PUT /identity/v3/projects/dbf96dc2d52140f6bde5f8e7f4e19e9b/users/ddca1533f5424fa3b1f90a1b901a2806/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:28:26.092608 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4e6db-0254-47e0-9db8-5c92862612cc None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:26.092912 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4e6db-0254-47e0-9db8-5c92862612cc None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:26.093222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4e6db-0254-47e0-9db8-5c92862612cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:26.118881 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d9f4e6db-0254-47e0-9db8-5c92862612cc None None] MFA Rules not processed for user `ddca1533f5424fa3b1f90a1b901a2806`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:26.120105 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d9f4e6db-0254-47e0-9db8-5c92862612cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:26.181444 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1469/2894] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:28:26.192802 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eba632-541b-45a3-8625-e4e219da25eb admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:26.194538 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e7eba632-541b-45a3-8625-e4e219da25eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:26.250107 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eba632-541b-45a3-8625-e4e219da25eb admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:26.254276 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26b24f-7d71-44be-9c87-bcd9a163208f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:26.254919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26b24f-7d71-44be-9c87-bcd9a163208f service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:26.255199 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26b24f-7d71-44be-9c87-bcd9a163208f service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:26.255471 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26b24f-7d71-44be-9c87-bcd9a163208f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:26.263994 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26b24f-7d71-44be-9c87-bcd9a163208f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:26.265414 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26b24f-7d71-44be-9c87-bcd9a163208f service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:26.274764 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1426/2895] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:28:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:28:27.491239 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4e6db-0254-47e0-9db8-5c92862612cc None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:27.492643 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d9f4e6db-0254-47e0-9db8-5c92862612cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:27.556970 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4e6db-0254-47e0-9db8-5c92862612cc None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:27.563601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ebc04-c7ed-426d-9188-b0c6f63fb692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:27.563601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ebc04-c7ed-426d-9188-b0c6f63fb692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:27.563601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ebc04-c7ed-426d-9188-b0c6f63fb692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:27.563601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ebc04-c7ed-426d-9188-b0c6f63fb692 admin admin] PATH_INFO: `/v3/users/fa0fe3302b164d92b19d89ab201b0a06` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:27.564226 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ebc04-c7ed-426d-9188-b0c6f63fb692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa0fe3302b164d92b19d89ab201b0a06)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:27.566553 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ebc04-c7ed-426d-9188-b0c6f63fb692 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:27.718457 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d53ebc04-c7ed-426d-9188-b0c6f63fb692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa0fe3302b164d92b19d89ab201b0a06'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:27.719130 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d53ebc04-c7ed-426d-9188-b0c6f63fb692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa0fe3302b164d92b19d89ab201b0a06'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:27.719781 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d53ebc04-c7ed-426d-9188-b0c6f63fb692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa0fe3302b164d92b19d89ab201b0a06'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:27.731670 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d53ebc04-c7ed-426d-9188-b0c6f63fb692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa0fe3302b164d92b19d89ab201b0a06'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:27.738369 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d53ebc04-c7ed-426d-9188-b0c6f63fb692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa0fe3302b164d92b19d89ab201b0a06'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:27.795991 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1470/2896] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:28:27 2022] DELETE /identity/v3/users/fa0fe3302b164d92b19d89ab201b0a06 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:28:27.800469 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1325a-25ce-4fb2-9d99-2a09729874a5 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:27.800943 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1325a-25ce-4fb2-9d99-2a09729874a5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:27.801332 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1325a-25ce-4fb2-9d99-2a09729874a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:27.818037 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-41a1325a-25ce-4fb2-9d99-2a09729874a5 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:27.819218 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-41a1325a-25ce-4fb2-9d99-2a09729874a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:27.873899 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1427/2897] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:28:27.884313 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ebc04-c7ed-426d-9188-b0c6f63fb692 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:27.885735 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d53ebc04-c7ed-426d-9188-b0c6f63fb692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:27.940897 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ebc04-c7ed-426d-9188-b0c6f63fb692 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:27.944513 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90976cc7-ff57-4940-a618-e39e4f6837da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:27.945163 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90976cc7-ff57-4940-a618-e39e4f6837da service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:27.945441 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90976cc7-ff57-4940-a618-e39e4f6837da service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:27.945714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90976cc7-ff57-4940-a618-e39e4f6837da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:27.954852 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90976cc7-ff57-4940-a618-e39e4f6837da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:27.956876 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90976cc7-ff57-4940-a618-e39e4f6837da service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:27.966707 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1471/2898] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:28:28.357999 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1325a-25ce-4fb2-9d99-2a09729874a5 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:28.359796 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-41a1325a-25ce-4fb2-9d99-2a09729874a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:28.371765 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1325a-25ce-4fb2-9d99-2a09729874a5 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:28.376719 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e820170-e216-40d6-937a-9eaaa078bef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:28.377603 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e820170-e216-40d6-937a-9eaaa078bef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:28.377913 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e820170-e216-40d6-937a-9eaaa078bef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:28.378183 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e820170-e216-40d6-937a-9eaaa078bef4 admin admin] PATH_INFO: `/v3/projects/83f19978597e4c16ad7ebaf22b632a41` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:28.379542 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e820170-e216-40d6-937a-9eaaa078bef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83f19978597e4c16ad7ebaf22b632a41)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:28.381524 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e820170-e216-40d6-937a-9eaaa078bef4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:28.489734 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1e820170-e216-40d6-937a-9eaaa078bef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83f19978597e4c16ad7ebaf22b632a41', 'request_id': 'req-1e820170-e216-40d6-937a-9eaaa078bef4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:28.562396 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1e820170-e216-40d6-937a-9eaaa078bef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83f19978597e4c16ad7ebaf22b632a41', 'request_id': 'req-1e820170-e216-40d6-937a-9eaaa078bef4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:28.568369 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1e820170-e216-40d6-937a-9eaaa078bef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83f19978597e4c16ad7ebaf22b632a41', 'request_id': 'req-1e820170-e216-40d6-937a-9eaaa078bef4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:28.579864 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1e820170-e216-40d6-937a-9eaaa078bef4 admin admin] The token cache is being invalidate because project 83f19978597e4c16ad7ebaf22b632a41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:28:28.580158 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1e820170-e216-40d6-937a-9eaaa078bef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:28.580830 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1e820170-e216-40d6-937a-9eaaa078bef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:28.582378 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1428/2899] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:28:28 2022] DELETE /identity/v3/projects/83f19978597e4c16ad7ebaf22b632a41 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:28:28.587385 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb45686-b98c-4a64-8cf6-c3a8e956d2d6 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:28.587930 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb45686-b98c-4a64-8cf6-c3a8e956d2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:28.588396 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb45686-b98c-4a64-8cf6-c3a8e956d2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:28.606254 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-ceb45686-b98c-4a64-8cf6-c3a8e956d2d6 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:28.607447 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ceb45686-b98c-4a64-8cf6-c3a8e956d2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:28.663872 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1472/2900] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:28:28.671945 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bec9e-8eb7-4f29-ad39-1100ec283744 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:28.672231 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bec9e-8eb7-4f29-ad39-1100ec283744 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:28.672508 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bec9e-8eb7-4f29-ad39-1100ec283744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:28.690846 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-aa7bec9e-8eb7-4f29-ad39-1100ec283744 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:28.692071 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-aa7bec9e-8eb7-4f29-ad39-1100ec283744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:28.699790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1429/2901] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:28:28.703827 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb45686-b98c-4a64-8cf6-c3a8e956d2d6 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:28.713803 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb45686-b98c-4a64-8cf6-c3a8e956d2d6 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:28.718451 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc7f2a-fdca-4d2c-9dd9-072c3f128028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:28.719888 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc7f2a-fdca-4d2c-9dd9-072c3f128028 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:28.719888 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc7f2a-fdca-4d2c-9dd9-072c3f128028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:28.719888 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc7f2a-fdca-4d2c-9dd9-072c3f128028 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:28.720455 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc7f2a-fdca-4d2c-9dd9-072c3f128028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 07:28:28.720764 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc7f2a-fdca-4d2c-9dd9-072c3f128028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:28.722958 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc7f2a-fdca-4d2c-9dd9-072c3f128028 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:28.734059 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1473/2902] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 12 07:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 07:28:28.738053 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bec9e-8eb7-4f29-ad39-1100ec283744 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:28.747029 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bec9e-8eb7-4f29-ad39-1100ec283744 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:28.751550 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce21520-3744-44f9-8d0d-270dd79a0291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:28.752224 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce21520-3744-44f9-8d0d-270dd79a0291 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:28.752505 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce21520-3744-44f9-8d0d-270dd79a0291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:28.752776 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce21520-3744-44f9-8d0d-270dd79a0291 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:28.753456 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce21520-3744-44f9-8d0d-270dd79a0291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:28.755322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce21520-3744-44f9-8d0d-270dd79a0291 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:28.838209 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1430/2903] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 12 07:28:28 2022] POST /identity/v3/projects => generated 395 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:28:28.842299 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc7f2a-fdca-4d2c-9dd9-072c3f128028 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:28.853064 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc7f2a-fdca-4d2c-9dd9-072c3f128028 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:28.906505 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452486b1-f263-43d0-ba85-c0090f17be97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:28.907177 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452486b1-f263-43d0-ba85-c0090f17be97 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:28.907459 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452486b1-f263-43d0-ba85-c0090f17be97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:28.907767 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452486b1-f263-43d0-ba85-c0090f17be97 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:28.908464 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452486b1-f263-43d0-ba85-c0090f17be97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:28.910987 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452486b1-f263-43d0-ba85-c0090f17be97 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:29.014326 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1474/2904] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 12 07:28:28 2022] POST /identity/v3/users => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 07:28:29.018269 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce21520-3744-44f9-8d0d-270dd79a0291 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:29.028832 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce21520-3744-44f9-8d0d-270dd79a0291 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:29.033366 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10878f9-a98d-4598-b648-4e51c81161ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:29.034687 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10878f9-a98d-4598-b648-4e51c81161ed admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:29.034973 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10878f9-a98d-4598-b648-4e51c81161ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:29.035242 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10878f9-a98d-4598-b648-4e51c81161ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:29.035994 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10878f9-a98d-4598-b648-4e51c81161ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:29.037566 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10878f9-a98d-4598-b648-4e51c81161ed admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:29.047760 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1431/2905] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:28:29.051669 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452486b1-f263-43d0-ba85-c0090f17be97 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:29.061714 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452486b1-f263-43d0-ba85-c0090f17be97 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:29.066895 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b53c85-4cbe-4460-95e4-a0c690a4b14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:29.067544 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b53c85-4cbe-4460-95e4-a0c690a4b14c admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:29.067873 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b53c85-4cbe-4460-95e4-a0c690a4b14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:29.068150 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b53c85-4cbe-4460-95e4-a0c690a4b14c admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:29.068875 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b53c85-4cbe-4460-95e4-a0c690a4b14c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:29.070498 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b53c85-4cbe-4460-95e4-a0c690a4b14c admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:29.080125 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1475/2906] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 12 07:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 07:28:29.084607 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10878f9-a98d-4598-b648-4e51c81161ed admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:29.094756 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10878f9-a98d-4598-b648-4e51c81161ed admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:29.099270 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b7afc-03f5-4460-a14b-dd080506e766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:29.100176 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b7afc-03f5-4460-a14b-dd080506e766 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:29.100457 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b7afc-03f5-4460-a14b-dd080506e766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:29.100728 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b7afc-03f5-4460-a14b-dd080506e766 admin admin] PATH_INFO: `/v3/projects/36a2e63d9ab948f29269eb5e949de495/users/4d25fa6527ad47cf9cf4736fb060297c/roles/2162d563a5344c26821a7961cb75468b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:29.114678 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b7afc-03f5-4460-a14b-dd080506e766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a2e63d9ab948f29269eb5e949de495, user_id=4d25fa6527ad47cf9cf4736fb060297c, role_id=2162d563a5344c26821a7961cb75468b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:29.117364 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b7afc-03f5-4460-a14b-dd080506e766 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:29.190928 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1432/2907] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 12 07:28:29 2022] PUT /identity/v3/projects/36a2e63d9ab948f29269eb5e949de495/users/4d25fa6527ad47cf9cf4736fb060297c/roles/2162d563a5344c26821a7961cb75468b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 07:28:29.202169 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f9d0c-1ac1-4129-8580-3cbafbcda271 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:29.202460 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f9d0c-1ac1-4129-8580-3cbafbcda271 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:29.202740 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f9d0c-1ac1-4129-8580-3cbafbcda271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:29.229388 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-fe2f9d0c-1ac1-4129-8580-3cbafbcda271 None None] MFA Rules not processed for user `4d25fa6527ad47cf9cf4736fb060297c`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:29.231430 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fe2f9d0c-1ac1-4129-8580-3cbafbcda271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:29.296139 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1476/2908] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:28:29.308022 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b7afc-03f5-4460-a14b-dd080506e766 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:29.313663 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4c9b7afc-03f5-4460-a14b-dd080506e766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:29.370966 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b7afc-03f5-4460-a14b-dd080506e766 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:29.374575 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc296a67-0f82-4900-ae98-2dc8e85d0f4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:29.375225 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc296a67-0f82-4900-ae98-2dc8e85d0f4f service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:29.375505 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc296a67-0f82-4900-ae98-2dc8e85d0f4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:29.375814 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc296a67-0f82-4900-ae98-2dc8e85d0f4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:29.385720 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc296a67-0f82-4900-ae98-2dc8e85d0f4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:29.387150 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc296a67-0f82-4900-ae98-2dc8e85d0f4f service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:29.396893 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1433/2909] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:28:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:28:41.249284 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f9d0c-1ac1-4129-8580-3cbafbcda271 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:41.309455 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f9d0c-1ac1-4129-8580-3cbafbcda271 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:41.314095 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf957874-e78a-442c-ad43-d2907b0c0965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:41.314957 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf957874-e78a-442c-ad43-d2907b0c0965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:41.315240 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf957874-e78a-442c-ad43-d2907b0c0965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:41.315602 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf957874-e78a-442c-ad43-d2907b0c0965 admin admin] PATH_INFO: `/v3/users/4d25fa6527ad47cf9cf4736fb060297c` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:41.316768 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf957874-e78a-442c-ad43-d2907b0c0965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d25fa6527ad47cf9cf4736fb060297c)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:41.318809 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf957874-e78a-442c-ad43-d2907b0c0965 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:41.484960 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-bf957874-e78a-442c-ad43-d2907b0c0965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d25fa6527ad47cf9cf4736fb060297c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:41.485553 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-bf957874-e78a-442c-ad43-d2907b0c0965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d25fa6527ad47cf9cf4736fb060297c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:41.486189 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-bf957874-e78a-442c-ad43-d2907b0c0965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d25fa6527ad47cf9cf4736fb060297c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:41.498387 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-bf957874-e78a-442c-ad43-d2907b0c0965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d25fa6527ad47cf9cf4736fb060297c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:41.505013 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-bf957874-e78a-442c-ad43-d2907b0c0965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d25fa6527ad47cf9cf4736fb060297c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:41.568001 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1477/2910] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:28:41 2022] DELETE /identity/v3/users/4d25fa6527ad47cf9cf4736fb060297c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:28:41.573251 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3297b-88cf-4967-aa25-abe132ad787c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:41.573656 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3297b-88cf-4967-aa25-abe132ad787c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:41.573874 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3297b-88cf-4967-aa25-abe132ad787c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:41.590667 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-aab3297b-88cf-4967-aa25-abe132ad787c None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:41.591921 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-aab3297b-88cf-4967-aa25-abe132ad787c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:41.648989 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1434/2911] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:28:41.658393 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf957874-e78a-442c-ad43-d2907b0c0965 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:41.659861 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-bf957874-e78a-442c-ad43-d2907b0c0965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:41.717060 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf957874-e78a-442c-ad43-d2907b0c0965 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:41.720700 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59313a86-9b4e-45c5-a9c6-420dea43343f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:41.721322 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59313a86-9b4e-45c5-a9c6-420dea43343f service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:41.721601 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59313a86-9b4e-45c5-a9c6-420dea43343f service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:41.721885 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59313a86-9b4e-45c5-a9c6-420dea43343f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:41.731147 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59313a86-9b4e-45c5-a9c6-420dea43343f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:41.732579 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59313a86-9b4e-45c5-a9c6-420dea43343f service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:41.742167 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1478/2912] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:28:42.108047 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3297b-88cf-4967-aa25-abe132ad787c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:42.109578 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-aab3297b-88cf-4967-aa25-abe132ad787c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:42.124221 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3297b-88cf-4967-aa25-abe132ad787c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:42.129386 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0699a-3d09-423b-9543-0ef8d1ade673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:42.130319 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0699a-3d09-423b-9543-0ef8d1ade673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:42.130526 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0699a-3d09-423b-9543-0ef8d1ade673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:42.130790 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0699a-3d09-423b-9543-0ef8d1ade673 admin admin] PATH_INFO: `/v3/projects/36a2e63d9ab948f29269eb5e949de495` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:42.132248 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0699a-3d09-423b-9543-0ef8d1ade673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36a2e63d9ab948f29269eb5e949de495)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:42.134250 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0699a-3d09-423b-9543-0ef8d1ade673 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:42.232389 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7fb0699a-3d09-423b-9543-0ef8d1ade673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36a2e63d9ab948f29269eb5e949de495', 'request_id': 'req-7fb0699a-3d09-423b-9543-0ef8d1ade673'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:42.340425 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7fb0699a-3d09-423b-9543-0ef8d1ade673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36a2e63d9ab948f29269eb5e949de495', 'request_id': 'req-7fb0699a-3d09-423b-9543-0ef8d1ade673'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:42.346176 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7fb0699a-3d09-423b-9543-0ef8d1ade673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36a2e63d9ab948f29269eb5e949de495', 'request_id': 'req-7fb0699a-3d09-423b-9543-0ef8d1ade673'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:42.357492 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7fb0699a-3d09-423b-9543-0ef8d1ade673 admin admin] The token cache is being invalidate because project 36a2e63d9ab948f29269eb5e949de495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:28:42.357781 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7fb0699a-3d09-423b-9543-0ef8d1ade673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:42.358411 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7fb0699a-3d09-423b-9543-0ef8d1ade673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:42.360031 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1435/2913] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:28:42 2022] DELETE /identity/v3/projects/36a2e63d9ab948f29269eb5e949de495 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:28:49.832681 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59313a86-9b4e-45c5-a9c6-420dea43343f service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:49.834100 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-59313a86-9b4e-45c5-a9c6-420dea43343f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:49.846791 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59313a86-9b4e-45c5-a9c6-420dea43343f service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:49.899298 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9177e8d-b60e-40f7-80a3-bb8d7e6e1104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:49.900187 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9177e8d-b60e-40f7-80a3-bb8d7e6e1104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:49.900464 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9177e8d-b60e-40f7-80a3-bb8d7e6e1104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:49.900733 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9177e8d-b60e-40f7-80a3-bb8d7e6e1104 admin admin] PATH_INFO: `/v3/users/ddca1533f5424fa3b1f90a1b901a2806` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:49.901905 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9177e8d-b60e-40f7-80a3-bb8d7e6e1104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddca1533f5424fa3b1f90a1b901a2806)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:49.903964 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9177e8d-b60e-40f7-80a3-bb8d7e6e1104 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:50.067160 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d9177e8d-b60e-40f7-80a3-bb8d7e6e1104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddca1533f5424fa3b1f90a1b901a2806'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:50.067855 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d9177e8d-b60e-40f7-80a3-bb8d7e6e1104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddca1533f5424fa3b1f90a1b901a2806'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:50.068465 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d9177e8d-b60e-40f7-80a3-bb8d7e6e1104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddca1533f5424fa3b1f90a1b901a2806'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:50.080233 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d9177e8d-b60e-40f7-80a3-bb8d7e6e1104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddca1533f5424fa3b1f90a1b901a2806'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:50.087491 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d9177e8d-b60e-40f7-80a3-bb8d7e6e1104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddca1533f5424fa3b1f90a1b901a2806'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:50.145495 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1479/2914] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:28:49 2022] DELETE /identity/v3/users/ddca1533f5424fa3b1f90a1b901a2806 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:28:50.150560 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e291e-fb23-4db2-9a49-269673e44492 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:50.151056 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e291e-fb23-4db2-9a49-269673e44492 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:50.151322 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e291e-fb23-4db2-9a49-269673e44492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:50.168567 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d88e291e-fb23-4db2-9a49-269673e44492 None None] MFA Rules not processed for user `79cb9f096a814d81a7a9552741bc1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:28:50.169807 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d88e291e-fb23-4db2-9a49-269673e44492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:50.226941 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1436/2915] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 12 07:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 07:28:50.236435 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9177e8d-b60e-40f7-80a3-bb8d7e6e1104 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:50.237814 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d9177e8d-b60e-40f7-80a3-bb8d7e6e1104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:50.293620 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9177e8d-b60e-40f7-80a3-bb8d7e6e1104 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:50.297408 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d2034-d4a3-496b-ac11-91639e40f6e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:50.298066 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d2034-d4a3-496b-ac11-91639e40f6e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:50.298338 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d2034-d4a3-496b-ac11-91639e40f6e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:50.298595 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d2034-d4a3-496b-ac11-91639e40f6e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:50.309249 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d2034-d4a3-496b-ac11-91639e40f6e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:50.311576 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d2034-d4a3-496b-ac11-91639e40f6e8 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:50.321251 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1480/2916] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:28:50.707314 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e291e-fb23-4db2-9a49-269673e44492 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:28:50.708785 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d88e291e-fb23-4db2-9a49-269673e44492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:28:50.723153 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e291e-fb23-4db2-9a49-269673e44492 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:28:50.729154 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792fe3c-b7aa-4557-bf01-792b27df3e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:28:50.730168 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792fe3c-b7aa-4557-bf01-792b27df3e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:28:50.730394 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792fe3c-b7aa-4557-bf01-792b27df3e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:28:50.730621 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792fe3c-b7aa-4557-bf01-792b27df3e92 admin admin] PATH_INFO: `/v3/projects/dbf96dc2d52140f6bde5f8e7f4e19e9b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:28:50.732385 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792fe3c-b7aa-4557-bf01-792b27df3e92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbf96dc2d52140f6bde5f8e7f4e19e9b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:28:50.734235 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792fe3c-b7aa-4557-bf01-792b27df3e92 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:28:50.830940 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7792fe3c-b7aa-4557-bf01-792b27df3e92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbf96dc2d52140f6bde5f8e7f4e19e9b', 'request_id': 'req-7792fe3c-b7aa-4557-bf01-792b27df3e92'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:50.905911 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7792fe3c-b7aa-4557-bf01-792b27df3e92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbf96dc2d52140f6bde5f8e7f4e19e9b', 'request_id': 'req-7792fe3c-b7aa-4557-bf01-792b27df3e92'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:50.911304 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7792fe3c-b7aa-4557-bf01-792b27df3e92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbf96dc2d52140f6bde5f8e7f4e19e9b', 'request_id': 'req-7792fe3c-b7aa-4557-bf01-792b27df3e92'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:50.922808 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7792fe3c-b7aa-4557-bf01-792b27df3e92 admin admin] The token cache is being invalidate because project dbf96dc2d52140f6bde5f8e7f4e19e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:28:50.923091 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7792fe3c-b7aa-4557-bf01-792b27df3e92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:50.923731 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7792fe3c-b7aa-4557-bf01-792b27df3e92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:28:50.925267 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1437/2917] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:28:50 2022] DELETE /identity/v3/projects/dbf96dc2d52140f6bde5f8e7f4e19e9b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:29:32.756722 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07108b12-0f2b-4620-9d1b-39a06b93c69e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:29:32.757202 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07108b12-0f2b-4620-9d1b-39a06b93c69e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:29:32.757362 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07108b12-0f2b-4620-9d1b-39a06b93c69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:29:32.775271 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-07108b12-0f2b-4620-9d1b-39a06b93c69e None None] MFA Rules not processed for user `7a25a3f2c9a148a1ae73e519070b190b`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 07:29:32.776471 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-07108b12-0f2b-4620-9d1b-39a06b93c69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:29:32.829054 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1481/2918] 10.222.0.25 () {58 vars in 967 bytes} [Thu May 12 07:29:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 07:29:32.868215 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792fe3c-b7aa-4557-bf01-792b27df3e92 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:29:32.869650 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7792fe3c-b7aa-4557-bf01-792b27df3e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:29:32.935883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792fe3c-b7aa-4557-bf01-792b27df3e92 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:29:32.940872 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb84f5a-f589-428a-8107-e2a07a2756c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9882820f88349cb8fa2e3d457b19959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:29:32.941513 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb84f5a-f589-428a-8107-e2a07a2756c0 service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:29:32.941793 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb84f5a-f589-428a-8107-e2a07a2756c0 service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:29:32.942065 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb84f5a-f589-428a-8107-e2a07a2756c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:29:32.951248 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb84f5a-f589-428a-8107-e2a07a2756c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:29:32.952856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb84f5a-f589-428a-8107-e2a07a2756c0 service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:29:32.961578 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1438/2919] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 12 07:29:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 07:29:40.895498 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07108b12-0f2b-4620-9d1b-39a06b93c69e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:29:40.897047 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-07108b12-0f2b-4620-9d1b-39a06b93c69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:29:40.961231 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07108b12-0f2b-4620-9d1b-39a06b93c69e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:29:40.965442 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef5a88-22c2-4e9c-8280-c9824946f5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:29:40.966317 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef5a88-22c2-4e9c-8280-c9824946f5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:29:40.966599 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef5a88-22c2-4e9c-8280-c9824946f5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:29:40.966866 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef5a88-22c2-4e9c-8280-c9824946f5a4 admin admin] PATH_INFO: `/v3/users/d64b5396be8944ce9fafc9034f54d55f` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:29:40.968113 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef5a88-22c2-4e9c-8280-c9824946f5a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d64b5396be8944ce9fafc9034f54d55f)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:29:40.970026 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef5a88-22c2-4e9c-8280-c9824946f5a4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:29:41.091336 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e4ef5a88-22c2-4e9c-8280-c9824946f5a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd64b5396be8944ce9fafc9034f54d55f'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:29:41.092005 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e4ef5a88-22c2-4e9c-8280-c9824946f5a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd64b5396be8944ce9fafc9034f54d55f'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:29:41.092611 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e4ef5a88-22c2-4e9c-8280-c9824946f5a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd64b5396be8944ce9fafc9034f54d55f'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:29:41.104276 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e4ef5a88-22c2-4e9c-8280-c9824946f5a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd64b5396be8944ce9fafc9034f54d55f'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:29:41.110741 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e4ef5a88-22c2-4e9c-8280-c9824946f5a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd64b5396be8944ce9fafc9034f54d55f'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:29:41.152279 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1482/2920] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:29:40 2022] DELETE /identity/v3/users/d64b5396be8944ce9fafc9034f54d55f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:29:41.623773 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb84f5a-f589-428a-8107-e2a07a2756c0 service swift] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:29:41.634864 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb84f5a-f589-428a-8107-e2a07a2756c0 service swift] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:29:41.694317 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994c8cc-46cc-43c0-b3f4-cf0b7b369870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:29:41.695171 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994c8cc-46cc-43c0-b3f4-cf0b7b369870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:29:41.695497 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994c8cc-46cc-43c0-b3f4-cf0b7b369870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:29:41.695808 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994c8cc-46cc-43c0-b3f4-cf0b7b369870 admin admin] PATH_INFO: `/v3/projects/b0d0d48c1db3496da28cdc39061b3d70` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:29:41.697001 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994c8cc-46cc-43c0-b3f4-cf0b7b369870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d0d48c1db3496da28cdc39061b3d70)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:29:41.698863 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994c8cc-46cc-43c0-b3f4-cf0b7b369870 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:29:41.809319 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c994c8cc-46cc-43c0-b3f4-cf0b7b369870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d0d48c1db3496da28cdc39061b3d70', 'request_id': 'req-c994c8cc-46cc-43c0-b3f4-cf0b7b369870'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:29:41.884648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c994c8cc-46cc-43c0-b3f4-cf0b7b369870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d0d48c1db3496da28cdc39061b3d70', 'request_id': 'req-c994c8cc-46cc-43c0-b3f4-cf0b7b369870'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:29:41.890147 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c994c8cc-46cc-43c0-b3f4-cf0b7b369870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d0d48c1db3496da28cdc39061b3d70', 'request_id': 'req-c994c8cc-46cc-43c0-b3f4-cf0b7b369870'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:29:41.901390 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c994c8cc-46cc-43c0-b3f4-cf0b7b369870 admin admin] The token cache is being invalidate because project b0d0d48c1db3496da28cdc39061b3d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:29:41.901674 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c994c8cc-46cc-43c0-b3f4-cf0b7b369870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:29:41.902298 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c994c8cc-46cc-43c0-b3f4-cf0b7b369870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:29:41.904042 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1439/2921] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:29:41 2022] DELETE /identity/v3/projects/b0d0d48c1db3496da28cdc39061b3d70 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:29:41.908072 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef5a88-22c2-4e9c-8280-c9824946f5a4 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:29:41.909524 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e4ef5a88-22c2-4e9c-8280-c9824946f5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:29:41.923838 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef5a88-22c2-4e9c-8280-c9824946f5a4 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:29:41.981379 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec1adb-be0a-487d-8c88-49e5af8e89e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:29:41.982253 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec1adb-be0a-487d-8c88-49e5af8e89e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:29:41.982535 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec1adb-be0a-487d-8c88-49e5af8e89e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:29:41.982808 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec1adb-be0a-487d-8c88-49e5af8e89e3 admin admin] PATH_INFO: `/v3/users/636a4b020cfb491eb59b1a051e5e9404` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:29:41.984084 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec1adb-be0a-487d-8c88-49e5af8e89e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=636a4b020cfb491eb59b1a051e5e9404)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:29:41.986081 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec1adb-be0a-487d-8c88-49e5af8e89e3 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:29:42.131281 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a9ec1adb-be0a-487d-8c88-49e5af8e89e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '636a4b020cfb491eb59b1a051e5e9404'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:29:42.131969 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a9ec1adb-be0a-487d-8c88-49e5af8e89e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '636a4b020cfb491eb59b1a051e5e9404'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:29:42.132600 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a9ec1adb-be0a-487d-8c88-49e5af8e89e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '636a4b020cfb491eb59b1a051e5e9404'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:29:42.144713 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a9ec1adb-be0a-487d-8c88-49e5af8e89e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '636a4b020cfb491eb59b1a051e5e9404'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:29:42.151481 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a9ec1adb-be0a-487d-8c88-49e5af8e89e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '636a4b020cfb491eb59b1a051e5e9404'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:29:42.214860 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1483/2922] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:29:41 2022] DELETE /identity/v3/users/636a4b020cfb491eb59b1a051e5e9404 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:29:42.434823 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994c8cc-46cc-43c0-b3f4-cf0b7b369870 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:29:42.437682 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c994c8cc-46cc-43c0-b3f4-cf0b7b369870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:29:42.450080 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994c8cc-46cc-43c0-b3f4-cf0b7b369870 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:29:42.507283 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dff57-400e-4b7f-81e3-a233b040e958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:29:42.508175 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dff57-400e-4b7f-81e3-a233b040e958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:29:42.508460 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dff57-400e-4b7f-81e3-a233b040e958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:29:42.508736 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dff57-400e-4b7f-81e3-a233b040e958 admin admin] PATH_INFO: `/v3/projects/63ab4123b3ae45ac99e14cc4ce2c9b6b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:29:42.509919 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016dff57-400e-4b7f-81e3-a233b040e958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ab4123b3ae45ac99e14cc4ce2c9b6b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:29:42.511843 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016dff57-400e-4b7f-81e3-a233b040e958 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:29:42.621648 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-016dff57-400e-4b7f-81e3-a233b040e958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ab4123b3ae45ac99e14cc4ce2c9b6b', 'request_id': 'req-016dff57-400e-4b7f-81e3-a233b040e958'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:29:42.684251 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-016dff57-400e-4b7f-81e3-a233b040e958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ab4123b3ae45ac99e14cc4ce2c9b6b', 'request_id': 'req-016dff57-400e-4b7f-81e3-a233b040e958'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:29:42.689636 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-016dff57-400e-4b7f-81e3-a233b040e958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ab4123b3ae45ac99e14cc4ce2c9b6b', 'request_id': 'req-016dff57-400e-4b7f-81e3-a233b040e958'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:29:42.700485 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-016dff57-400e-4b7f-81e3-a233b040e958 admin admin] The token cache is being invalidate because project 63ab4123b3ae45ac99e14cc4ce2c9b6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:29:42.700766 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-016dff57-400e-4b7f-81e3-a233b040e958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:29:42.701395 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-016dff57-400e-4b7f-81e3-a233b040e958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:29:42.702963 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1440/2923] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:29:42 2022] DELETE /identity/v3/projects/63ab4123b3ae45ac99e14cc4ce2c9b6b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:30:11.362916 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec1adb-be0a-487d-8c88-49e5af8e89e3 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:30:11.364382 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a9ec1adb-be0a-487d-8c88-49e5af8e89e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:30:11.431525 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec1adb-be0a-487d-8c88-49e5af8e89e3 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:30:11.476986 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6dc29-9575-4e19-be92-80059a550464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5006e095ba41d994dca0bf581417e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:30:11.477667 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6dc29-9575-4e19-be92-80059a550464 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:30:11.477952 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6dc29-9575-4e19-be92-80059a550464 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:30:11.478222 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6dc29-9575-4e19-be92-80059a550464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:30:11.480033 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3cf6dc29-9575-4e19-be92-80059a550464 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:30:11.547561 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6dc29-9575-4e19-be92-80059a550464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:30:11.549046 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6dc29-9575-4e19-be92-80059a550464 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:30:11.558576 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1484/2924] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:30:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:30:11.610561 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dff57-400e-4b7f-81e3-a233b040e958 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:30:11.611953 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-016dff57-400e-4b7f-81e3-a233b040e958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:30:11.690684 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dff57-400e-4b7f-81e3-a233b040e958 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:30:11.695667 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1240c-2482-4802-b80d-eec66290fad0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d2edf68b1b440097981097699bb307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:30:11.696989 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1240c-2482-4802-b80d-eec66290fad0 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:30:11.697295 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1240c-2482-4802-b80d-eec66290fad0 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:30:11.697570 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1240c-2482-4802-b80d-eec66290fad0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:30:11.699351 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b4b1240c-2482-4802-b80d-eec66290fad0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:30:11.710543 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1240c-2482-4802-b80d-eec66290fad0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:30:11.712187 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1240c-2482-4802-b80d-eec66290fad0 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:30:11.721965 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1441/2925] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:30:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:32:28.428643 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6dc29-9575-4e19-be92-80059a550464 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:32:28.430119 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3cf6dc29-9575-4e19-be92-80059a550464 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:32:28.487009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6dc29-9575-4e19-be92-80059a550464 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:32:28.490582 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd5ac0-ab4d-4b10-892a-2de594a30085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9cbec1af6545fcb34425dce87d0ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:32:28.491223 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd5ac0-ab4d-4b10-892a-2de594a30085 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:32:28.491502 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd5ac0-ab4d-4b10-892a-2de594a30085 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:32:28.491816 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd5ac0-ab4d-4b10-892a-2de594a30085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:32:28.493549 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f8fd5ac0-ab4d-4b10-892a-2de594a30085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:32:28.553595 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd5ac0-ab4d-4b10-892a-2de594a30085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:32:28.554940 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd5ac0-ab4d-4b10-892a-2de594a30085 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:32:28.564685 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1485/2926] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:32:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 07:32:35.408726 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1240c-2482-4802-b80d-eec66290fad0 service placement] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:32:35.410201 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b4b1240c-2482-4802-b80d-eec66290fad0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:32:35.428475 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1240c-2482-4802-b80d-eec66290fad0 service placement] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:32:35.433486 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d97445-c6a7-4b4b-b2c3-b4ea313a55c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:32:35.434348 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d97445-c6a7-4b4b-b2c3-b4ea313a55c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:32:35.434630 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d97445-c6a7-4b4b-b2c3-b4ea313a55c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:32:35.434900 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d97445-c6a7-4b4b-b2c3-b4ea313a55c5 admin admin] PATH_INFO: `/v3/users/9caf2e62387840e5ab72b3abe34f5008` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:32:35.436169 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d97445-c6a7-4b4b-b2c3-b4ea313a55c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9caf2e62387840e5ab72b3abe34f5008)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:32:35.438329 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d97445-c6a7-4b4b-b2c3-b4ea313a55c5 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:32:35.608856 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-89d97445-c6a7-4b4b-b2c3-b4ea313a55c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9caf2e62387840e5ab72b3abe34f5008'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:32:35.609524 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-89d97445-c6a7-4b4b-b2c3-b4ea313a55c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9caf2e62387840e5ab72b3abe34f5008'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:32:35.620985 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-89d97445-c6a7-4b4b-b2c3-b4ea313a55c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9caf2e62387840e5ab72b3abe34f5008'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:32:35.621609 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-89d97445-c6a7-4b4b-b2c3-b4ea313a55c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9caf2e62387840e5ab72b3abe34f5008'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:32:35.628252 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-89d97445-c6a7-4b4b-b2c3-b4ea313a55c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9caf2e62387840e5ab72b3abe34f5008'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:32:35.697821 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1442/2927] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:32:35 2022] DELETE /identity/v3/users/9caf2e62387840e5ab72b3abe34f5008 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:32:35.945015 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd5ac0-ab4d-4b10-892a-2de594a30085 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:32:35.955469 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd5ac0-ab4d-4b10-892a-2de594a30085 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:32:36.019158 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb97c08-7149-4074-b963-ab99190cf9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:32:36.020051 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb97c08-7149-4074-b963-ab99190cf9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:32:36.020333 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb97c08-7149-4074-b963-ab99190cf9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:32:36.020605 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb97c08-7149-4074-b963-ab99190cf9e2 admin admin] PATH_INFO: `/v3/projects/c8f49f13fc76471cab47c7270da89297` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:32:36.021780 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb97c08-7149-4074-b963-ab99190cf9e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8f49f13fc76471cab47c7270da89297)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:32:36.023657 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb97c08-7149-4074-b963-ab99190cf9e2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:32:36.133285 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-beb97c08-7149-4074-b963-ab99190cf9e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8f49f13fc76471cab47c7270da89297', 'request_id': 'req-beb97c08-7149-4074-b963-ab99190cf9e2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:32:36.235850 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-beb97c08-7149-4074-b963-ab99190cf9e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8f49f13fc76471cab47c7270da89297', 'request_id': 'req-beb97c08-7149-4074-b963-ab99190cf9e2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:32:36.242009 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-beb97c08-7149-4074-b963-ab99190cf9e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8f49f13fc76471cab47c7270da89297', 'request_id': 'req-beb97c08-7149-4074-b963-ab99190cf9e2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:32:36.253595 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-beb97c08-7149-4074-b963-ab99190cf9e2 admin admin] The token cache is being invalidate because project c8f49f13fc76471cab47c7270da89297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:32:36.253880 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-beb97c08-7149-4074-b963-ab99190cf9e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:32:36.254538 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-beb97c08-7149-4074-b963-ab99190cf9e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:32:36.256161 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1486/2928] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:32:35 2022] DELETE /identity/v3/projects/c8f49f13fc76471cab47c7270da89297 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:32:36.260209 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d97445-c6a7-4b4b-b2c3-b4ea313a55c5 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:32:36.262250 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-89d97445-c6a7-4b4b-b2c3-b4ea313a55c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:32:36.275346 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d97445-c6a7-4b4b-b2c3-b4ea313a55c5 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:32:36.331580 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6194e3c-84cf-4372-8f5f-aea9bfc8b179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:32:36.332472 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6194e3c-84cf-4372-8f5f-aea9bfc8b179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:32:36.332754 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6194e3c-84cf-4372-8f5f-aea9bfc8b179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:32:36.333027 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6194e3c-84cf-4372-8f5f-aea9bfc8b179 admin admin] PATH_INFO: `/v3/users/18db665a314846c194abc858697fc964` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:32:36.345576 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6194e3c-84cf-4372-8f5f-aea9bfc8b179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18db665a314846c194abc858697fc964)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:32:36.347499 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6194e3c-84cf-4372-8f5f-aea9bfc8b179 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:32:36.511344 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a6194e3c-84cf-4372-8f5f-aea9bfc8b179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18db665a314846c194abc858697fc964'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:32:36.512016 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a6194e3c-84cf-4372-8f5f-aea9bfc8b179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18db665a314846c194abc858697fc964'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:32:36.523615 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a6194e3c-84cf-4372-8f5f-aea9bfc8b179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18db665a314846c194abc858697fc964'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:32:36.524280 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a6194e3c-84cf-4372-8f5f-aea9bfc8b179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18db665a314846c194abc858697fc964'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:32:36.530903 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a6194e3c-84cf-4372-8f5f-aea9bfc8b179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18db665a314846c194abc858697fc964'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:32:36.601271 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1443/2929] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 12 07:32:36 2022] DELETE /identity/v3/users/18db665a314846c194abc858697fc964 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:32:36.872319 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb97c08-7149-4074-b963-ab99190cf9e2 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:32:36.873781 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-beb97c08-7149-4074-b963-ab99190cf9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:32:36.886741 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb97c08-7149-4074-b963-ab99190cf9e2 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:32:36.942140 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c378f84-2f11-47af-b285-eab30af33f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79cb9f096a814d81a7a9552741bc1a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2018cacb6f4eb3a54694e57a783679', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:32:36.942998 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c378f84-2f11-47af-b285-eab30af33f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:32:36.943280 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c378f84-2f11-47af-b285-eab30af33f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:32:36.943551 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c378f84-2f11-47af-b285-eab30af33f52 admin admin] PATH_INFO: `/v3/projects/6e86417338df454dbc8bf6bb82904c1d` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:32:36.953536 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c378f84-2f11-47af-b285-eab30af33f52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e86417338df454dbc8bf6bb82904c1d)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:32:36.955446 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c378f84-2f11-47af-b285-eab30af33f52 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:32:37.041429 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9c378f84-2f11-47af-b285-eab30af33f52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e86417338df454dbc8bf6bb82904c1d', 'request_id': 'req-9c378f84-2f11-47af-b285-eab30af33f52'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:32:37.092574 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9c378f84-2f11-47af-b285-eab30af33f52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e86417338df454dbc8bf6bb82904c1d', 'request_id': 'req-9c378f84-2f11-47af-b285-eab30af33f52'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:32:37.098075 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9c378f84-2f11-47af-b285-eab30af33f52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e86417338df454dbc8bf6bb82904c1d', 'request_id': 'req-9c378f84-2f11-47af-b285-eab30af33f52'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:32:37.110101 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9c378f84-2f11-47af-b285-eab30af33f52 admin admin] The token cache is being invalidate because project 6e86417338df454dbc8bf6bb82904c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 07:32:37.110386 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9c378f84-2f11-47af-b285-eab30af33f52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:32:37.111055 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9c378f84-2f11-47af-b285-eab30af33f52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 07:32:37.112656 dv-cinder-766064-5-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1487/2930] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 12 07:32:36 2022] DELETE /identity/v3/projects/6e86417338df454dbc8bf6bb82904c1d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 07:35:15.587883 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6194e3c-84cf-4372-8f5f-aea9bfc8b179 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 07:35:15.589291 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a6194e3c-84cf-4372-8f5f-aea9bfc8b179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:35:15.702067 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6194e3c-84cf-4372-8f5f-aea9bfc8b179 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 07:35:15.761257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b962b0a-8752-45e1-8b81-41df03978cf0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d2edf68b1b440097981097699bb307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e1a8b143974111b0ba09d041b331d5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 07:35:15.761257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b962b0a-8752-45e1-8b81-41df03978cf0 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 07:35:15.761257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b962b0a-8752-45e1-8b81-41df03978cf0 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 07:35:15.761257 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b962b0a-8752-45e1-8b81-41df03978cf0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 07:35:15.761695 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7b962b0a-8752-45e1-8b81-41df03978cf0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 07:35:15.772688 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b962b0a-8752-45e1-8b81-41df03978cf0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 07:35:15.774278 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b962b0a-8752-45e1-8b81-41df03978cf0 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 07:35:15.784455 dv-cinder-766064-5-iscsi devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1444/2931] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 12 07:35:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)